-- Logs begin at Mon 2022-05-23 11:48:20 UTC, end at Mon 2022-05-23 12:47:39 UTC. -- May 23 12:17:43.060815 dv-cinder-836996-27-smb systemd[1]: Starting Devstack devstack@keystone.service... May 23 12:17:43.067974 dv-cinder-836996-27-smb devstack@keystone.service[80191]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 23 12:17:43.069979 dv-cinder-836996-27-smb devstack@keystone.service[80191]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 12:17:43 2022] *** May 23 12:17:43.069979 dv-cinder-836996-27-smb devstack@keystone.service[80191]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 12:17:43.069979 dv-cinder-836996-27-smb devstack@keystone.service[80191]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 12:17:43.069979 dv-cinder-836996-27-smb devstack@keystone.service[80191]: nodename: dv-cinder-836996-27-smb May 23 12:17:43.069979 dv-cinder-836996-27-smb devstack@keystone.service[80191]: machine: x86_64 May 23 12:17:43.069979 dv-cinder-836996-27-smb devstack@keystone.service[80191]: clock source: unix May 23 12:17:43.069979 dv-cinder-836996-27-smb devstack@keystone.service[80191]: pcre jit disabled May 23 12:17:43.070419 dv-cinder-836996-27-smb devstack@keystone.service[80191]: detected number of CPU cores: 4 May 23 12:17:43.070419 dv-cinder-836996-27-smb devstack@keystone.service[80191]: current working directory: / May 23 12:17:43.070419 dv-cinder-836996-27-smb devstack@keystone.service[80191]: detected binary path: /usr/bin/uwsgi-core May 23 12:17:43.070419 dv-cinder-836996-27-smb devstack@keystone.service[80191]: your processes number limit is 47680 May 23 12:17:43.070419 dv-cinder-836996-27-smb devstack@keystone.service[80191]: your memory page size is 4096 bytes May 23 12:17:43.070419 dv-cinder-836996-27-smb devstack@keystone.service[80191]: detected max file descriptor number: 2048 May 23 12:17:43.070419 dv-cinder-836996-27-smb devstack@keystone.service[80191]: lock engine: pthread robust mutexes May 23 12:17:43.070419 dv-cinder-836996-27-smb devstack@keystone.service[80191]: thunder lock: enabled May 23 12:17:43.070419 dv-cinder-836996-27-smb devstack@keystone.service[80191]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 23 12:17:43.070419 dv-cinder-836996-27-smb devstack@keystone.service[80191]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 12:17:43.116325 dv-cinder-836996-27-smb devstack@keystone.service[80191]: Python main interpreter initialized at 0x55eacb30e9c0 May 23 12:17:43.116325 dv-cinder-836996-27-smb devstack@keystone.service[80191]: python threads support enabled May 23 12:17:43.116325 dv-cinder-836996-27-smb devstack@keystone.service[80191]: your server socket listen backlog is limited to 100 connections May 23 12:17:43.116325 dv-cinder-836996-27-smb devstack@keystone.service[80191]: your mercy for graceful operations on workers is 90 seconds May 23 12:17:43.117243 dv-cinder-836996-27-smb devstack@keystone.service[80191]: mapped 403077 bytes (393 KB) for 2 cores May 23 12:17:43.117243 dv-cinder-836996-27-smb devstack@keystone.service[80191]: *** Operational MODE: preforking *** May 23 12:17:43.117243 dv-cinder-836996-27-smb devstack@keystone.service[80191]: *** uWSGI is running in multiple interpreter mode *** May 23 12:17:43.117243 dv-cinder-836996-27-smb devstack@keystone.service[80191]: spawned uWSGI master process (pid: 80191) May 23 12:17:43.117265 dv-cinder-836996-27-smb systemd[1]: Started Devstack devstack@keystone.service. May 23 12:17:43.122547 dv-cinder-836996-27-smb devstack@keystone.service[80191]: spawned uWSGI worker 1 (pid: 80198, cores: 1) May 23 12:17:43.122547 dv-cinder-836996-27-smb devstack@keystone.service[80191]: spawned uWSGI worker 2 (pid: 80199, cores: 1) May 23 12:17:43.122547 dv-cinder-836996-27-smb devstack@keystone.service[80191]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 12:17:48.744576 dv-cinder-836996-27-smb devstack@keystone.service[80198]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:17:48.744576 dv-cinder-836996-27-smb devstack@keystone.service[80198]: from cryptography.utils import int_from_bytes May 23 12:17:48.745363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:17:48.745363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: from cryptography.utils import int_from_bytes May 23 12:17:48.771122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:17:48.771122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: from cryptography.utils import int_from_bytes May 23 12:17:48.771691 dv-cinder-836996-27-smb devstack@keystone.service[80199]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 12:17:48.771691 dv-cinder-836996-27-smb devstack@keystone.service[80199]: from cryptography.utils import int_from_bytes May 23 12:17:48.794976 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 12:17:48.795170 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 12:17:48.795363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] command line args: [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 12:17:48.795633 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 12:17:48.795811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ================================================================================ {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 12:17:48.796067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] admin_token = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.796316 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] config_dir = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.796504 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.796686 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] config_source = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.796865 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] debug = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.797062 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.798229 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.798229 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.798229 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.798229 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.798474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] list_limit = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.798474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] log_config_append = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.798679 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.798862 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] log_dir = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.799046 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] log_file = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.799285 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.799535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.799783 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.800031 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.800207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.800383 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.800628 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.800874 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.801109 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.801342 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.801576 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.801807 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.802054 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.802301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.802601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.803090 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.803272 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] publish_errors = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.803504 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.803735 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.803912 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.804158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.804395 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.804631 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] standard_threads = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.804861 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.805105 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.805281 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.805456 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] use_journal = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.805632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] use_json = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.805807 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] use_stderr = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.805981 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] use_syslog = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.806213 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.806470 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.806739 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.807002 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.807243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.807491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.807729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.808503 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.808743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.808996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.809246 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.809499 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.809736 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.809986 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.810224 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.810472 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.810746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.810984 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.811240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.811497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.811745 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.811981 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.812234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.812494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.812747 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.812998 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.813230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.813462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.813695 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.813933 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.814183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.814432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.814687 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.814919 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.815165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.815412 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.815651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.815899 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.816134 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.816372 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.816605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.816837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.817068 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.817298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.817527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.817764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.818012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.818130 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 12:17:48.818246 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 12:17:48.818363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.818489 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] command line args: [] {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 12:17:48.818624 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.818748 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 12:17:48.818863 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.818982 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ================================================================================ {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 12:17:48.819095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.819221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] admin_token = **** {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.819335 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.819448 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] config_dir = [] {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.819560 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.819671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.819671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] config_source = [] {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.819893 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.820014 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] debug = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.820135 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.820256 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.820396 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.820587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.820710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.820825 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.820938 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.821050 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.821162 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.821282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.821397 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.821509 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] list_limit = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.821509 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] log_config_append = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.821728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.821841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.821962 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.822077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] log_dir = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.822077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] log_file = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.822292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.822414 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.822563 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.822682 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.822806 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.822921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.823034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.823151 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.823267 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.823392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.823508 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.823662 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.823790 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.823904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.824546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.824662 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.824776 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.824888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.825006 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.825121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.825242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.825356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.825470 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.825583 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.825701 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.825815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.825999 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.826116 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.826235 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.826349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.826463 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.826463 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.826708 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.826824 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.826936 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] publish_errors = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.827055 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.827180 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.827180 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.827392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.827504 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.827630 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.827752 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.827874 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.827995 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.828109 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.828221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] standard_threads = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.828340 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.828454 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.828575 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.828690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.828803 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.828938 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.828938 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] use_journal = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.829152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.829273 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] use_json = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.829387 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.829500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] use_stderr = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.829611 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.829724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] use_syslog = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.829837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.829957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 12:17:48.830085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.830205 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.830325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.830439 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.830575 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.830703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.830820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.830933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.831029 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.831123 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.831217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.831319 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.831455 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.831564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.831662 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.831758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.831860 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.831966 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.832063 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.832123 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.832198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.832320 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.832436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.832559 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.832664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.832776 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.832896 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] auth.external = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.833011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.833132 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.833256 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.833373 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.833496 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.833617 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.833732 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.833856 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] auth.password = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.833974 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.834096 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] auth.token = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.834226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.834342 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.834455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.834590 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.834707 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.834832 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.834950 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.835063 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.835166 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.835277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.835400 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.835505 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.835617 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.835730 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.835843 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.835956 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] credential.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.836077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.836242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.836363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.836477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.836591 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.836704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.836827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.836942 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.837056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.837170 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.837283 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.837396 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.837518 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.837634 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.837747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.837860 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.837972 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.838093 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.838284 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.838401 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.838530 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.838530 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.838746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.838870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.838994 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.839111 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.839280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.839408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.839528 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.839653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.839777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.839900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.840022 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.840144 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.840267 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.840383 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.840506 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.840634 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.840759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.840882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.840998 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.841112 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.841227 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.841333 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.841431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.841528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.841632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.841757 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.841885 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.842013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.842013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.842237 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.842355 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.842470 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.842639 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.842767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.842884 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.842999 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.843112 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.843226 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.843341 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.843463 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.843580 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.843694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.843807 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.843926 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.844040 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.844180 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.844301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.844301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.844556 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.844682 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.844799 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.844913 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.845028 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.845154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.845271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.845386 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.845571 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.845689 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.845805 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.845928 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.846046 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.846160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.846275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.846390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.846526 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.846659 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.846659 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.846888 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.847003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.847109 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.847223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.847347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.847464 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.847580 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.847695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.847809 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.847923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.848050 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.848168 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.848285 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.848399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.848399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.848615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.848738 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.848855 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.848969 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.849083 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.849198 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.849319 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.849444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.849561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.849685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.849802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.849917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.850032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.850159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.850284 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.850402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.850530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.850649 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.850765 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.850891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.851009 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.851124 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.851239 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.851354 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.851469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.851657 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.851778 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.851892 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.852008 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.852122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.852237 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.852360 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.852477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.852592 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.852706 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.852859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.852986 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.853115 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.853233 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.853348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.853463 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.853578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.853692 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.853821 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.853939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.854059 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.854175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.854290 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] auth.external = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.854394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.854530 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.854649 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.854765 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.854911 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.855027 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.855142 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.855271 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] auth.password = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.855396 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.855513 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] auth.token = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.855628 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.855744 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.855859 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.855984 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.856110 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.856228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.856350 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.856467 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.856581 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.856709 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.856837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.856966 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.857083 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.857205 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.857329 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.857446 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] credential.caching = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.857561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.857676 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.857791 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.857907 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.858031 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.858148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.858264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.858378 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.858493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.858665 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.858793 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.858917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.859035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.859150 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.859271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.859388 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.859512 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.859629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.859744 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.859859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.859973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.860088 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.860211 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.860211 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.860430 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.860544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.860659 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.861021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.861146 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.861264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.861379 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.861494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.861609 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] federation.caching = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.861731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.861856 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.861973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.862088 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.862204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.862319 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.862434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.862573 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.862693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.862809 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.862925 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.863030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.863127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.863241 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.863366 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.863483 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.863590 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.863690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.863788 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.863905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.864006 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.864103 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.864199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.864297 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] identity.caching = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.864395 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.864500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.864500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.864691 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.864789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.864885 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.864981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.865093 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.865192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.865289 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.865387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.865489 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.865586 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.865693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.865800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.865918 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.866033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.866147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.866261 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.866389 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.866562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.866681 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] role.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.866807 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.866924 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] role.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.867039 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.867163 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.867281 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.867396 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.867512 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.867626 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.867742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.867867 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.867985 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.868100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.868215 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.868330 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.868454 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.868572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.868688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.868803 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.868917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.868917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.869141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.869257 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.869372 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.869486 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.869601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.869715 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.869838 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.869956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.870072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.870187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.870301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.870416 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.870416 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.871174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.871289 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.871404 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.871519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.871634 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.871757 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.871874 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.871989 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.872103 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.872218 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.872333 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.872457 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.872575 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.872692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.872806 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.872921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.873035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.873159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.873276 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.873391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.873506 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.873620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.873735 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.873861 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.873979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.874094 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.874208 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.874323 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.874437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.874643 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.874764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.874886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.875002 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.875118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.875232 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.875356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.875473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.875588 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.875709 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] token.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.875826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.875941 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.876065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.876182 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.876297 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.user = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.876410 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.876525 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.876640 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.876763 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.876882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.876997 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.877111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.877226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.877348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.877465 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.877580 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.877695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.877695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.877911 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.878033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.878150 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.878263 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.878377 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.878491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.878622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.878752 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.878870 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.878870 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.879086 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.879200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.879315 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.879441 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.879558 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.879672 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.879787 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.879901 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.connection = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.880025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.880151 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.880267 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.880267 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.880493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.880613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.880729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.880843 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.880966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.881095 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.881212 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.881326 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.881441 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.881555 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.881670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.881793 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.881910 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.882025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.882141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.882256 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.882370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.882493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.882687 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.882802 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.882916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.883030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.883145 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.883272 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.883390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.883506 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.883620 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.883734 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.883852 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.883974 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.884091 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.884206 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.884321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.884321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 12:17:48.884537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.884537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.884537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] resource.caching = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.884537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.884537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.884537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.884537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.884537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.884537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.885474 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.885474 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.885474 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.885474 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] role.caching = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.885474 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] role.driver = sql {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.885996 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.885996 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.886785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.887039 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.887287 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.887532 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.887778 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.888021 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.888266 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.888498 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.888767 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.889013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.889256 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.889498 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.889913 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.890151 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.890403 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.890678 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.890928 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.891178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.891412 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.891665 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.891915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.892161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.892399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.892632 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.892862 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.893109 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.893363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.893608 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.893842 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.894061 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.894293 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.894547 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] token.caching = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.894786 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.895030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.895264 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.895517 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.895762 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.895997 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.896238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.896479 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.896723 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.896956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.897192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.897422 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.897665 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.897908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.898135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.898374 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.898694 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.898964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] database.connection = **** {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.899207 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.899453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.899687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.899926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.900159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.900392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.900624 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.900858 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.901098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.901331 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.901579 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.901850 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.902095 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.902334 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.902598 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.902830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.903069 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.903305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 12:17:48.903472 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 12:17:48.913515 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:48.913752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:48.913977 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:48.922640 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:48.928017 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:48.928251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:48.928477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:48.938774 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:48.951702 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:48.951935 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:48.957581 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:48.957809 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.004378 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.004899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.055970 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.056194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.056370 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.056606 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.123519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.123758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.123849 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.123950 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.124031 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.124106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.124179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.124254 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.124373 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.124459 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.124588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.124672 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.147711 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.147835 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.147995 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.148120 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.148218 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.148293 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.148394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.148493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.148616 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.148698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.148830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.148912 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.149041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.149126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.160423 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.160537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.173403 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.173589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.173675 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.173815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.173898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.174038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.174121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.174258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.174342 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.174469 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.174581 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.174709 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.174804 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.174920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80199) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 12:17:49.192432 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.192642 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 12:17:49.192750 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.192927 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 12:17:49.193010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.193207 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 12:17:49.193288 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.193478 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.193573 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 12:17:49.193730 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.193814 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.193981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.194064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.194229 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.194312 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.194529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.206000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.206275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.206571 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.206854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.207500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.207773 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.208040 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.208317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.215477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.216980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80199) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.218750 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.219029 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.219307 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.219587 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.219868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.220126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.220236 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80199) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.220394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.220515 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.220776 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.220859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.221047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.221129 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.221318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.221407 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.221588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.221670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.221939 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.222210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.222478 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.222773 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.223038 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.248171 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.249255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.249925 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.250204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.250982 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80199) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.251260 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.255504 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.255738 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.256019 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.256468 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80199) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.256743 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.257017 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.264038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.264262 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.264844 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80199) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.265128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.268797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.269200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.269484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.269615 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80199) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.269752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.269938 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.270022 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.270219 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.270321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.270546 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.270714 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.270800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.270875 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.271045 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.271312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.271574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.289928 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.290210 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.290686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.290971 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.294893 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.295656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80199) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.298467 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.298782 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.299351 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.299641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.303817 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.304647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80199) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.307404 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.308262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80199) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.311200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.311510 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.311796 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.312013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.312180 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.312310 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.312394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.312603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.312687 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.312891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.313166 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.313446 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.331888 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.332176 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.332442 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.332675 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80199) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.332761 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.332960 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.333222 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.333479 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.341298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.342019 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.342976 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.343253 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.343729 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.344008 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.346333 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.346596 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.346877 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.347068 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80199) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.347151 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.347344 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.347428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.347618 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.347894 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.348166 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.360966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.361248 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.361532 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.361800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80199) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.361892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.362075 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.362158 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.362350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.362432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.362647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.362734 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.362933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.363208 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.363477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.380511 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.381276 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80199) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.383800 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.384531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80199) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.387635 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.388349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.389222 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.389950 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.390880 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.391165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.391443 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.391575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80199) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.391858 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.392142 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.398806 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.399511 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.400410 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.401096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80199) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.404221 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.404517 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.404798 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.405016 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.405120 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.405339 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.405674 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.405998 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.414091 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.414379 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.414787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.415035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80199) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.415319 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.415696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.422666 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.422949 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.423235 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.423507 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.423590 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80199) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 12:17:49.423776 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.423868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.424056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.424138 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.424336 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.424450 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.424602 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.424698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.424864 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.424957 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.425129 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.425213 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.425396 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.425476 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.425651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.425732 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.425928 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.426011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.426192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.426272 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.426451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.426728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.426990 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80199) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 12:17:49.465690 dv-cinder-836996-27-smb devstack@keystone.service[80198]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55eacb30e9c0 pid: 80198 (default app) May 23 12:17:49.466330 dv-cinder-836996-27-smb devstack@keystone.service[80199]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55eacb30e9c0 pid: 80199 (default app) May 23 12:17:49.468934 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04ad0d-6560-4f9a-b694-fbfe49e661ad None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:17:49.469228 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04ad0d-6560-4f9a-b694-fbfe49e661ad None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:17:49.469503 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04ad0d-6560-4f9a-b694-fbfe49e661ad None None] PATH_INFO: `/v3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:17:49.473781 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Mon May 23 12:17:49 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:17:57.462052 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a0ea4-565e-4263-b8c1-5a97be2babf6 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:17:57.462614 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a0ea4-565e-4263-b8c1-5a97be2babf6 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:17:57.462614 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a0ea4-565e-4263-b8c1-5a97be2babf6 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:17:57.467067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:17:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:17:57.472208 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ba875-7c74-4481-bf2a-a1dccd06a58f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:17:57.472591 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ba875-7c74-4481-bf2a-a1dccd06a58f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:17:57.472754 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ba875-7c74-4481-bf2a-a1dccd06a58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:17:57.547045 dv-cinder-836996-27-smb devstack@keystone.service[80198]: INFO dbcounter [None req-317ba875-7c74-4481-bf2a-a1dccd06a58f None None] Registered counter for database keystone May 23 12:17:57.568772 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG oslo_db.sqlalchemy.engines [None req-317ba875-7c74-4481-bf2a-a1dccd06a58f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:17:57.574963 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writer thread running {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:17:57.755954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG passlib.handlers.bcrypt [None req-317ba875-7c74-4481-bf2a-a1dccd06a58f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80198) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 23 12:17:57.756304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG passlib.handlers.bcrypt [None req-317ba875-7c74-4481-bf2a-a1dccd06a58f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80198) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 23 12:17:57.811485 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-317ba875-7c74-4481-bf2a-a1dccd06a58f None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:17:57.813096 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-317ba875-7c74-4481-bf2a-a1dccd06a58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:17:57.937506 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:17:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 23 12:17:58.115118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a0ea4-565e-4263-b8c1-5a97be2babf6 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:17:58.184266 dv-cinder-836996-27-smb devstack@keystone.service[80199]: INFO dbcounter [None req-2d9a0ea4-565e-4263-b8c1-5a97be2babf6 None None] Registered counter for database keystone May 23 12:17:58.203824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG oslo_db.sqlalchemy.engines [None req-2d9a0ea4-565e-4263-b8c1-5a97be2babf6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 12:17:58.210045 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writer thread running {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 12:17:58.329326 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a0ea4-565e-4263-b8c1-5a97be2babf6 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:17:58.333560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14ed68-86bc-46e6-9e10-d92bcc940ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:17:58.334224 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14ed68-86bc-46e6-9e10-d92bcc940ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:17:58.334527 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14ed68-86bc-46e6-9e10-d92bcc940ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:17:58.334816 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14ed68-86bc-46e6-9e10-d92bcc940ac0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:17:58.342892 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14ed68-86bc-46e6-9e10-d92bcc940ac0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:17:58.395061 dv-cinder-836996-27-smb devstack@keystone.service[80199]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ab14ed68-86bc-46e6-9e10-d92bcc940ac0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 23 12:17:58.395340 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14ed68-86bc-46e6-9e10-d92bcc940ac0 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:17:58.405511 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Mon May 23 12:17:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:17:58.411593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ba875-7c74-4481-bf2a-a1dccd06a58f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:17:58.426086 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ba875-7c74-4481-bf2a-a1dccd06a58f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:17:58.430471 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967137ae-7e8e-4e39-900c-1ad711d7365c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:17:58.431604 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967137ae-7e8e-4e39-900c-1ad711d7365c admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:17:58.431892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967137ae-7e8e-4e39-900c-1ad711d7365c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:17:58.432175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967137ae-7e8e-4e39-900c-1ad711d7365c admin admin] PATH_INFO: `/v3/projects/14be2fbaccef4510a5810ab627c88a01` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:17:58.433725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967137ae-7e8e-4e39-900c-1ad711d7365c admin admin] RBAC: Authorizing `identity:get_project(project_id=14be2fbaccef4510a5810ab627c88a01)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:17:58.592340 dv-cinder-836996-27-smb devstack@keystone.service[80198]: WARNING keystone.common.rbac_enforcer.enforcer [None req-967137ae-7e8e-4e39-900c-1ad711d7365c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 23 12:17:58.592993 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967137ae-7e8e-4e39-900c-1ad711d7365c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:17:58.597584 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Mon May 23 12:17:58 2022] GET /identity/v3/projects/14be2fbaccef4510a5810ab627c88a01 => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:00.754697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febd241-ea65-4a07-ab5a-385bcd4e2734 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:00.755218 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febd241-ea65-4a07-ab5a-385bcd4e2734 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:00.755328 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febd241-ea65-4a07-ab5a-385bcd4e2734 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:00.759391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:18:00.765467 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64d065-7ad2-4186-a707-bf157a21cea4 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:00.765892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64d065-7ad2-4186-a707-bf157a21cea4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:00.766026 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64d065-7ad2-4186-a707-bf157a21cea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:00.784439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6f64d065-7ad2-4186-a707-bf157a21cea4 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:00.785938 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6f64d065-7ad2-4186-a707-bf157a21cea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:00.793721 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 23 12:18:00.815795 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febd241-ea65-4a07-ab5a-385bcd4e2734 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:00.828264 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febd241-ea65-4a07-ab5a-385bcd4e2734 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:00.832418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5488490-5513-4d4d-8809-f220a7782bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:00.833046 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5488490-5513-4d4d-8809-f220a7782bac admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:00.833338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5488490-5513-4d4d-8809-f220a7782bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:00.833623 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5488490-5513-4d4d-8809-f220a7782bac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:00.841279 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5488490-5513-4d4d-8809-f220a7782bac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:00.843108 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5488490-5513-4d4d-8809-f220a7782bac admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:00.851873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Mon May 23 12:18:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:18:00.857202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64d065-7ad2-4186-a707-bf157a21cea4 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:00.866321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64d065-7ad2-4186-a707-bf157a21cea4 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:00.871146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f33e9-c76d-4324-a59a-108afdc5e540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:00.872082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f33e9-c76d-4324-a59a-108afdc5e540 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:00.872367 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f33e9-c76d-4324-a59a-108afdc5e540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:00.872643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f33e9-c76d-4324-a59a-108afdc5e540 admin admin] PATH_INFO: `/v3/users/38b5788f4258438a9175f55196c13413` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:00.874019 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f33e9-c76d-4324-a59a-108afdc5e540 admin admin] RBAC: Authorizing `identity:get_user(user_id=38b5788f4258438a9175f55196c13413)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:00.875884 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f33e9-c76d-4324-a59a-108afdc5e540 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:00.877425 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Mon May 23 12:18:00 2022] GET /identity/v3/users/38b5788f4258438a9175f55196c13413 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:03.149972 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616b433-5224-4718-90bd-90360eadb4d9 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:03.150534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616b433-5224-4718-90bd-90360eadb4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:03.150636 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616b433-5224-4718-90bd-90360eadb4d9 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:03.152455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:03.157620 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c008b-4b0b-4bd7-ad2f-9d1dcb5d8803 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:03.158074 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c008b-4b0b-4bd7-ad2f-9d1dcb5d8803 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:03.158186 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c008b-4b0b-4bd7-ad2f-9d1dcb5d8803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:03.165425 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb72a8-9a96-40e4-9ab2-74bd6efbbd9b None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:03.165714 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb72a8-9a96-40e4-9ab2-74bd6efbbd9b None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:03.165995 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb72a8-9a96-40e4-9ab2-74bd6efbbd9b None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:03.167363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:03.173052 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd9b25-b9a7-4e16-84ac-b2a7819e0b53 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:03.173347 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd9b25-b9a7-4e16-84ac-b2a7819e0b53 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:03.173636 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd9b25-b9a7-4e16-84ac-b2a7819e0b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:03.175694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-583c008b-4b0b-4bd7-ad2f-9d1dcb5d8803 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:03.176891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-583c008b-4b0b-4bd7-ad2f-9d1dcb5d8803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:03.212332 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG passlib.handlers.bcrypt [None req-b8dd9b25-b9a7-4e16-84ac-b2a7819e0b53 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80199) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 23 12:18:03.212767 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG passlib.handlers.bcrypt [None req-b8dd9b25-b9a7-4e16-84ac-b2a7819e0b53 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80199) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 23 12:18:03.260303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:03.261092 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-b8dd9b25-b9a7-4e16-84ac-b2a7819e0b53 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:03.262753 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-b8dd9b25-b9a7-4e16-84ac-b2a7819e0b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:03.287205 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c008b-4b0b-4bd7-ad2f-9d1dcb5d8803 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:03.320325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:03.366712 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:18:03.388015 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd9b25-b9a7-4e16-84ac-b2a7819e0b53 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:03.405454 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c008b-4b0b-4bd7-ad2f-9d1dcb5d8803 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:03.438074 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69536f-2157-4f61-8d2d-c3e27e822dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:03.438904 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69536f-2157-4f61-8d2d-c3e27e822dfa None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:03.439197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69536f-2157-4f61-8d2d-c3e27e822dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:03.439482 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69536f-2157-4f61-8d2d-c3e27e822dfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:03.451508 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69536f-2157-4f61-8d2d-c3e27e822dfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:03.462651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-ff69536f-2157-4f61-8d2d-c3e27e822dfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:18:03.462651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:03.462651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:03.462651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:03.462651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:03.462651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:03.462651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:03.462651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:03.462651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:03.462651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:03.462651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:03.462651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:03.462651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:03.462651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:03.462651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:03.462651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:03.464282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:03.464282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:03.464282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:03.464282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:03.464282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:03.464282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:03.464282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:03.464282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:03.464282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:03.464282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:03.464282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:03.464282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:18:03.464282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:03.464282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:03.464282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:03.464282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:03.465127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:03.465127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:03.465127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:03.465127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:03.465127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:03.465127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:03.465127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:03.465127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:03.465127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:03.465127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:03.465127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:18:03.465127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:18:03.465127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:18:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:18:03.470879 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69536f-2157-4f61-8d2d-c3e27e822dfa None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:03.489732 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd9b25-b9a7-4e16-84ac-b2a7819e0b53 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:03.492017 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:03.531164 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece76fe1-5e6c-45a0-9f9f-c0a813ea7322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:03.532068 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece76fe1-5e6c-45a0-9f9f-c0a813ea7322 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:03.532360 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece76fe1-5e6c-45a0-9f9f-c0a813ea7322 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:03.532644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece76fe1-5e6c-45a0-9f9f-c0a813ea7322 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:03.553234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:03.573966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69536f-2157-4f61-8d2d-c3e27e822dfa None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:03.609797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece76fe1-5e6c-45a0-9f9f-c0a813ea7322 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:03.611842 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece76fe1-5e6c-45a0-9f9f-c0a813ea7322 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:03.614436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807fefd-9810-4585-9e18-2db2a858299d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:03.615139 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807fefd-9810-4585-9e18-2db2a858299d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:03.616304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807fefd-9810-4585-9e18-2db2a858299d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:03.616304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807fefd-9810-4585-9e18-2db2a858299d None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:03.616552 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807fefd-9810-4585-9e18-2db2a858299d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:03.616759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807fefd-9810-4585-9e18-2db2a858299d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:03.618174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807fefd-9810-4585-9e18-2db2a858299d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:03.630688 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 8/15] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:03.636689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807fefd-9810-4585-9e18-2db2a858299d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:03.716575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 12:18:03.723236 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece76fe1-5e6c-45a0-9f9f-c0a813ea7322 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:03.725965 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:03.742193 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807fefd-9810-4585-9e18-2db2a858299d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:03.775585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bb7a5-4937-4969-acca-7c20b775a362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:03.776451 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bb7a5-4937-4969-acca-7c20b775a362 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:03.776735 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bb7a5-4937-4969-acca-7c20b775a362 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:03.777005 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bb7a5-4937-4969-acca-7c20b775a362 None admin] PATH_INFO: `/v3/users/38b5788f4258438a9175f55196c13413` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:03.778201 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bb7a5-4937-4969-acca-7c20b775a362 None admin] RBAC: Authorizing `identity:get_user(user_id=38b5788f4258438a9175f55196c13413)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:03.779699 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bb7a5-4937-4969-acca-7c20b775a362 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:03.781295 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:03 2022] GET /identity/v3/users/38b5788f4258438a9175f55196c13413 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:03.786521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bb7a5-4937-4969-acca-7c20b775a362 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:03.800217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:03.826526 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece76fe1-5e6c-45a0-9f9f-c0a813ea7322 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:03.858972 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5b64c-dbd1-4959-82b3-1c1216946636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:03.859758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5b64c-dbd1-4959-82b3-1c1216946636 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:03.860045 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5b64c-dbd1-4959-82b3-1c1216946636 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:03.860585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5b64c-dbd1-4959-82b3-1c1216946636 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:03.879032 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5b64c-dbd1-4959-82b3-1c1216946636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:03.880508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5b64c-dbd1-4959-82b3-1c1216946636 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:03.885025 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bb7a5-4937-4969-acca-7c20b775a362 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:03.901338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-f8b5b64c-dbd1-4959-82b3-1c1216946636 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:18:03.901338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:03.901338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:03.901338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:03.901338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:03.901338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:03.901338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:03.901338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:03.901338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:03.901338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:03.901338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:03.901338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:03.901338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:18:03.901338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:18:03.901338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:18:03.902275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:18:03.902275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:03.902275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:03.902275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:03.902275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:03.902275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:03.902275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:03.902275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:03.902275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:18:03.902275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:03.902275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:03.902275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:03.902275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:03.902275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:03.902275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:03.902275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:03.902275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:03.903113 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:18:03.903113 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:18:03.903113 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:18:03.903113 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:18:03.903113 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 9/18] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:18:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:18:03.908641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5b64c-dbd1-4959-82b3-1c1216946636 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:03.929261 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa0876-6f29-4848-85fd-4175298ac479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:03.930061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa0876-6f29-4848-85fd-4175298ac479 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:03.930351 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa0876-6f29-4848-85fd-4175298ac479 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:03.930664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa0876-6f29-4848-85fd-4175298ac479 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:03.931865 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa0876-6f29-4848-85fd-4175298ac479 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:03.933884 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa0876-6f29-4848-85fd-4175298ac479 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:03.935525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 10/19] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:18:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:03.941133 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa0876-6f29-4848-85fd-4175298ac479 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:03.967795 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:04.013560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5b64c-dbd1-4959-82b3-1c1216946636 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:04.023425 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:04.042481 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa0876-6f29-4848-85fd-4175298ac479 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:04.046970 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92feee11-0d1d-474e-b102-6727efe16361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:04.047637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92feee11-0d1d-474e-b102-6727efe16361 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:04.047929 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92feee11-0d1d-474e-b102-6727efe16361 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:04.048213 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92feee11-0d1d-474e-b102-6727efe16361 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:04.048946 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92feee11-0d1d-474e-b102-6727efe16361 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:04.049260 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92feee11-0d1d-474e-b102-6727efe16361 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:04.050697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92feee11-0d1d-474e-b102-6727efe16361 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:04.068285 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 10/20] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:04.077606 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e789d04-5958-489a-b3f4-05ab0c6d8d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:04.078283 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e789d04-5958-489a-b3f4-05ab0c6d8d56 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:04.078600 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e789d04-5958-489a-b3f4-05ab0c6d8d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:04.078880 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e789d04-5958-489a-b3f4-05ab0c6d8d56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:04.079741 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e789d04-5958-489a-b3f4-05ab0c6d8d56 None admin] RBAC: Adding query filter params (role.id=3ae7c5e54e084ac4a1f94da93a667583, scope.domain.id=default, user.id=38b5788f4258438a9175f55196c13413) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:04.080068 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e789d04-5958-489a-b3f4-05ab0c6d8d56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:04.081581 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e789d04-5958-489a-b3f4-05ab0c6d8d56 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:04.089373 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 11/21] 10.222.0.25 () {56 vars in 1322 bytes} [Mon May 23 12:18:03 2022] GET /identity/v3/role_assignments?user.id=38b5788f4258438a9175f55196c13413&scope.domain.id=default&role.id=3ae7c5e54e084ac4a1f94da93a667583 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:06.687200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f773c6-d531-4cf9-8c99-99bb3f79568e None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:06.688280 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f773c6-d531-4cf9-8c99-99bb3f79568e None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:06.688815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f773c6-d531-4cf9-8c99-99bb3f79568e None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:06.690526 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 11/22] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:06.696947 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf283ad-a034-4929-aab2-7a427f5e736d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:06.698463 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf283ad-a034-4929-aab2-7a427f5e736d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:06.699047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf283ad-a034-4929-aab2-7a427f5e736d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:06.718940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-adf283ad-a034-4929-aab2-7a427f5e736d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:06.720499 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-adf283ad-a034-4929-aab2-7a427f5e736d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:06.792798 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 12/23] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:06.827908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f773c6-d531-4cf9-8c99-99bb3f79568e None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:06.882843 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9fcb0-7d2c-4e6a-ba66-792495f3b19c None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:06.883513 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9fcb0-7d2c-4e6a-ba66-792495f3b19c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:06.884037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9fcb0-7d2c-4e6a-ba66-792495f3b19c None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:06.886257 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:18:06.891609 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46550c-0e81-4e69-946b-a36ae8e826ba None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:06.892382 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46550c-0e81-4e69-946b-a36ae8e826ba None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:06.892904 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46550c-0e81-4e69-946b-a36ae8e826ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:06.918527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-cb46550c-0e81-4e69-946b-a36ae8e826ba None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:06.921104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cb46550c-0e81-4e69-946b-a36ae8e826ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:07.033593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 14/25] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:18:07.035126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7115e3-4d83-40e4-80ab-51ba0b9c6d3d None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:07.035425 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7115e3-4d83-40e4-80ab-51ba0b9c6d3d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:07.035710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7115e3-4d83-40e4-80ab-51ba0b9c6d3d None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:07.041382 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 15/26] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:07.043999 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92786378-b036-4cfc-b181-1fb9da41a3d3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:07.044294 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92786378-b036-4cfc-b181-1fb9da41a3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:07.044580 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92786378-b036-4cfc-b181-1fb9da41a3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:07.070990 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:07.083843 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-92786378-b036-4cfc-b181-1fb9da41a3d3 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:07.085089 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-92786378-b036-4cfc-b181-1fb9da41a3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:07.156074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f773c6-d531-4cf9-8c99-99bb3f79568e None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:07.194905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:07.225055 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 16/27] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:18:07.225644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92786378-b036-4cfc-b181-1fb9da41a3d3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:07.227296 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874d16b-169c-4e5c-bd4e-7047b9dd7e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:07.228159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874d16b-169c-4e5c-bd4e-7047b9dd7e25 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:07.228453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874d16b-169c-4e5c-bd4e-7047b9dd7e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:07.228734 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874d16b-169c-4e5c-bd4e-7047b9dd7e25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:07.255129 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874d16b-169c-4e5c-bd4e-7047b9dd7e25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:07.265920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-c874d16b-169c-4e5c-bd4e-7047b9dd7e25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:18:07.265920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:07.265920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:07.265920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:07.265920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:07.265920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:07.265920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:07.265920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:07.265920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:07.265920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:07.265920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:07.265920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:07.265920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:07.265920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:07.265920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:07.265920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:07.266866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:07.266866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:07.266866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:07.266866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:07.266866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:07.266866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:07.266866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:07.266866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:07.266866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:07.266866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:07.266866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:07.266866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:18:07.266866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:07.266866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:07.266866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:07.266866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:07.267653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:07.267653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:07.267653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:07.267653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:07.267653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:07.267653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:07.267653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:07.267653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:07.267653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:07.267653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:07.267653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:18:07.267653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:18:07.269978 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 12/28] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:18:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 443 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:07.271020 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874d16b-169c-4e5c-bd4e-7047b9dd7e25 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:07.374432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92786378-b036-4cfc-b181-1fb9da41a3d3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:07.418450 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904b752-5b9e-4df7-8cfc-78eb0e0310ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:07.419153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904b752-5b9e-4df7-8cfc-78eb0e0310ad None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:07.419439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904b752-5b9e-4df7-8cfc-78eb0e0310ad None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:07.419717 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904b752-5b9e-4df7-8cfc-78eb0e0310ad None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:07.420470 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904b752-5b9e-4df7-8cfc-78eb0e0310ad None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:07.421893 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904b752-5b9e-4df7-8cfc-78eb0e0310ad None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:07.424644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:07.493914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874d16b-169c-4e5c-bd4e-7047b9dd7e25 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:07.542798 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bac3f6-6efc-46aa-86a7-a5697d7f4f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:07.543935 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bac3f6-6efc-46aa-86a7-a5697d7f4f3b None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:07.544575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bac3f6-6efc-46aa-86a7-a5697d7f4f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:07.545055 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bac3f6-6efc-46aa-86a7-a5697d7f4f3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:07.556275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bac3f6-6efc-46aa-86a7-a5697d7f4f3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:07.558524 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bac3f6-6efc-46aa-86a7-a5697d7f4f3b None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:07.577286 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 17/29] 10.222.0.25 () {60 vars in 1131 bytes} [Mon May 23 12:18:07 2022] POST /identity/v3/roles => generated 219 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:18:07.577959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-79bac3f6-6efc-46aa-86a7-a5697d7f4f3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:18:07.577959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:07.577959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:07.577959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:07.577959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:07.577959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:07.577959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:07.577959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:07.577959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:07.577959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:07.577959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:07.577959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:07.577959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:18:07.577959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:18:07.577959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:18:07.578797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:18:07.578797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:07.578797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:07.578797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:07.578797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:07.578797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:07.578797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:07.578797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:07.578797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:18:07.578797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:07.578797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:07.578797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:07.578797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:07.578797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:07.578797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:07.578797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:07.578797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:07.579647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:18:07.579647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:18:07.579647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:18:07.579647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:18:07.581789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 13/30] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:07.583166 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904b752-5b9e-4df7-8cfc-78eb0e0310ad None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:07.583708 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed96c2a-9aea-4199-9363-35b222c9d3a5 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:07.584205 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed96c2a-9aea-4199-9363-35b222c9d3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:07.584690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed96c2a-9aea-4199-9363-35b222c9d3a5 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:07.586297 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 14/31] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:07.587533 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed96c2a-9aea-4199-9363-35b222c9d3a5 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:07.645197 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:07.779996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904b752-5b9e-4df7-8cfc-78eb0e0310ad None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:07.793402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed96c2a-9aea-4199-9363-35b222c9d3a5 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:07.825192 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4718a-9748-4c2d-a05b-b5616843efb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:07.826376 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4718a-9748-4c2d-a05b-b5616843efb3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:07.826962 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4718a-9748-4c2d-a05b-b5616843efb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:07.827485 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4718a-9748-4c2d-a05b-b5616843efb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:07.828525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4718a-9748-4c2d-a05b-b5616843efb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:07.829234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4718a-9748-4c2d-a05b-b5616843efb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:07.831293 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4718a-9748-4c2d-a05b-b5616843efb3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:07.843641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddfd88-1f49-4b89-a89f-69a82d08508b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:07.844687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddfd88-1f49-4b89-a89f-69a82d08508b None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:07.845222 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 18/32] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:07.845690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddfd88-1f49-4b89-a89f-69a82d08508b None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:07.846173 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddfd88-1f49-4b89-a89f-69a82d08508b None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:07.846699 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67556c30-8057-4da3-b869-88a02ceef267 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:07.846999 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67556c30-8057-4da3-b869-88a02ceef267 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:07.847328 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67556c30-8057-4da3-b869-88a02ceef267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:07.847806 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddfd88-1f49-4b89-a89f-69a82d08508b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:07.848311 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddfd88-1f49-4b89-a89f-69a82d08508b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:07.849937 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddfd88-1f49-4b89-a89f-69a82d08508b None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:07.867199 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 15/33] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:07.868289 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-67556c30-8057-4da3-b869-88a02ceef267 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:07.868683 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddfd88-1f49-4b89-a89f-69a82d08508b None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:07.870645 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-67556c30-8057-4da3-b869-88a02ceef267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:07.950633 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:07.975072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 19/34] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:07.975804 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67556c30-8057-4da3-b869-88a02ceef267 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:07.990809 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:08.008376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddfd88-1f49-4b89-a89f-69a82d08508b None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:08.052760 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977eab3-a675-4368-b1ad-ba3fde3aa47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:08.053647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977eab3-a675-4368-b1ad-ba3fde3aa47d None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:08.053936 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977eab3-a675-4368-b1ad-ba3fde3aa47d None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:08.054215 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977eab3-a675-4368-b1ad-ba3fde3aa47d None admin] PATH_INFO: `/v3/users/38b5788f4258438a9175f55196c13413` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:08.055954 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977eab3-a675-4368-b1ad-ba3fde3aa47d None admin] RBAC: Authorizing `identity:get_user(user_id=38b5788f4258438a9175f55196c13413)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:08.058159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977eab3-a675-4368-b1ad-ba3fde3aa47d None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:08.060084 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 16/35] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:07 2022] GET /identity/v3/users/38b5788f4258438a9175f55196c13413 => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:08.060729 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977eab3-a675-4368-b1ad-ba3fde3aa47d None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:08.112767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67556c30-8057-4da3-b869-88a02ceef267 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:08.152763 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4046fad-d489-47ca-8e41-98fe722fc3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:08.153439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4046fad-d489-47ca-8e41-98fe722fc3e4 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:08.153730 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4046fad-d489-47ca-8e41-98fe722fc3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:08.154012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4046fad-d489-47ca-8e41-98fe722fc3e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:08.154772 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4046fad-d489-47ca-8e41-98fe722fc3e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:08.156253 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4046fad-d489-47ca-8e41-98fe722fc3e4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:08.194526 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 20/36] 10.222.0.25 () {60 vars in 1141 bytes} [Mon May 23 12:18:07 2022] POST /identity/v3/projects => generated 301 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:18:08.194526 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db2827-47e0-4750-a373-ece93624cf79 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:08.194526 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db2827-47e0-4750-a373-ece93624cf79 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:08.194526 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db2827-47e0-4750-a373-ece93624cf79 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:08.194526 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 21/37] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:08.194526 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db2827-47e0-4750-a373-ece93624cf79 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:08.198941 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977eab3-a675-4368-b1ad-ba3fde3aa47d None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:08.246359 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce4347-be62-42ad-bfa6-bd1170c8c08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:08.247069 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce4347-be62-42ad-bfa6-bd1170c8c08a None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:08.247361 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce4347-be62-42ad-bfa6-bd1170c8c08a None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:08.247648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce4347-be62-42ad-bfa6-bd1170c8c08a None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:08.248151 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:08.248585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce4347-be62-42ad-bfa6-bd1170c8c08a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:08.250847 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce4347-be62-42ad-bfa6-bd1170c8c08a None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:08.323402 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db2827-47e0-4750-a373-ece93624cf79 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:08.365418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1901c3e-6359-4cf4-8f5f-89c0eb990e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:08.366323 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1901c3e-6359-4cf4-8f5f-89c0eb990e6a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:08.366716 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1901c3e-6359-4cf4-8f5f-89c0eb990e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:08.367004 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1901c3e-6359-4cf4-8f5f-89c0eb990e6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:08.368282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1901c3e-6359-4cf4-8f5f-89c0eb990e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:08.369966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1901c3e-6359-4cf4-8f5f-89c0eb990e6a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:08.372181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 22/38] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:18:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:08.373661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7f0ed-d83f-428c-9839-25eff962a8d4 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:08.373958 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7f0ed-d83f-428c-9839-25eff962a8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:08.374242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7f0ed-d83f-428c-9839-25eff962a8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:08.394252 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-78a7f0ed-d83f-428c-9839-25eff962a8d4 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:08.397329 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-78a7f0ed-d83f-428c-9839-25eff962a8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:08.397449 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 17/39] 10.222.0.25 () {60 vars in 1131 bytes} [Mon May 23 12:18:08 2022] POST /identity/v3/roles => generated 225 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:18:08.397449 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce4347-be62-42ad-bfa6-bd1170c8c08a None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:08.429178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:08.504024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 23/40] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:08.505454 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873bc10-0c57-4836-8f0a-c6c56d424691 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:08.505751 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873bc10-0c57-4836-8f0a-c6c56d424691 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:08.506030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873bc10-0c57-4836-8f0a-c6c56d424691 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:08.515917 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 24/41] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:08 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:08.530474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914174b0-ccdd-4ef7-a32d-06ec4fd7f23b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:08.530474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914174b0-ccdd-4ef7-a32d-06ec4fd7f23b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:08.530474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914174b0-ccdd-4ef7-a32d-06ec4fd7f23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:08.553482 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-914174b0-ccdd-4ef7-a32d-06ec4fd7f23b None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:08.554286 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce4347-be62-42ad-bfa6-bd1170c8c08a None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:08.554754 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-914174b0-ccdd-4ef7-a32d-06ec4fd7f23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:08.592081 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:08.604359 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53847d23-52be-4afb-b1a0-06883a7b8602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:08.605285 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53847d23-52be-4afb-b1a0-06883a7b8602 None admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:08.605588 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53847d23-52be-4afb-b1a0-06883a7b8602 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:08.605905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53847d23-52be-4afb-b1a0-06883a7b8602 None admin] PATH_INFO: `/v3/domains/default/users/38b5788f4258438a9175f55196c13413/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:08.608296 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53847d23-52be-4afb-b1a0-06883a7b8602 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=38b5788f4258438a9175f55196c13413, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:08.609934 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53847d23-52be-4afb-b1a0-06883a7b8602 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:08.635057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 18/42] 10.222.0.25 () {58 vars in 1361 bytes} [Mon May 23 12:18:08 2022] PUT /identity/v3/domains/default/users/38b5788f4258438a9175f55196c13413/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:18:08.637282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53847d23-52be-4afb-b1a0-06883a7b8602 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:08.674535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 25/43] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:18:08.696985 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914174b0-ccdd-4ef7-a32d-06ec4fd7f23b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:08.777065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:08.800489 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53847d23-52be-4afb-b1a0-06883a7b8602 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:08.841791 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c342eb9-4875-4c1f-8bb3-7d10445d94f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:08.842633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c342eb9-4875-4c1f-8bb3-7d10445d94f8 None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:08.842816 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914174b0-ccdd-4ef7-a32d-06ec4fd7f23b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:08.843245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c342eb9-4875-4c1f-8bb3-7d10445d94f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:08.843487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c342eb9-4875-4c1f-8bb3-7d10445d94f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:08.844840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c342eb9-4875-4c1f-8bb3-7d10445d94f8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:08.847545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c342eb9-4875-4c1f-8bb3-7d10445d94f8 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:08.871248 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 19/44] 10.222.0.25 () {60 vars in 1131 bytes} [Mon May 23 12:18:08 2022] POST /identity/v3/roles => generated 223 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:18:08.894180 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88e487-7e13-435f-a63f-4e48b555a8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:08.895074 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88e487-7e13-435f-a63f-4e48b555a8de None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:08.895384 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88e487-7e13-435f-a63f-4e48b555a8de None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:08.895637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88e487-7e13-435f-a63f-4e48b555a8de None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:08.897026 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea88e487-7e13-435f-a63f-4e48b555a8de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:08.898594 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea88e487-7e13-435f-a63f-4e48b555a8de None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:08.900562 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 26/45] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:18:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:08.910542 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c342eb9-4875-4c1f-8bb3-7d10445d94f8 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:09.036416 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c342eb9-4875-4c1f-8bb3-7d10445d94f8 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:09.100554 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315c628-1427-42b0-be67-181cc6dacbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:09.101239 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315c628-1427-42b0-be67-181cc6dacbea None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:09.101551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315c628-1427-42b0-be67-181cc6dacbea None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:09.101836 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315c628-1427-42b0-be67-181cc6dacbea None admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:09.102592 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315c628-1427-42b0-be67-181cc6dacbea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:09.104061 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315c628-1427-42b0-be67-181cc6dacbea None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:09.108938 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:09.147778 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 20/46] 10.222.0.25 () {60 vars in 1141 bytes} [Mon May 23 12:18:08 2022] POST /identity/v3/projects => generated 312 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:18:10.991682 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fc4ef-5f2d-43c3-8a0e-97ad50130eee None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:10.992192 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fc4ef-5f2d-43c3-8a0e-97ad50130eee None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:10.992296 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fc4ef-5f2d-43c3-8a0e-97ad50130eee None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:10.993621 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 27/47] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:10.999687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7f253-a7b5-4476-ae0f-58f6bd101720 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:11.000081 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7f253-a7b5-4476-ae0f-58f6bd101720 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:11.000270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7f253-a7b5-4476-ae0f-58f6bd101720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:11.017117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-19a7f253-a7b5-4476-ae0f-58f6bd101720 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:11.018805 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-19a7f253-a7b5-4476-ae0f-58f6bd101720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:11.087551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 21/48] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:11.110383 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fc4ef-5f2d-43c3-8a0e-97ad50130eee None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:11.147526 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:11.232391 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fc4ef-5f2d-43c3-8a0e-97ad50130eee None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:11.282791 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f53850-fee1-45a3-acfe-41d5b2695f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:11.283502 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f53850-fee1-45a3-acfe-41d5b2695f98 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:11.283787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f53850-fee1-45a3-acfe-41d5b2695f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:11.284068 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f53850-fee1-45a3-acfe-41d5b2695f98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:11.294968 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f53850-fee1-45a3-acfe-41d5b2695f98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:11.302477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-e8f53850-fee1-45a3-acfe-41d5b2695f98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:18:11.302477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:11.302477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:11.302477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:11.302477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:11.302477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:11.302477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:11.302477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:11.302477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:11.302477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:11.302477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:11.302477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:11.302477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:11.302477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:11.302477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:11.302477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:11.303332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:11.303332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:11.303332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:11.303332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:11.303332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:11.303332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:11.303332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:11.303332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:11.303332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:11.303332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:11.303332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:11.303332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:18:11.303332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:11.303332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:11.303332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:11.303332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:11.304058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:11.304058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:11.304058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:11.304058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:11.304058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:11.304058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:11.304058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:11.304058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:11.304058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:11.304058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:11.304058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:18:11.304058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:18:11.304058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 28/49] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:18:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:11.309442 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7f253-a7b5-4476-ae0f-58f6bd101720 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:11.368425 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0afcad-1ac8-4e51-a760-ab06dff4ee2b None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:11.368731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0afcad-1ac8-4e51-a760-ab06dff4ee2b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:11.369021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0afcad-1ac8-4e51-a760-ab06dff4ee2b None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:11.370398 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 29/50] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:18:11.375496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae90ee0-4a55-4ebb-a578-b6f5445516de None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:11.375793 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae90ee0-4a55-4ebb-a578-b6f5445516de None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:11.376079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae90ee0-4a55-4ebb-a578-b6f5445516de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:11.392652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4ae90ee0-4a55-4ebb-a578-b6f5445516de None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:11.393852 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4ae90ee0-4a55-4ebb-a578-b6f5445516de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:11.416252 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7f253-a7b5-4476-ae0f-58f6bd101720 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:11.433797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:11.451825 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495236b-b217-4e53-89db-27ac361ac49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:11.452496 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495236b-b217-4e53-89db-27ac361ac49f None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:11.452792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495236b-b217-4e53-89db-27ac361ac49f None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:11.453076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495236b-b217-4e53-89db-27ac361ac49f None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:11.453827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495236b-b217-4e53-89db-27ac361ac49f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:11.454139 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495236b-b217-4e53-89db-27ac361ac49f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:11.455649 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495236b-b217-4e53-89db-27ac361ac49f None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:11.460734 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 30/51] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:18:11.468274 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 22/52] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:11.473665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae90ee0-4a55-4ebb-a578-b6f5445516de None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:11.483750 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495236b-b217-4e53-89db-27ac361ac49f None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:11.500160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:11.582810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae90ee0-4a55-4ebb-a578-b6f5445516de None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:11.583243 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495236b-b217-4e53-89db-27ac361ac49f None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:11.616729 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0a7e7-3195-40c2-99bc-6a123fed85a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:11.617162 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc43b35-2908-4ee0-b166-9e0d4f807698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:11.617524 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0a7e7-3195-40c2-99bc-6a123fed85a6 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:11.617818 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0a7e7-3195-40c2-99bc-6a123fed85a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:11.618027 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc43b35-2908-4ee0-b166-9e0d4f807698 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:11.618121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0a7e7-3195-40c2-99bc-6a123fed85a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:11.618317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc43b35-2908-4ee0-b166-9e0d4f807698 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:11.618633 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc43b35-2908-4ee0-b166-9e0d4f807698 None admin] PATH_INFO: `/v3/users/38b5788f4258438a9175f55196c13413` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:11.619305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0a7e7-3195-40c2-99bc-6a123fed85a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:11.619889 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc43b35-2908-4ee0-b166-9e0d4f807698 None admin] RBAC: Authorizing `identity:get_user(user_id=38b5788f4258438a9175f55196c13413)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:11.620786 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0a7e7-3195-40c2-99bc-6a123fed85a6 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:11.621359 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc43b35-2908-4ee0-b166-9e0d4f807698 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:11.622416 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 23/53] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:18:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:11.623093 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 31/54] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:11 2022] GET /identity/v3/users/38b5788f4258438a9175f55196c13413 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:11.628111 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0a7e7-3195-40c2-99bc-6a123fed85a6 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:11.628248 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc43b35-2908-4ee0-b166-9e0d4f807698 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:11.686245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:11.728108 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:11.738027 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc43b35-2908-4ee0-b166-9e0d4f807698 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:11.743745 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0a7e7-3195-40c2-99bc-6a123fed85a6 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:11.773305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d8e56-819a-424d-ad7d-275975f5d47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:11.774098 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d8e56-819a-424d-ad7d-275975f5d47f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:11.774381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d8e56-819a-424d-ad7d-275975f5d47f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:11.774687 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d8e56-819a-424d-ad7d-275975f5d47f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:11.776402 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d8e56-819a-424d-ad7d-275975f5d47f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:11.777870 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d8e56-819a-424d-ad7d-275975f5d47f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:11.779507 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 32/55] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:18:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:11.782411 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950057d4-a73f-48a5-88ba-3c909104b438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:11.783112 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950057d4-a73f-48a5-88ba-3c909104b438 None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:11.783405 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950057d4-a73f-48a5-88ba-3c909104b438 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:11.783689 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950057d4-a73f-48a5-88ba-3c909104b438 None admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:11.784498 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950057d4-a73f-48a5-88ba-3c909104b438 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:11.785095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d8e56-819a-424d-ad7d-275975f5d47f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:11.785964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950057d4-a73f-48a5-88ba-3c909104b438 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:11.810888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 24/56] 10.222.0.25 () {60 vars in 1140 bytes} [Mon May 23 12:18:11 2022] POST /identity/v3/projects => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:18:11.897723 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d8e56-819a-424d-ad7d-275975f5d47f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:11.936715 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e039cc9-93df-4962-bce8-bab53d1a71c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:11.937410 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e039cc9-93df-4962-bce8-bab53d1a71c4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:11.937708 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e039cc9-93df-4962-bce8-bab53d1a71c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:11.938001 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e039cc9-93df-4962-bce8-bab53d1a71c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:11.938925 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e039cc9-93df-4962-bce8-bab53d1a71c4 None admin] RBAC: Adding query filter params (role.id=3ae7c5e54e084ac4a1f94da93a667583, scope.domain.id=default, user.id=38b5788f4258438a9175f55196c13413) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:11.939247 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e039cc9-93df-4962-bce8-bab53d1a71c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:11.940806 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e039cc9-93df-4962-bce8-bab53d1a71c4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:11.948473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 33/57] 10.222.0.25 () {56 vars in 1322 bytes} [Mon May 23 12:18:11 2022] GET /identity/v3/role_assignments?user.id=38b5788f4258438a9175f55196c13413&scope.domain.id=default&role.id=3ae7c5e54e084ac4a1f94da93a667583 => generated 530 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:14.018483 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceab1f9-62ec-425d-a084-90c9e21c5de3 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:14.019005 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceab1f9-62ec-425d-a084-90c9e21c5de3 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:14.019088 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceab1f9-62ec-425d-a084-90c9e21c5de3 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:14.020442 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 25/58] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:14.026939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009d258-7ef1-458a-a74d-6655cc3cb0d1 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:14.027341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009d258-7ef1-458a-a74d-6655cc3cb0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:14.027516 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009d258-7ef1-458a-a74d-6655cc3cb0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:14.044118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b009d258-7ef1-458a-a74d-6655cc3cb0d1 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:14.045326 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b009d258-7ef1-458a-a74d-6655cc3cb0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:14.062100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:14.111442 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 34/59] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:14.136106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceab1f9-62ec-425d-a084-90c9e21c5de3 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:14.233081 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:14.237718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceab1f9-62ec-425d-a084-90c9e21c5de3 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:14.271612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401679d-3fd0-42cf-8a6e-e2025bda6296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:14.272336 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401679d-3fd0-42cf-8a6e-e2025bda6296 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:14.272628 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401679d-3fd0-42cf-8a6e-e2025bda6296 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:14.272911 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401679d-3fd0-42cf-8a6e-e2025bda6296 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:14.274084 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401679d-3fd0-42cf-8a6e-e2025bda6296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:14.275606 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401679d-3fd0-42cf-8a6e-e2025bda6296 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:14.277247 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 26/60] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:18:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:14.282876 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009d258-7ef1-458a-a74d-6655cc3cb0d1 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:14.390009 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009d258-7ef1-458a-a74d-6655cc3cb0d1 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:14.424643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb305b-5eb2-4fa3-961e-0061dd9e912f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:14.425738 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb305b-5eb2-4fa3-961e-0061dd9e912f None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:14.426257 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb305b-5eb2-4fa3-961e-0061dd9e912f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:14.426798 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb305b-5eb2-4fa3-961e-0061dd9e912f None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:14.428027 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb305b-5eb2-4fa3-961e-0061dd9e912f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:14.429589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb305b-5eb2-4fa3-961e-0061dd9e912f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:14.455288 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 35/61] 10.222.0.25 () {60 vars in 1132 bytes} [Mon May 23 12:18:14 2022] POST /identity/v3/users => generated 275 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:18:17.610311 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c21ef-2351-45d7-b33c-077b7f43402b None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:17.611609 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c21ef-2351-45d7-b33c-077b7f43402b None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:17.612185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c21ef-2351-45d7-b33c-077b7f43402b None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:17.614559 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 27/62] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:17.621363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056b755-72af-49f8-b3e5-16a72bebdfb7 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:17.622258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056b755-72af-49f8-b3e5-16a72bebdfb7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:17.622784 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056b755-72af-49f8-b3e5-16a72bebdfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:17.647392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0056b755-72af-49f8-b3e5-16a72bebdfb7 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:17.648965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0056b755-72af-49f8-b3e5-16a72bebdfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:17.656954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:17.764937 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 36/63] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:18:17.820130 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c21ef-2351-45d7-b33c-077b7f43402b None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:17.973352 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c21ef-2351-45d7-b33c-077b7f43402b None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:18.019432 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e7ecb-17c9-4a04-aebe-fabf54f737c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:18.020240 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e7ecb-17c9-4a04-aebe-fabf54f737c4 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:18.020524 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e7ecb-17c9-4a04-aebe-fabf54f737c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:18.020800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e7ecb-17c9-4a04-aebe-fabf54f737c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:18.036312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e7ecb-17c9-4a04-aebe-fabf54f737c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:18.048980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-4a3e7ecb-17c9-4a04-aebe-fabf54f737c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:18.048980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:18.048980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:18.048980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:18.048980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:18.048980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:18.048980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:18.048980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:18.048980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:18.048980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:18.048980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:18.048980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:18.048980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:18.048980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:18.048980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:18.048980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:18.050163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:18.050163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:18.050163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:18.050163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:18.050163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:18.050163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:18.050163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:18.050163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:18.050163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:18.050163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:18.050163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:18.050163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:18:18.050163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:18.050163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:18.050163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:18.050163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:18.050956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:18.050956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:18.050956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:18.050956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:18.050956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:18.050956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:18.050956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:18.050956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:18.050956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:18.050956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:18.050956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:18.050956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:18:18.050956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 28/64] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:18.059891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056b755-72af-49f8-b3e5-16a72bebdfb7 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:18.134539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f5e75-32f4-4033-8ddd-18f0adb1f0a9 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:18.136079 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f5e75-32f4-4033-8ddd-18f0adb1f0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:18.136567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f5e75-32f4-4033-8ddd-18f0adb1f0a9 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:18.138194 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 29/65] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:18.144843 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fae68-d4f8-410d-b830-b768d417ff4c None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:18.145436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fae68-d4f8-410d-b830-b768d417ff4c None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:18.145932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fae68-d4f8-410d-b830-b768d417ff4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:18.173488 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-e24fae68-d4f8-410d-b830-b768d417ff4c None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:18.176117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e24fae68-d4f8-410d-b830-b768d417ff4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:18.250980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:18.267688 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056b755-72af-49f8-b3e5-16a72bebdfb7 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:18.318426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3906c-a0c2-44f9-a2da-1ccf9fd74d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:18.319590 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3906c-a0c2-44f9-a2da-1ccf9fd74d87 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:18.320065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3906c-a0c2-44f9-a2da-1ccf9fd74d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:18.320684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3906c-a0c2-44f9-a2da-1ccf9fd74d87 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:18.321619 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3906c-a0c2-44f9-a2da-1ccf9fd74d87 None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:18.322085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3906c-a0c2-44f9-a2da-1ccf9fd74d87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:18.325105 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3906c-a0c2-44f9-a2da-1ccf9fd74d87 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:18.334837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 37/66] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:18:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:18.342536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3906c-a0c2-44f9-a2da-1ccf9fd74d87 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:18.346882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:18.357222 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 30/67] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:18:18.372808 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcea3e0-f2be-4dd0-a36e-eb0f488f12ff None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:18.373190 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcea3e0-f2be-4dd0-a36e-eb0f488f12ff None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:18.373857 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcea3e0-f2be-4dd0-a36e-eb0f488f12ff None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:18.376215 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 31/68] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:18.390062 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cca26-8537-48a1-812e-2921b20a4219 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:18.390727 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cca26-8537-48a1-812e-2921b20a4219 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:18.391234 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cca26-8537-48a1-812e-2921b20a4219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:18.410411 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-894cca26-8537-48a1-812e-2921b20a4219 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:18.411884 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-894cca26-8537-48a1-812e-2921b20a4219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:18.483320 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3906c-a0c2-44f9-a2da-1ccf9fd74d87 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:18.507062 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 32/69] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:18:18.508923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cca26-8537-48a1-812e-2921b20a4219 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:18.525418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d474bcf-bb1f-46dc-9213-7a69b43797d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:18.526299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d474bcf-bb1f-46dc-9213-7a69b43797d8 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:18.526619 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d474bcf-bb1f-46dc-9213-7a69b43797d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:18.526897 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d474bcf-bb1f-46dc-9213-7a69b43797d8 None admin] PATH_INFO: `/v3/users/1a07c7c0378b48d9b37b3826e79a85c5` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:18.541726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d474bcf-bb1f-46dc-9213-7a69b43797d8 None admin] RBAC: Authorizing `identity:get_user(user_id=1a07c7c0378b48d9b37b3826e79a85c5)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:18.543330 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d474bcf-bb1f-46dc-9213-7a69b43797d8 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:18.549242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 38/70] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:18 2022] GET /identity/v3/users/1a07c7c0378b48d9b37b3826e79a85c5 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:18.549242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83571945-38a8-482e-b53c-bd0e5987fe41 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:18.549242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83571945-38a8-482e-b53c-bd0e5987fe41 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:18.549242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83571945-38a8-482e-b53c-bd0e5987fe41 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:18.549242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 39/71] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:18.549242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320bef5-5555-481a-aa6a-b374e3e5912d None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:18.549660 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320bef5-5555-481a-aa6a-b374e3e5912d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:18.549660 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320bef5-5555-481a-aa6a-b374e3e5912d None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:18.550983 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 40/72] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:18.552867 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320bef5-5555-481a-aa6a-b374e3e5912d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:18.604645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:18.616434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:18.618596 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cca26-8537-48a1-812e-2921b20a4219 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:18.653115 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b0bb5-5623-4551-9206-14277c7d8a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:18.653916 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b0bb5-5623-4551-9206-14277c7d8a07 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:18.654214 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b0bb5-5623-4551-9206-14277c7d8a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:18.654529 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b0bb5-5623-4551-9206-14277c7d8a07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:18.659769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320bef5-5555-481a-aa6a-b374e3e5912d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:18.666923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b0bb5-5623-4551-9206-14277c7d8a07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:18.674702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-fe7b0bb5-5623-4551-9206-14277c7d8a07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:18.674702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:18.674702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:18.674702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:18.674702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:18.674702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:18.674702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:18.674702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:18.674702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:18.674702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:18.674702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:18.674702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:18.674702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:18.674702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:18.674702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:18.674702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:18.675607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:18.675607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:18.675607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:18.675607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:18.675607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:18.675607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:18.675607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:18.675607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:18.675607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:18.675607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:18.675607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:18.675607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:18:18.675607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:18.675607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:18.675607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:18.675607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:18.676343 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:18.676343 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:18.676343 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:18.676343 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:18.676343 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:18.676343 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:18.676343 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:18.676343 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:18.676343 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:18.676343 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:18.676343 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:18.676343 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:18:18.676343 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 33/73] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:18.676977 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b0bb5-5623-4551-9206-14277c7d8a07 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:18.696920 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beda1f4-e70b-42a7-8c3f-51da57516264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:18.697839 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beda1f4-e70b-42a7-8c3f-51da57516264 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:18.698126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beda1f4-e70b-42a7-8c3f-51da57516264 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:18.698407 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beda1f4-e70b-42a7-8c3f-51da57516264 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:18.709108 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beda1f4-e70b-42a7-8c3f-51da57516264 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:18.717160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-8beda1f4-e70b-42a7-8c3f-51da57516264 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:18:18.717160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:18.717160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:18.717160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:18.717160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:18.717160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:18.717160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:18.717160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:18.717160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:18.717160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:18.717160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:18.717160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:18.717160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:18.717160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:18.717160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:18.717160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:18.718769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:18.718769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:18.718769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:18.718769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:18.718769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:18.718769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:18.718769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:18.718769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:18.718769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:18.718769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:18.718769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:18.718769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:18:18.718769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:18.718769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:18.718769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:18.718769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:18.719795 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:18.719795 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:18.719795 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:18.719795 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:18.719795 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:18.719795 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:18.719795 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:18.719795 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:18.719795 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:18.719795 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:18.719795 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:18:18.719795 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:18:18.719795 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 41/74] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:18:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:18.719795 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06e2dc-c3da-4461-b56b-78e5efc90f4d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:18.720469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06e2dc-c3da-4461-b56b-78e5efc90f4d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:18.720469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06e2dc-c3da-4461-b56b-78e5efc90f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:18.736824 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ae06e2dc-c3da-4461-b56b-78e5efc90f4d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:18.738017 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ae06e2dc-c3da-4461-b56b-78e5efc90f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:18.783760 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b0bb5-5623-4551-9206-14277c7d8a07 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:18.812971 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 42/75] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:18.814361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f95e7-7ddc-428f-958a-437db50d9c91 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:18.814705 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f95e7-7ddc-428f-958a-437db50d9c91 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:18.814983 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f95e7-7ddc-428f-958a-437db50d9c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:18.825405 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935e0de-847d-4df5-a0df-4abdb45e960c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:18.826060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935e0de-847d-4df5-a0df-4abdb45e960c None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:18.826356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935e0de-847d-4df5-a0df-4abdb45e960c None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:18.826745 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935e0de-847d-4df5-a0df-4abdb45e960c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:18.841755 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4f5f95e7-7ddc-428f-958a-437db50d9c91 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:18.842974 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4f5f95e7-7ddc-428f-958a-437db50d9c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:18.846220 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:18.889400 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:18.898325 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935e0de-847d-4df5-a0df-4abdb45e960c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:18.899865 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935e0de-847d-4df5-a0df-4abdb45e960c None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:18.911144 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 43/76] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:18.911976 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f95e7-7ddc-428f-958a-437db50d9c91 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:19.001851 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 34/77] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:18:19.002747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935e0de-847d-4df5-a0df-4abdb45e960c None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:19.018230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f95e7-7ddc-428f-958a-437db50d9c91 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:19.052878 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:19.053695 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b169ee6-4806-4930-9572-a65e15378f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:19.054415 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b169ee6-4806-4930-9572-a65e15378f4c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:19.054769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b169ee6-4806-4930-9572-a65e15378f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:19.055096 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b169ee6-4806-4930-9572-a65e15378f4c None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:19.055961 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b169ee6-4806-4930-9572-a65e15378f4c None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:19.056273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b169ee6-4806-4930-9572-a65e15378f4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:19.057725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b169ee6-4806-4930-9572-a65e15378f4c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:19.065856 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 44/78] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:18:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:19.066684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b169ee6-4806-4930-9572-a65e15378f4c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:19.105694 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935e0de-847d-4df5-a0df-4abdb45e960c None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:19.109285 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:19.141288 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76ddcc-f8d2-4f12-93d1-ee5107178ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:19.141964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76ddcc-f8d2-4f12-93d1-ee5107178ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:19.142257 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76ddcc-f8d2-4f12-93d1-ee5107178ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:19.142571 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76ddcc-f8d2-4f12-93d1-ee5107178ed7 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:19.143318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76ddcc-f8d2-4f12-93d1-ee5107178ed7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:19.143636 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76ddcc-f8d2-4f12-93d1-ee5107178ed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:19.145051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76ddcc-f8d2-4f12-93d1-ee5107178ed7 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:19.153855 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 35/79] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:19.154448 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76ddcc-f8d2-4f12-93d1-ee5107178ed7 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:19.169444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b169ee6-4806-4930-9572-a65e15378f4c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:19.202615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7942b-2582-4a78-9da2-45f3330f4365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:19.203408 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7942b-2582-4a78-9da2-45f3330f4365 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:19.203689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7942b-2582-4a78-9da2-45f3330f4365 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:19.203969 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7942b-2582-4a78-9da2-45f3330f4365 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:19.205139 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7942b-2582-4a78-9da2-45f3330f4365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:19.206644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7942b-2582-4a78-9da2-45f3330f4365 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:19.208237 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 45/80] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:18:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:19.208997 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7942b-2582-4a78-9da2-45f3330f4365 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:19.260542 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76ddcc-f8d2-4f12-93d1-ee5107178ed7 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:19.271658 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:19.295578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f313d-0d71-4da6-9f1d-e66d17497f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:19.296388 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f313d-0d71-4da6-9f1d-e66d17497f18 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:19.296681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f313d-0d71-4da6-9f1d-e66d17497f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:19.296964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f313d-0d71-4da6-9f1d-e66d17497f18 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:19.307379 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f313d-0d71-4da6-9f1d-e66d17497f18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:19.314939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7942b-2582-4a78-9da2-45f3330f4365 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:19.315516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-ff7f313d-0d71-4da6-9f1d-e66d17497f18 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:18:19.315516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:19.315516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:19.315516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:19.315516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:19.315516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:19.315516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:19.315516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:19.315516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:19.315516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:19.315516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:19.315516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:19.315516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:19.315516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:19.315516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:19.315516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:19.316493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:19.316493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:19.316493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:19.316493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:19.316493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:19.316493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:19.316493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:19.316493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:19.316493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:19.316493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:19.316493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:19.316493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:18:19.316493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:19.316493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:19.316493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:19.316493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:19.317245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:19.317245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:19.317245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:19.317245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:19.317245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:19.317245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:19.317245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:19.317245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:19.317245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:19.317245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:19.317245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:18:19.317245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:18:19.317245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 36/81] 10.222.0.25 () {56 vars in 1114 bytes} [Mon May 23 12:18:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:19.317856 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f313d-0d71-4da6-9f1d-e66d17497f18 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:19.326174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:19.352247 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05add0b8-884f-41d2-883f-05781497beae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:19.353113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05add0b8-884f-41d2-883f-05781497beae None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:19.353431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05add0b8-884f-41d2-883f-05781497beae None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:19.353728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05add0b8-884f-41d2-883f-05781497beae None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:19.354945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05add0b8-884f-41d2-883f-05781497beae None admin] RBAC: Authorizing `identity:get_project(project_id=3fd6ed2a258c474293105ba1798cee00)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:19.356424 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05add0b8-884f-41d2-883f-05781497beae None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:19.358125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 46/82] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:19 2022] GET /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:19.358931 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05add0b8-884f-41d2-883f-05781497beae None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:19.427611 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f313d-0d71-4da6-9f1d-e66d17497f18 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:19.457838 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05add0b8-884f-41d2-883f-05781497beae None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:19.462290 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd2911-9023-4a8d-8cfe-73ab77d4e9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:19.464109 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd2911-9023-4a8d-8cfe-73ab77d4e9de None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:19.464424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd2911-9023-4a8d-8cfe-73ab77d4e9de None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:19.464724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd2911-9023-4a8d-8cfe-73ab77d4e9de None admin] PATH_INFO: `/v3/users/1a07c7c0378b48d9b37b3826e79a85c5` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:19.466004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd2911-9023-4a8d-8cfe-73ab77d4e9de None admin] RBAC: Authorizing `identity:get_user(user_id=1a07c7c0378b48d9b37b3826e79a85c5)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:19.467507 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd2911-9023-4a8d-8cfe-73ab77d4e9de None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:19.469139 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 37/83] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:19 2022] GET /identity/v3/users/1a07c7c0378b48d9b37b3826e79a85c5 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:19.469890 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd2911-9023-4a8d-8cfe-73ab77d4e9de None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:19.496337 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0825a-3d4b-4d2f-9bb3-76cb2db23ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:19.497211 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0825a-3d4b-4d2f-9bb3-76cb2db23ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:19.497742 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0825a-3d4b-4d2f-9bb3-76cb2db23ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:19.497869 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0825a-3d4b-4d2f-9bb3-76cb2db23ae7 None admin] PATH_INFO: `/v3/users/38b5788f4258438a9175f55196c13413` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:19.498998 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0825a-3d4b-4d2f-9bb3-76cb2db23ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=38b5788f4258438a9175f55196c13413)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:19.500468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0825a-3d4b-4d2f-9bb3-76cb2db23ae7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:19.502081 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 47/84] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:19 2022] GET /identity/v3/users/38b5788f4258438a9175f55196c13413 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:19.502872 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0825a-3d4b-4d2f-9bb3-76cb2db23ae7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:19.512933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:19.549039 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:19.573665 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd2911-9023-4a8d-8cfe-73ab77d4e9de None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:19.602009 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0825a-3d4b-4d2f-9bb3-76cb2db23ae7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:19.605497 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acecd1c-d7f9-4c08-9148-6b27916ddb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:19.606197 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acecd1c-d7f9-4c08-9148-6b27916ddb27 None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:19.606519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acecd1c-d7f9-4c08-9148-6b27916ddb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:19.606812 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acecd1c-d7f9-4c08-9148-6b27916ddb27 None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:19.607523 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acecd1c-d7f9-4c08-9148-6b27916ddb27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:19.609007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acecd1c-d7f9-4c08-9148-6b27916ddb27 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:19.646879 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 38/85] 10.222.0.25 () {60 vars in 1132 bytes} [Mon May 23 12:18:19 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:18:19.647567 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96191d8-5a0e-4533-91e8-2ce61cfae423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:19.647567 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96191d8-5a0e-4533-91e8-2ce61cfae423 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:19.647754 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acecd1c-d7f9-4c08-9148-6b27916ddb27 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:19.647844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96191d8-5a0e-4533-91e8-2ce61cfae423 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:19.647844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96191d8-5a0e-4533-91e8-2ce61cfae423 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:19.647844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96191d8-5a0e-4533-91e8-2ce61cfae423 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:19.647844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96191d8-5a0e-4533-91e8-2ce61cfae423 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:19.647844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96191d8-5a0e-4533-91e8-2ce61cfae423 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:19.650983 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 48/86] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:18:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:19.654573 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96191d8-5a0e-4533-91e8-2ce61cfae423 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:19.764461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:19.773272 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acecd1c-d7f9-4c08-9148-6b27916ddb27 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:19.774104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96191d8-5a0e-4533-91e8-2ce61cfae423 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:19.785597 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:19.813808 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78abfcd-dc1e-47a4-a781-972b00edcfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:19.814452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b86a8f-6d95-49a2-99a2-0092fc7c8ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:19.814825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78abfcd-dc1e-47a4-a781-972b00edcfc7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:19.815139 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78abfcd-dc1e-47a4-a781-972b00edcfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:19.815233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b86a8f-6d95-49a2-99a2-0092fc7c8ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:19.815472 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b86a8f-6d95-49a2-99a2-0092fc7c8ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:19.815563 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78abfcd-dc1e-47a4-a781-972b00edcfc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:19.815701 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b86a8f-6d95-49a2-99a2-0092fc7c8ea7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:19.816541 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b86a8f-6d95-49a2-99a2-0092fc7c8ea7 None admin] RBAC: Adding query filter params (role.id=3dac847973464a2cb123dc2c9083baf3, scope.project.id=3fd6ed2a258c474293105ba1798cee00, user.id=1a07c7c0378b48d9b37b3826e79a85c5) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:19.816858 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b86a8f-6d95-49a2-99a2-0092fc7c8ea7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:19.818329 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b86a8f-6d95-49a2-99a2-0092fc7c8ea7 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:19.828226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 39/87] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:18:19 2022] GET /identity/v3/role_assignments?user.id=1a07c7c0378b48d9b37b3826e79a85c5&scope.project.id=3fd6ed2a258c474293105ba1798cee00&role.id=3dac847973464a2cb123dc2c9083baf3 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:19.828833 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b86a8f-6d95-49a2-99a2-0092fc7c8ea7 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:19.925057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78abfcd-dc1e-47a4-a781-972b00edcfc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:19.927348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78abfcd-dc1e-47a4-a781-972b00edcfc7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:19.977500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b86a8f-6d95-49a2-99a2-0092fc7c8ea7 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:20.040063 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adf959-759d-4220-bb63-5807ca2a6fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:20.041707 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adf959-759d-4220-bb63-5807ca2a6fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:20.042276 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adf959-759d-4220-bb63-5807ca2a6fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:20.042874 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adf959-759d-4220-bb63-5807ca2a6fd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:20.075390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 49/88] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:18:20.076072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78abfcd-dc1e-47a4-a781-972b00edcfc7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:20.076723 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:20.089535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:20.139845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adf959-759d-4220-bb63-5807ca2a6fd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:20.142143 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adf959-759d-4220-bb63-5807ca2a6fd7 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:20.215662 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78abfcd-dc1e-47a4-a781-972b00edcfc7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:20.264009 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005cd91-1659-4526-a288-ef5e19ee82dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:20.265164 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005cd91-1659-4526-a288-ef5e19ee82dd None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:20.265704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005cd91-1659-4526-a288-ef5e19ee82dd None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:20.265993 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005cd91-1659-4526-a288-ef5e19ee82dd None admin] PATH_INFO: `/v3/users/1a07c7c0378b48d9b37b3826e79a85c5` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:20.267993 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005cd91-1659-4526-a288-ef5e19ee82dd None admin] RBAC: Authorizing `identity:get_user(user_id=1a07c7c0378b48d9b37b3826e79a85c5)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:20.269499 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005cd91-1659-4526-a288-ef5e19ee82dd None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:20.270274 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 40/89] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:18:20.271270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adf959-759d-4220-bb63-5807ca2a6fd7 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:20.271402 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 50/90] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:20 2022] GET /identity/v3/users/1a07c7c0378b48d9b37b3826e79a85c5 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:20.277339 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005cd91-1659-4526-a288-ef5e19ee82dd None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:20.340390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:20.392565 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:20.426115 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adf959-759d-4220-bb63-5807ca2a6fd7 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:20.440674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005cd91-1659-4526-a288-ef5e19ee82dd None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:20.471931 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb7326-9158-4104-b6d5-660710b9a949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:20.473432 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb7326-9158-4104-b6d5-660710b9a949 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:20.473730 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb7326-9158-4104-b6d5-660710b9a949 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:20.474268 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb7326-9158-4104-b6d5-660710b9a949 None admin] PATH_INFO: `/v3/projects/11f4e69612c946569894c24a9ab0b35a` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:20.475883 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb7326-9158-4104-b6d5-660710b9a949 None admin] RBAC: Authorizing `identity:get_project(project_id=11f4e69612c946569894c24a9ab0b35a)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:20.478111 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb7326-9158-4104-b6d5-660710b9a949 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:20.481819 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 41/91] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:20 2022] GET /identity/v3/projects/11f4e69612c946569894c24a9ab0b35a => generated 312 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:20.482923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb7326-9158-4104-b6d5-660710b9a949 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:20.485707 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f947391-4628-472d-9242-13f6cb211567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:20.486479 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f947391-4628-472d-9242-13f6cb211567 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:20.486970 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f947391-4628-472d-9242-13f6cb211567 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:20.487262 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f947391-4628-472d-9242-13f6cb211567 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:20.622261 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f947391-4628-472d-9242-13f6cb211567 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:20.623817 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f947391-4628-472d-9242-13f6cb211567 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:20.645856 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb7326-9158-4104-b6d5-660710b9a949 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:20.674319 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:20.693253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6516b-a5dc-449a-ace1-09036fdc2622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:20.694492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6516b-a5dc-449a-ace1-09036fdc2622 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:20.695023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6516b-a5dc-449a-ace1-09036fdc2622 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:20.695499 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6516b-a5dc-449a-ace1-09036fdc2622 None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:20.699239 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6516b-a5dc-449a-ace1-09036fdc2622 None admin] RBAC: Authorizing `identity:get_project(project_id=3fd6ed2a258c474293105ba1798cee00)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:20.700968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6516b-a5dc-449a-ace1-09036fdc2622 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:20.702926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 42/92] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:20 2022] GET /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:20.703894 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6516b-a5dc-449a-ace1-09036fdc2622 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:20.737764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:20.820894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 51/93] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 12:18:20.821775 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f947391-4628-472d-9242-13f6cb211567 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:20.843804 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6516b-a5dc-449a-ace1-09036fdc2622 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:20.914921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff2a2c-e45b-4d93-804a-c460ccc5cb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:20.916780 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff2a2c-e45b-4d93-804a-c460ccc5cb41 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:20.919832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff2a2c-e45b-4d93-804a-c460ccc5cb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:20.920623 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff2a2c-e45b-4d93-804a-c460ccc5cb41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:20.922644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff2a2c-e45b-4d93-804a-c460ccc5cb41 None admin] RBAC: Adding query filter params (role.id=3dac847973464a2cb123dc2c9083baf3, scope.project.id=11f4e69612c946569894c24a9ab0b35a, user.id=1a07c7c0378b48d9b37b3826e79a85c5) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:20.923359 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff2a2c-e45b-4d93-804a-c460ccc5cb41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:20.926014 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff2a2c-e45b-4d93-804a-c460ccc5cb41 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:20.935929 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 43/94] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:18:20 2022] GET /identity/v3/role_assignments?user.id=1a07c7c0378b48d9b37b3826e79a85c5&scope.project.id=11f4e69612c946569894c24a9ab0b35a&role.id=3dac847973464a2cb123dc2c9083baf3 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:20.937197 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff2a2c-e45b-4d93-804a-c460ccc5cb41 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:21.014344 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f947391-4628-472d-9242-13f6cb211567 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:21.060468 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:21.111130 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821825c-6154-4d95-8a62-a782435827e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:21.114544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821825c-6154-4d95-8a62-a782435827e7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:21.114544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821825c-6154-4d95-8a62-a782435827e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:21.114544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821825c-6154-4d95-8a62-a782435827e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:21.114544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821825c-6154-4d95-8a62-a782435827e7 None admin] RBAC: Adding query filter params (role.id=3ae7c5e54e084ac4a1f94da93a667583, scope.project.id=3fd6ed2a258c474293105ba1798cee00, user.id=38b5788f4258438a9175f55196c13413) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:21.114544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821825c-6154-4d95-8a62-a782435827e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:21.115054 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821825c-6154-4d95-8a62-a782435827e7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:21.129422 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 52/95] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:18:20 2022] GET /identity/v3/role_assignments?user.id=38b5788f4258438a9175f55196c13413&scope.project.id=3fd6ed2a258c474293105ba1798cee00&role.id=3ae7c5e54e084ac4a1f94da93a667583 => generated 259 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:21.150699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff2a2c-e45b-4d93-804a-c460ccc5cb41 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:21.212835 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7f8c1-af68-49bb-bb48-6b2c2d2d1150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:21.213787 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7f8c1-af68-49bb-bb48-6b2c2d2d1150 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:21.214175 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7f8c1-af68-49bb-bb48-6b2c2d2d1150 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:21.214659 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7f8c1-af68-49bb-bb48-6b2c2d2d1150 None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:21.216526 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7f8c1-af68-49bb-bb48-6b2c2d2d1150 None admin] RBAC: Authorizing `identity:get_project(project_id=3fd6ed2a258c474293105ba1798cee00)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:21.218975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7f8c1-af68-49bb-bb48-6b2c2d2d1150 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:21.221691 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 44/96] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:20 2022] GET /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:21.227928 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821825c-6154-4d95-8a62-a782435827e7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:21.316961 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:21.408523 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821825c-6154-4d95-8a62-a782435827e7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:21.462828 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77bfde-1d86-4777-84a8-7517351f4015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:21.463872 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77bfde-1d86-4777-84a8-7517351f4015 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:21.464368 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77bfde-1d86-4777-84a8-7517351f4015 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:21.464852 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77bfde-1d86-4777-84a8-7517351f4015 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:21.465903 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77bfde-1d86-4777-84a8-7517351f4015 None admin] RBAC: Adding query filter params (role.id=d9ac3d950cc243aaa45c802dd5f3d844, scope.project.id=3fd6ed2a258c474293105ba1798cee00, user.id=1a07c7c0378b48d9b37b3826e79a85c5) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:21.466439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77bfde-1d86-4777-84a8-7517351f4015 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:21.468152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77bfde-1d86-4777-84a8-7517351f4015 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:21.474302 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 53/97] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:18:21 2022] GET /identity/v3/role_assignments?user.id=1a07c7c0378b48d9b37b3826e79a85c5&scope.project.id=3fd6ed2a258c474293105ba1798cee00&role.id=d9ac3d950cc243aaa45c802dd5f3d844 => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:22.900952 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442d2f4-7f88-48c5-a6bf-78c5a9ec517d None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:22.901500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442d2f4-7f88-48c5-a6bf-78c5a9ec517d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:22.901500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442d2f4-7f88-48c5-a6bf-78c5a9ec517d None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:22.903029 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 45/98] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:22.908721 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143165f-7b42-477a-8c91-41701be83692 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:22.909219 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143165f-7b42-477a-8c91-41701be83692 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:22.909298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143165f-7b42-477a-8c91-41701be83692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:22.912473 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fc594-e9bd-47ef-9f3e-c401ae20d9b1 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:22.912764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fc594-e9bd-47ef-9f3e-c401ae20d9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:22.913040 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fc594-e9bd-47ef-9f3e-c401ae20d9b1 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:22.914385 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 46/99] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:22.921465 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42a099-895a-418f-b9f6-2163722fe8b8 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:22.921760 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42a099-895a-418f-b9f6-2163722fe8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:22.922036 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42a099-895a-418f-b9f6-2163722fe8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:22.940122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3143165f-7b42-477a-8c91-41701be83692 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:22.941811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3143165f-7b42-477a-8c91-41701be83692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:22.949665 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-7b42a099-895a-418f-b9f6-2163722fe8b8 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:22.950921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-7b42a099-895a-418f-b9f6-2163722fe8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:23.062033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 47/100] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:23.101207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 54/101] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:23.104211 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42a099-895a-418f-b9f6-2163722fe8b8 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:23.136629 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143165f-7b42-477a-8c91-41701be83692 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:23.209962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:23.221950 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:23.308667 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42a099-895a-418f-b9f6-2163722fe8b8 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:23.355164 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffcc19-e078-4be8-8301-2f7b556c3a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:23.355963 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffcc19-e078-4be8-8301-2f7b556c3a59 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:23.356251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffcc19-e078-4be8-8301-2f7b556c3a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:23.356528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffcc19-e078-4be8-8301-2f7b556c3a59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:23.357913 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bffcc19-e078-4be8-8301-2f7b556c3a59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:23.359839 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bffcc19-e078-4be8-8301-2f7b556c3a59 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:23.361685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 48/102] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:18:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:23.362752 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ced5fd-54f7-4a91-ac0c-4486cc4cfb02 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:23.363043 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ced5fd-54f7-4a91-ac0c-4486cc4cfb02 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:23.363323 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ced5fd-54f7-4a91-ac0c-4486cc4cfb02 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:23.364555 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 49/103] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:23.376350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ced5fd-54f7-4a91-ac0c-4486cc4cfb02 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:23.378165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143165f-7b42-477a-8c91-41701be83692 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:23.443522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e2c83-cd51-4bee-b715-8bb77f46e098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:23.444296 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e2c83-cd51-4bee-b715-8bb77f46e098 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:23.444585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e2c83-cd51-4bee-b715-8bb77f46e098 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:23.444862 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e2c83-cd51-4bee-b715-8bb77f46e098 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:23.464290 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e2c83-cd51-4bee-b715-8bb77f46e098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:23.477113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-962e2c83-cd51-4bee-b715-8bb77f46e098 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:18:23.477113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:23.477113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:23.477113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:23.477113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:23.477113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:23.477113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:23.477113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:23.477113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:23.477113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:23.477113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:23.477113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:23.477113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:23.477113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:23.477113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:23.477113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:23.478000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:23.478000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:23.478000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:23.478000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:23.478000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:23.478000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:23.478000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:23.478000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:23.478000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:23.478000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:23.478000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:23.478000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:18:23.478000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:23.478000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:23.478000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:23.478000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:23.478854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:23.478854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:23.478854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:23.478854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:23.478854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:23.478854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:23.478854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:23.478854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:23.478854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:23.478854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:23.478854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:18:23.478854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:18:23.478854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 55/104] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:23.480755 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f3e99-2e80-4fde-843f-fd41ebe97f01 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:23.483104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f3e99-2e80-4fde-843f-fd41ebe97f01 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:23.485596 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f3e99-2e80-4fde-843f-fd41ebe97f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:23.520461 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7e8f3e99-2e80-4fde-843f-fd41ebe97f01 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:23.522793 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7e8f3e99-2e80-4fde-843f-fd41ebe97f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:23.554710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ced5fd-54f7-4a91-ac0c-4486cc4cfb02 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:23.582985 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:23.595751 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07af1ea-c162-4e01-8370-b6df05d08bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:23.596723 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07af1ea-c162-4e01-8370-b6df05d08bbb None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:23.597148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07af1ea-c162-4e01-8370-b6df05d08bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:23.597585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07af1ea-c162-4e01-8370-b6df05d08bbb None admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:23.598444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07af1ea-c162-4e01-8370-b6df05d08bbb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:23.600054 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07af1ea-c162-4e01-8370-b6df05d08bbb None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:23.629018 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 50/105] 10.222.0.25 () {60 vars in 1141 bytes} [Mon May 23 12:18:23 2022] POST /identity/v3/projects => generated 302 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:18:23.630246 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07af1ea-c162-4e01-8370-b6df05d08bbb None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:23.693466 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 56/106] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:23.765705 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07af1ea-c162-4e01-8370-b6df05d08bbb None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:23.772012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f3e99-2e80-4fde-843f-fd41ebe97f01 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:23.803674 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e568f03-e0e1-45f5-a3cd-bf66a1b17dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:23.804365 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e568f03-e0e1-45f5-a3cd-bf66a1b17dde None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:23.804654 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e568f03-e0e1-45f5-a3cd-bf66a1b17dde None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:23.804936 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e568f03-e0e1-45f5-a3cd-bf66a1b17dde None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:23.805828 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e568f03-e0e1-45f5-a3cd-bf66a1b17dde None admin] RBAC: Adding query filter params (name=reader) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:23.806203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e568f03-e0e1-45f5-a3cd-bf66a1b17dde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:23.807848 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e568f03-e0e1-45f5-a3cd-bf66a1b17dde None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:23.817516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 51/107] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:18:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:23.823382 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e568f03-e0e1-45f5-a3cd-bf66a1b17dde None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:23.838402 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:23.877179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:23.950291 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e568f03-e0e1-45f5-a3cd-bf66a1b17dde None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:23.986153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec10ce-9561-4156-8ea1-274be60fd675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:23.987079 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec10ce-9561-4156-8ea1-274be60fd675 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:23.987369 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec10ce-9561-4156-8ea1-274be60fd675 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:23.987647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec10ce-9561-4156-8ea1-274be60fd675 None admin] PATH_INFO: `/v3/users/95b0bb6a2fa64ff8939d387b47a7c9ac` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:24.005103 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec10ce-9561-4156-8ea1-274be60fd675 None admin] RBAC: Authorizing `identity:get_user(user_id=95b0bb6a2fa64ff8939d387b47a7c9ac)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:24.007705 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec10ce-9561-4156-8ea1-274be60fd675 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:24.008354 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 52/108] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:23 2022] GET /identity/v3/users/95b0bb6a2fa64ff8939d387b47a7c9ac => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:24.010171 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3099e6f-8ffb-4e19-b9b8-0d3b5cdd755a None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:24.011562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3099e6f-8ffb-4e19-b9b8-0d3b5cdd755a None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:24.013396 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3099e6f-8ffb-4e19-b9b8-0d3b5cdd755a None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:24.015081 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 53/109] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:24.019705 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3099e6f-8ffb-4e19-b9b8-0d3b5cdd755a None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:24.028044 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f3e99-2e80-4fde-843f-fd41ebe97f01 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:24.073190 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cd230-512c-4e37-a8c0-f597c7b0a33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:24.074203 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cd230-512c-4e37-a8c0-f597c7b0a33c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:24.075001 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cd230-512c-4e37-a8c0-f597c7b0a33c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:24.075442 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cd230-512c-4e37-a8c0-f597c7b0a33c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:24.092252 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cd230-512c-4e37-a8c0-f597c7b0a33c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:24.107032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-da0cd230-512c-4e37-a8c0-f597c7b0a33c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:24.107032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:24.107032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:24.107032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:24.107032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:24.107032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:24.107032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:24.107032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:24.107032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:24.107032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:24.107032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:24.107032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:24.107032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:24.107032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:24.107032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:24.107032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:24.108158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:24.108158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:24.108158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:24.108158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:24.108158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:24.108158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:24.108158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:24.108158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:24.108158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:24.108158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:24.108158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:24.108158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:18:24.108158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:24.108158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:24.108158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:24.108158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:24.109107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:24.109107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:24.109107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:24.109107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:24.109107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:24.109107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:24.109107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:24.109107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:24.109107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:24.109107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:24.109107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:24.109107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:18:24.109107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 57/110] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:24.109107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab16015-988c-43de-924f-24abd4341a8c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:24.110221 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab16015-988c-43de-924f-24abd4341a8c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:24.110221 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab16015-988c-43de-924f-24abd4341a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:24.138790 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-cab16015-988c-43de-924f-24abd4341a8c None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:24.146981 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cab16015-988c-43de-924f-24abd4341a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:24.177205 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:24.195192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3099e6f-8ffb-4e19-b9b8-0d3b5cdd755a None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:24.264770 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a8fbd-0a3b-42b1-bfed-a403e149830c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:24.266851 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a8fbd-0a3b-42b1-bfed-a403e149830c None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:24.267303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a8fbd-0a3b-42b1-bfed-a403e149830c None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:24.267728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a8fbd-0a3b-42b1-bfed-a403e149830c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:24.285231 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 58/111] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:24.286381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab16015-988c-43de-924f-24abd4341a8c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:24.315382 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:24.352082 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a8fbd-0a3b-42b1-bfed-a403e149830c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:24.354197 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a8fbd-0a3b-42b1-bfed-a403e149830c None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:24.477213 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:24.491661 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 54/112] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:18:24.492313 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab16015-988c-43de-924f-24abd4341a8c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:24.492639 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a8fbd-0a3b-42b1-bfed-a403e149830c None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:24.553593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fb25f-2672-4762-ad64-78d6f1dfbbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:24.554377 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fb25f-2672-4762-ad64-78d6f1dfbbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:24.554789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fb25f-2672-4762-ad64-78d6f1dfbbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:24.555069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fb25f-2672-4762-ad64-78d6f1dfbbf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:24.555931 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005fb25f-2672-4762-ad64-78d6f1dfbbf1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:24.556262 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005fb25f-2672-4762-ad64-78d6f1dfbbf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:24.558435 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005fb25f-2672-4762-ad64-78d6f1dfbbf1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:24.567653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 59/113] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:18:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:24.568548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fb25f-2672-4762-ad64-78d6f1dfbbf1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:24.598839 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a8fbd-0a3b-42b1-bfed-a403e149830c None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:24.636118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70cc7c-3ea4-43cc-912d-f82917b672bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:24.636905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70cc7c-3ea4-43cc-912d-f82917b672bd None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:24.637204 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70cc7c-3ea4-43cc-912d-f82917b672bd None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:24.637491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70cc7c-3ea4-43cc-912d-f82917b672bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:24.649273 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70cc7c-3ea4-43cc-912d-f82917b672bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:24.656935 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:24.657637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-dc70cc7c-3ea4-43cc-912d-f82917b672bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:24.657637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:24.657637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:24.657637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:24.657637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:24.657637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:24.657637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:24.657637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:24.657637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:24.657637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:24.657637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:24.657637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:24.657637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:24.657637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:24.657637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:24.657637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:24.659436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:24.659436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:24.659436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:24.659436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:24.659436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:24.659436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:24.659436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:24.659436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:24.659436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:24.659436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:24.659436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:24.659436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:18:24.659436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:24.659436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:24.659436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:24.659436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:24.660282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:24.660282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:24.660282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:24.660282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:24.660282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:24.660282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:24.660282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:24.660282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:24.660282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:24.660282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:24.660282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:24.660282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:18:24.665628 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 55/114] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:24.666938 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db5443-4518-4e78-bf3c-f5f757ee954a None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:24.667235 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db5443-4518-4e78-bf3c-f5f757ee954a None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:24.667517 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db5443-4518-4e78-bf3c-f5f757ee954a None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:24.669081 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 56/115] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:24.669896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db5443-4518-4e78-bf3c-f5f757ee954a None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:24.688552 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fb25f-2672-4762-ad64-78d6f1dfbbf1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:24.728086 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077e465-18d4-4418-a84c-88257b6287c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:24.728957 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077e465-18d4-4418-a84c-88257b6287c7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:24.729244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077e465-18d4-4418-a84c-88257b6287c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:24.729521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077e465-18d4-4418-a84c-88257b6287c7 None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:24.731211 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077e465-18d4-4418-a84c-88257b6287c7 None admin] RBAC: Authorizing `identity:get_project(project_id=3fd6ed2a258c474293105ba1798cee00)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:24.732693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077e465-18d4-4418-a84c-88257b6287c7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:24.733857 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:24.734842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 60/116] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:24 2022] GET /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:24.735857 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b313118-cafc-4693-b510-b057a8e20171 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:24.736148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b313118-cafc-4693-b510-b057a8e20171 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:24.736425 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b313118-cafc-4693-b510-b057a8e20171 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:24.741638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 61/117] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:24.741638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b313118-cafc-4693-b510-b057a8e20171 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:24.790699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db5443-4518-4e78-bf3c-f5f757ee954a None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:24.827123 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bce60-08a4-4e73-962b-452cf8450127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:24.827916 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bce60-08a4-4e73-962b-452cf8450127 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:24.828203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bce60-08a4-4e73-962b-452cf8450127 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:24.828479 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bce60-08a4-4e73-962b-452cf8450127 None admin] PATH_INFO: `/v3/users/1a07c7c0378b48d9b37b3826e79a85c5` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:24.829671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bce60-08a4-4e73-962b-452cf8450127 None admin] RBAC: Authorizing `identity:get_user(user_id=1a07c7c0378b48d9b37b3826e79a85c5)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:24.831176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bce60-08a4-4e73-962b-452cf8450127 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:24.832798 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 57/118] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:24 2022] GET /identity/v3/users/1a07c7c0378b48d9b37b3826e79a85c5 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:24.837281 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddd535-5d47-41a2-9df7-f4b38511ac86 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:24.837281 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddd535-5d47-41a2-9df7-f4b38511ac86 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:24.837281 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddd535-5d47-41a2-9df7-f4b38511ac86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:24.853013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-7cddd535-5d47-41a2-9df7-f4b38511ac86 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:24.854797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-7cddd535-5d47-41a2-9df7-f4b38511ac86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:24.866001 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b313118-cafc-4693-b510-b057a8e20171 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:24.906315 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab577d94-db6c-4c50-822c-8dca5fa4b8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:24.907122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab577d94-db6c-4c50-822c-8dca5fa4b8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:24.907416 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab577d94-db6c-4c50-822c-8dca5fa4b8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:24.907698 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab577d94-db6c-4c50-822c-8dca5fa4b8a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:24.908458 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab577d94-db6c-4c50-822c-8dca5fa4b8a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:24.908771 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab577d94-db6c-4c50-822c-8dca5fa4b8a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:24.910278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab577d94-db6c-4c50-822c-8dca5fa4b8a2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:24.924760 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 62/119] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:18:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:24.924760 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab577d94-db6c-4c50-822c-8dca5fa4b8a2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:24.929245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 58/120] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:24.931409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:24.939846 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e49d2-afde-4783-9f94-17342dde4410 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:24.940145 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e49d2-afde-4783-9f94-17342dde4410 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:24.940428 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e49d2-afde-4783-9f94-17342dde4410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:24.959789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-1a2e49d2-afde-4783-9f94-17342dde4410 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:24.961887 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-1a2e49d2-afde-4783-9f94-17342dde4410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:25.015158 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:25.028057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab577d94-db6c-4c50-822c-8dca5fa4b8a2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:25.036649 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 59/121] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:25.037750 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e49d2-afde-4783-9f94-17342dde4410 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:25.073080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a88ba-6f1f-4507-96ce-3eda3f64fb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:25.073729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a88ba-6f1f-4507-96ce-3eda3f64fb16 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:25.074019 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a88ba-6f1f-4507-96ce-3eda3f64fb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:25.074549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a88ba-6f1f-4507-96ce-3eda3f64fb16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:25.075161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a88ba-6f1f-4507-96ce-3eda3f64fb16 None admin] RBAC: Adding query filter params (role.id=ee2f590e932841609deb8ed245e89ef4, scope.project.id=3fd6ed2a258c474293105ba1798cee00, user.id=95b0bb6a2fa64ff8939d387b47a7c9ac) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:25.075474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a88ba-6f1f-4507-96ce-3eda3f64fb16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:25.076931 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a88ba-6f1f-4507-96ce-3eda3f64fb16 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:25.083276 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 63/122] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:18:24 2022] GET /identity/v3/role_assignments?user.id=95b0bb6a2fa64ff8939d387b47a7c9ac&scope.project.id=3fd6ed2a258c474293105ba1798cee00&role.id=ee2f590e932841609deb8ed245e89ef4 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:25.083860 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a88ba-6f1f-4507-96ce-3eda3f64fb16 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:25.189499 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e49d2-afde-4783-9f94-17342dde4410 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:25.193783 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:25.240377 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a88ba-6f1f-4507-96ce-3eda3f64fb16 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:25.244620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fa4cb-a21f-4933-9ac9-0450d948680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:25.245439 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fa4cb-a21f-4933-9ac9-0450d948680a None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:25.245780 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fa4cb-a21f-4933-9ac9-0450d948680a None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:25.246141 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fa4cb-a21f-4933-9ac9-0450d948680a None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:25.248755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612fa4cb-a21f-4933-9ac9-0450d948680a None admin] RBAC: Authorizing `identity:get_project(project_id=3fd6ed2a258c474293105ba1798cee00)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:25.250370 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612fa4cb-a21f-4933-9ac9-0450d948680a None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:25.252355 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 60/123] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:25 2022] GET /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:25.253200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fa4cb-a21f-4933-9ac9-0450d948680a None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:25.301115 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335f1c6-601a-44ae-b4d5-cdd05f290f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:25.302424 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335f1c6-601a-44ae-b4d5-cdd05f290f2b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:25.302754 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335f1c6-601a-44ae-b4d5-cdd05f290f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:25.303040 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335f1c6-601a-44ae-b4d5-cdd05f290f2b None admin] PATH_INFO: `/v3/users/1a07c7c0378b48d9b37b3826e79a85c5` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:25.304638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335f1c6-601a-44ae-b4d5-cdd05f290f2b None admin] RBAC: Authorizing `identity:get_user(user_id=1a07c7c0378b48d9b37b3826e79a85c5)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:25.306603 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335f1c6-601a-44ae-b4d5-cdd05f290f2b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:25.309368 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 64/124] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:25 2022] GET /identity/v3/users/1a07c7c0378b48d9b37b3826e79a85c5 => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:25.314835 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335f1c6-601a-44ae-b4d5-cdd05f290f2b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:25.330349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:25.382033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fa4cb-a21f-4933-9ac9-0450d948680a None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:25.419747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a249d-27a3-4802-b2b4-0eb2bc296be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:25.420560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a249d-27a3-4802-b2b4-0eb2bc296be9 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:25.420854 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a249d-27a3-4802-b2b4-0eb2bc296be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:25.421141 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a249d-27a3-4802-b2b4-0eb2bc296be9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:25.434151 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a249d-27a3-4802-b2b4-0eb2bc296be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:25.443408 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335f1c6-601a-44ae-b4d5-cdd05f290f2b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:25.444106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-627a249d-27a3-4802-b2b4-0eb2bc296be9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:18:25.444106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:25.444106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:25.444106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:25.444106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:25.444106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:25.444106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:25.444106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:25.444106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:25.444106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:25.444106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:25.444106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:25.444106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:25.444106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:25.444106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:25.444106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:25.444926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:25.444926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:25.444926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:25.444926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:25.444926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:25.444926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:25.444926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:25.444926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:25.444926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:25.444926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:25.444926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:25.444926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:18:25.444926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:25.444926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:25.444926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:25.444926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:25.445679 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:25.445679 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:25.445679 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:25.445679 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:25.445679 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:25.445679 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:25.445679 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:25.445679 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:25.445679 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:25.445679 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:25.445679 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:18:25.445679 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:18:25.445679 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 61/125] 10.222.0.25 () {56 vars in 1114 bytes} [Mon May 23 12:18:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:25.447611 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a249d-27a3-4802-b2b4-0eb2bc296be9 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:25.492994 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8e20c-b12d-4265-acd5-04c64481323b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:25.494329 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8e20c-b12d-4265-acd5-04c64481323b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:25.494665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8e20c-b12d-4265-acd5-04c64481323b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:25.494953 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8e20c-b12d-4265-acd5-04c64481323b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:25.509098 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:25.515821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8e20c-b12d-4265-acd5-04c64481323b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:25.527321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-1ab8e20c-b12d-4265-acd5-04c64481323b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:18:25.527321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:25.527321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:25.527321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:25.527321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:25.527321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:25.527321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:25.527321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:25.527321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:25.527321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:25.527321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:25.527321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:25.527321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:25.527321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:25.527321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:25.527321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:25.528184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:25.528184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:25.528184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:25.528184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:25.528184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:25.528184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:25.528184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:25.528184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:25.528184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:25.528184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:25.528184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:25.528184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:18:25.528184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:25.528184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:25.528184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:25.528184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:25.528945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:25.528945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:25.528945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:25.528945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:25.528945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:25.528945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:25.528945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:25.528945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:25.528945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:25.528945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:25.528945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:18:25.528945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:18:25.528945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 65/126] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:18:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:25.530722 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8e20c-b12d-4265-acd5-04c64481323b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:25.565549 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a249d-27a3-4802-b2b4-0eb2bc296be9 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:25.579301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:25.602523 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89d442-2cf8-4dbc-9252-f0916fe09e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:25.603673 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89d442-2cf8-4dbc-9252-f0916fe09e59 None admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:25.604060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89d442-2cf8-4dbc-9252-f0916fe09e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:25.604441 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89d442-2cf8-4dbc-9252-f0916fe09e59 None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00/users/1a07c7c0378b48d9b37b3826e79a85c5/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:25.606554 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89d442-2cf8-4dbc-9252-f0916fe09e59 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fd6ed2a258c474293105ba1798cee00, user_id=1a07c7c0378b48d9b37b3826e79a85c5, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:25.608151 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89d442-2cf8-4dbc-9252-f0916fe09e59 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:25.626603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 62/127] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:18:25 2022] PUT /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00/users/1a07c7c0378b48d9b37b3826e79a85c5/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:18:25.627527 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89d442-2cf8-4dbc-9252-f0916fe09e59 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:25.732906 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8e20c-b12d-4265-acd5-04c64481323b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:25.764990 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89d442-2cf8-4dbc-9252-f0916fe09e59 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:25.805834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841886b-d0ab-49be-9744-9c17a7b394e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:25.807239 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841886b-d0ab-49be-9744-9c17a7b394e3 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:25.807534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841886b-d0ab-49be-9744-9c17a7b394e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:25.807811 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841886b-d0ab-49be-9744-9c17a7b394e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:25.808576 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841886b-d0ab-49be-9744-9c17a7b394e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:25.808940 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841886b-d0ab-49be-9744-9c17a7b394e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:25.810537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841886b-d0ab-49be-9744-9c17a7b394e3 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:25.820675 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 63/128] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:18:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:25.821547 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841886b-d0ab-49be-9744-9c17a7b394e3 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:25.840867 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7685711-80f4-4c86-acd2-d1fa5ff17b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:25.841815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7685711-80f4-4c86-acd2-d1fa5ff17b9f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:25.842111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7685711-80f4-4c86-acd2-d1fa5ff17b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:25.842393 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7685711-80f4-4c86-acd2-d1fa5ff17b9f None admin] PATH_INFO: `/v3/projects/11f4e69612c946569894c24a9ab0b35a` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:25.847420 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7685711-80f4-4c86-acd2-d1fa5ff17b9f None admin] RBAC: Authorizing `identity:get_project(project_id=11f4e69612c946569894c24a9ab0b35a)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:25.848959 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7685711-80f4-4c86-acd2-d1fa5ff17b9f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:25.852082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 66/129] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:25 2022] GET /identity/v3/projects/11f4e69612c946569894c24a9ab0b35a => generated 312 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:25.852905 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7685711-80f4-4c86-acd2-d1fa5ff17b9f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:25.867197 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:25.953267 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841886b-d0ab-49be-9744-9c17a7b394e3 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:25.974925 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:25.998305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117dd57-7bb8-4bdf-af2e-c5caa1440f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:25.999260 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117dd57-7bb8-4bdf-af2e-c5caa1440f39 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:25.999557 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117dd57-7bb8-4bdf-af2e-c5caa1440f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:25.999838 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117dd57-7bb8-4bdf-af2e-c5caa1440f39 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:26.000592 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117dd57-7bb8-4bdf-af2e-c5caa1440f39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:26.000901 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117dd57-7bb8-4bdf-af2e-c5caa1440f39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:26.003546 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117dd57-7bb8-4bdf-af2e-c5caa1440f39 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:26.015042 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 64/130] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:26.015840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117dd57-7bb8-4bdf-af2e-c5caa1440f39 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:26.016475 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7685711-80f4-4c86-acd2-d1fa5ff17b9f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:26.056482 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c3bb0-066c-46d9-a271-bf1c77629dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:26.057370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c3bb0-066c-46d9-a271-bf1c77629dea None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:26.057713 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c3bb0-066c-46d9-a271-bf1c77629dea None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:26.057999 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c3bb0-066c-46d9-a271-bf1c77629dea None admin] PATH_INFO: `/v3/users/1a07c7c0378b48d9b37b3826e79a85c5` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:26.059538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c3bb0-066c-46d9-a271-bf1c77629dea None admin] RBAC: Authorizing `identity:get_user(user_id=1a07c7c0378b48d9b37b3826e79a85c5)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:26.061070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c3bb0-066c-46d9-a271-bf1c77629dea None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:26.064013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 67/131] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:25 2022] GET /identity/v3/users/1a07c7c0378b48d9b37b3826e79a85c5 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:26.064962 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c3bb0-066c-46d9-a271-bf1c77629dea None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:26.193062 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c3bb0-066c-46d9-a271-bf1c77629dea None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:26.218565 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:26.233834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117dd57-7bb8-4bdf-af2e-c5caa1440f39 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:26.244670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0612e9-9a7a-476d-920a-b9c39caefe0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:26.245559 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0612e9-9a7a-476d-920a-b9c39caefe0d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:26.245844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0612e9-9a7a-476d-920a-b9c39caefe0d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:26.246168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0612e9-9a7a-476d-920a-b9c39caefe0d None admin] PATH_INFO: `/v3/users/38b5788f4258438a9175f55196c13413` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:26.247413 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0612e9-9a7a-476d-920a-b9c39caefe0d None admin] RBAC: Authorizing `identity:get_user(user_id=38b5788f4258438a9175f55196c13413)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:26.248943 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0612e9-9a7a-476d-920a-b9c39caefe0d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:26.250534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 68/132] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:26 2022] GET /identity/v3/users/38b5788f4258438a9175f55196c13413 => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:26.251299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0612e9-9a7a-476d-920a-b9c39caefe0d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:26.259131 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:26.293642 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f21bbf-16ef-45a6-b5d6-40a4a1c53cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:26.294929 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f21bbf-16ef-45a6-b5d6-40a4a1c53cd6 None admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:26.295444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f21bbf-16ef-45a6-b5d6-40a4a1c53cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:26.295984 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f21bbf-16ef-45a6-b5d6-40a4a1c53cd6 None admin] PATH_INFO: `/v3/projects/11f4e69612c946569894c24a9ab0b35a/users/1a07c7c0378b48d9b37b3826e79a85c5/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:26.298276 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f21bbf-16ef-45a6-b5d6-40a4a1c53cd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=11f4e69612c946569894c24a9ab0b35a, user_id=1a07c7c0378b48d9b37b3826e79a85c5, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:26.300130 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f21bbf-16ef-45a6-b5d6-40a4a1c53cd6 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:26.317313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 65/133] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:18:26 2022] PUT /identity/v3/projects/11f4e69612c946569894c24a9ab0b35a/users/1a07c7c0378b48d9b37b3826e79a85c5/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:18:26.318622 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f21bbf-16ef-45a6-b5d6-40a4a1c53cd6 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:26.404163 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0612e9-9a7a-476d-920a-b9c39caefe0d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:26.466410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f21bbf-16ef-45a6-b5d6-40a4a1c53cd6 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:26.506846 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbb4fe-a795-4b69-8d3e-9e7085b3a637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:26.507561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195db64b-ef30-41d3-85cb-e3e4ecaeac60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:26.507694 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbb4fe-a795-4b69-8d3e-9e7085b3a637 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:26.507919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbb4fe-a795-4b69-8d3e-9e7085b3a637 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:26.508203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbb4fe-a795-4b69-8d3e-9e7085b3a637 None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:26.509911 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195db64b-ef30-41d3-85cb-e3e4ecaeac60 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:26.510017 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbb4fe-a795-4b69-8d3e-9e7085b3a637 None admin] RBAC: Authorizing `identity:get_project(project_id=3fd6ed2a258c474293105ba1798cee00)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:26.510522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195db64b-ef30-41d3-85cb-e3e4ecaeac60 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:26.511003 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195db64b-ef30-41d3-85cb-e3e4ecaeac60 None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:26.511521 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbb4fe-a795-4b69-8d3e-9e7085b3a637 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:26.512721 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195db64b-ef30-41d3-85cb-e3e4ecaeac60 None admin] RBAC: Authorizing `identity:get_project(project_id=3fd6ed2a258c474293105ba1798cee00)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:26.513472 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 66/134] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:26 2022] GET /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:26.519107 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89309d-34fb-4311-9f85-535880f29f97 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:26.519107 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89309d-34fb-4311-9f85-535880f29f97 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:26.519107 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89309d-34fb-4311-9f85-535880f29f97 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:26.519107 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 67/135] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:26.519107 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89309d-34fb-4311-9f85-535880f29f97 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:26.520684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195db64b-ef30-41d3-85cb-e3e4ecaeac60 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:26.523081 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 69/136] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:26 2022] GET /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:26.528169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e49416-3bc4-4a26-9ad9-645b35e13a91 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:26.528738 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e49416-3bc4-4a26-9ad9-645b35e13a91 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:26.529234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e49416-3bc4-4a26-9ad9-645b35e13a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:26.554875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:26.557744 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-60e49416-3bc4-4a26-9ad9-645b35e13a91 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:26.559190 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-60e49416-3bc4-4a26-9ad9-645b35e13a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:26.635144 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:26.641376 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 70/137] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:26.642354 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e49416-3bc4-4a26-9ad9-645b35e13a91 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:26.647588 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89309d-34fb-4311-9f85-535880f29f97 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:26.705235 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bbc75-1473-4401-9595-3f9b2e546b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:26.706137 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bbc75-1473-4401-9595-3f9b2e546b71 None admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:26.706427 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bbc75-1473-4401-9595-3f9b2e546b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:26.706808 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bbc75-1473-4401-9595-3f9b2e546b71 None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00/users/38b5788f4258438a9175f55196c13413/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:26.709934 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bbc75-1473-4401-9595-3f9b2e546b71 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fd6ed2a258c474293105ba1798cee00, user_id=38b5788f4258438a9175f55196c13413, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:26.711443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bbc75-1473-4401-9595-3f9b2e546b71 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:26.728723 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 68/138] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:18:26 2022] PUT /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00/users/38b5788f4258438a9175f55196c13413/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:18:26.735924 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bbc75-1473-4401-9595-3f9b2e546b71 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:26.785168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e49416-3bc4-4a26-9ad9-645b35e13a91 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:26.824661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f218d-e0f7-4f22-a0d8-e3c39077ede6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:26.825957 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f218d-e0f7-4f22-a0d8-e3c39077ede6 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:26.826475 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f218d-e0f7-4f22-a0d8-e3c39077ede6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:26.827004 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f218d-e0f7-4f22-a0d8-e3c39077ede6 None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00/users/1a07c7c0378b48d9b37b3826e79a85c5/roles/d9ac3d950cc243aaa45c802dd5f3d844` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:26.829777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f218d-e0f7-4f22-a0d8-e3c39077ede6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fd6ed2a258c474293105ba1798cee00, user_id=1a07c7c0378b48d9b37b3826e79a85c5, role_id=d9ac3d950cc243aaa45c802dd5f3d844)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:26.831606 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f218d-e0f7-4f22-a0d8-e3c39077ede6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:26.861070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 71/139] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:18:26 2022] PUT /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00/users/1a07c7c0378b48d9b37b3826e79a85c5/roles/d9ac3d950cc243aaa45c802dd5f3d844 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:18:26.879834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:26.908374 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bbc75-1473-4401-9595-3f9b2e546b71 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:26.966891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1614b6-85fe-4aa5-81bc-1c6895593303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:26.967738 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1614b6-85fe-4aa5-81bc-1c6895593303 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:26.968099 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1614b6-85fe-4aa5-81bc-1c6895593303 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:26.968386 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1614b6-85fe-4aa5-81bc-1c6895593303 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:26.969787 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1614b6-85fe-4aa5-81bc-1c6895593303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:26.971381 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1614b6-85fe-4aa5-81bc-1c6895593303 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:26.974281 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 69/140] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:18:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:26.979247 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f218d-e0f7-4f22-a0d8-e3c39077ede6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:27.054402 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:27.103677 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f218d-e0f7-4f22-a0d8-e3c39077ede6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:27.141666 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5068af0-b391-4e1f-8f59-0f9ce53c5e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:27.142347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5068af0-b391-4e1f-8f59-0f9ce53c5e23 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:27.142666 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5068af0-b391-4e1f-8f59-0f9ce53c5e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:27.142948 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5068af0-b391-4e1f-8f59-0f9ce53c5e23 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:27.143697 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5068af0-b391-4e1f-8f59-0f9ce53c5e23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:27.145188 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5068af0-b391-4e1f-8f59-0f9ce53c5e23 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:27.169160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 72/141] 10.222.0.25 () {60 vars in 1132 bytes} [Mon May 23 12:18:26 2022] POST /identity/v3/users => generated 283 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:18:27.796847 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee5252-fa1d-40df-bbd0-b0634096abdb None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:27.797347 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee5252-fa1d-40df-bbd0-b0634096abdb None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:27.797443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee5252-fa1d-40df-bbd0-b0634096abdb None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:27.799020 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 70/142] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:27.804149 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e4ac9-833f-45ad-93ea-d73d3d71422b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:27.804446 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e4ac9-833f-45ad-93ea-d73d3d71422b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:27.804728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e4ac9-833f-45ad-93ea-d73d3d71422b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:27.832076 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-485e4ac9-833f-45ad-93ea-d73d3d71422b None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:27.833604 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-485e4ac9-833f-45ad-93ea-d73d3d71422b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:27.924622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 73/143] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:27.949462 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee5252-fa1d-40df-bbd0-b0634096abdb None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:28.071307 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee5252-fa1d-40df-bbd0-b0634096abdb None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:28.110312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69d14d-9420-45cc-a71e-b1d201f89c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:28.111148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69d14d-9420-45cc-a71e-b1d201f89c52 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:28.111438 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69d14d-9420-45cc-a71e-b1d201f89c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:28.111717 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69d14d-9420-45cc-a71e-b1d201f89c52 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:28.131563 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69d14d-9420-45cc-a71e-b1d201f89c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:28.144303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-ae69d14d-9420-45cc-a71e-b1d201f89c52 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:18:28.144303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:28.144303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:28.144303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:28.144303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:28.144303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:28.144303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:28.144303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:28.144303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:28.144303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:28.144303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:28.144303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:28.144303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:28.144303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:28.144303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:28.144303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:28.145301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:28.145301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:28.145301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:28.145301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:28.145301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:28.145301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:28.145301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:28.145301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:28.145301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:28.145301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:28.145301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:28.145301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:18:28.145301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:28.145301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:28.145301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:28.145301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:28.146060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:28.146060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:28.146060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:28.146060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:28.146060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:28.146060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:28.146060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:28.146060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:28.146060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:28.146060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:28.146060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:18:28.146060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:18:28.146060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 71/144] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:28.153747 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e4ac9-833f-45ad-93ea-d73d3d71422b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:28.229024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:28.298559 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e4ac9-833f-45ad-93ea-d73d3d71422b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:28.347068 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95143bc8-1bd6-4f69-985f-cd5a13ed3f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:28.347755 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95143bc8-1bd6-4f69-985f-cd5a13ed3f26 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:28.348041 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95143bc8-1bd6-4f69-985f-cd5a13ed3f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:28.348317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95143bc8-1bd6-4f69-985f-cd5a13ed3f26 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:28.349076 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95143bc8-1bd6-4f69-985f-cd5a13ed3f26 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:28.349382 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95143bc8-1bd6-4f69-985f-cd5a13ed3f26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:28.350821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95143bc8-1bd6-4f69-985f-cd5a13ed3f26 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:28.363495 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 74/145] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:18:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:28.369872 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69d14d-9420-45cc-a71e-b1d201f89c52 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:28.400815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:28.530372 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69d14d-9420-45cc-a71e-b1d201f89c52 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:28.572163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d040fd-15e0-4cce-9d46-7a0331908c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:28.573057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d040fd-15e0-4cce-9d46-7a0331908c52 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:28.573352 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d040fd-15e0-4cce-9d46-7a0331908c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:28.573636 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d040fd-15e0-4cce-9d46-7a0331908c52 None admin] PATH_INFO: `/v3/users/95b0bb6a2fa64ff8939d387b47a7c9ac` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:28.574904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d040fd-15e0-4cce-9d46-7a0331908c52 None admin] RBAC: Authorizing `identity:get_user(user_id=95b0bb6a2fa64ff8939d387b47a7c9ac)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:28.576719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d040fd-15e0-4cce-9d46-7a0331908c52 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:28.578577 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 72/146] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:28 2022] GET /identity/v3/users/95b0bb6a2fa64ff8939d387b47a7c9ac => generated 289 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:28.584988 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95143bc8-1bd6-4f69-985f-cd5a13ed3f26 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:28.749503 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e60e8-bd29-4979-a711-7c75cc9e3561 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:28.749931 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e60e8-bd29-4979-a711-7c75cc9e3561 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:28.750415 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e60e8-bd29-4979-a711-7c75cc9e3561 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:28.756643 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 73/147] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:28.759259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95143bc8-1bd6-4f69-985f-cd5a13ed3f26 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:28.765315 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b1bcf-3523-4373-8d53-799587c3c6c1 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:28.765793 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b1bcf-3523-4373-8d53-799587c3c6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:28.766255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b1bcf-3523-4373-8d53-799587c3c6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:28.779075 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:28.820148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-767b1bcf-3523-4373-8d53-799587c3c6c1 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:28.822858 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-767b1bcf-3523-4373-8d53-799587c3c6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:28.825642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0953cbf-89c8-4000-97a4-992980efb50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:28.826682 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0953cbf-89c8-4000-97a4-992980efb50b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:28.826973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0953cbf-89c8-4000-97a4-992980efb50b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:28.827252 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0953cbf-89c8-4000-97a4-992980efb50b None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:28.829561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0953cbf-89c8-4000-97a4-992980efb50b None admin] RBAC: Authorizing `identity:get_project(project_id=3fd6ed2a258c474293105ba1798cee00)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:28.831069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0953cbf-89c8-4000-97a4-992980efb50b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:28.833089 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 75/148] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:28 2022] GET /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:28.843829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0953cbf-89c8-4000-97a4-992980efb50b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:28.979431 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 74/149] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:18:29.017388 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b1bcf-3523-4373-8d53-799587c3c6c1 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:29.036441 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:29.041320 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0953cbf-89c8-4000-97a4-992980efb50b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:29.117776 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a33ff-2e74-4c08-a036-1516846ac0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:29.119332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a33ff-2e74-4c08-a036-1516846ac0b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:29.119627 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a33ff-2e74-4c08-a036-1516846ac0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:29.119910 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a33ff-2e74-4c08-a036-1516846ac0b5 None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00/users/95b0bb6a2fa64ff8939d387b47a7c9ac/roles/ee2f590e932841609deb8ed245e89ef4` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:29.127057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a33ff-2e74-4c08-a036-1516846ac0b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fd6ed2a258c474293105ba1798cee00, user_id=95b0bb6a2fa64ff8939d387b47a7c9ac, role_id=ee2f590e932841609deb8ed245e89ef4)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:29.128588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a33ff-2e74-4c08-a036-1516846ac0b5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:29.158969 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 76/150] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:18:28 2022] PUT /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00/users/95b0bb6a2fa64ff8939d387b47a7c9ac/roles/ee2f590e932841609deb8ed245e89ef4 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:18:29.237885 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b1bcf-3523-4373-8d53-799587c3c6c1 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:29.286658 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafaeb8c-5ce3-4838-8955-9cb3df18e189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:29.287390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafaeb8c-5ce3-4838-8955-9cb3df18e189 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:29.287680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafaeb8c-5ce3-4838-8955-9cb3df18e189 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:29.287962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafaeb8c-5ce3-4838-8955-9cb3df18e189 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:29.306068 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafaeb8c-5ce3-4838-8955-9cb3df18e189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:29.315466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-bafaeb8c-5ce3-4838-8955-9cb3df18e189 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:29.315466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:29.315466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:29.315466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:29.315466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:29.315466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:29.315466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:29.315466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:29.315466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:29.315466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:29.315466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:29.315466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:29.315466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:29.315466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:29.315466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:29.315466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:29.316350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:29.316350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:29.316350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:29.316350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:29.316350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:29.316350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:29.316350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:29.316350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:29.316350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:29.316350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:29.316350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:29.316350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:18:29.316350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:29.316350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:29.316350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:29.316350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:29.317106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:29.317106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:29.317106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:29.317106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:29.317106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:29.317106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:29.317106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:29.317106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:29.317106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:29.317106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:29.317106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:29.317106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:18:29.317106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 75/151] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:18:29.322375 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a33ff-2e74-4c08-a036-1516846ac0b5 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:29.413030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:29.524349 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a33ff-2e74-4c08-a036-1516846ac0b5 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:29.568242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704ce1a-bb1a-47c0-a577-79ec66ad77c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:29.568839 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704ce1a-bb1a-47c0-a577-79ec66ad77c8 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:29.569126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704ce1a-bb1a-47c0-a577-79ec66ad77c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:29.569406 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704ce1a-bb1a-47c0-a577-79ec66ad77c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:29.570173 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704ce1a-bb1a-47c0-a577-79ec66ad77c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:29.570484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704ce1a-bb1a-47c0-a577-79ec66ad77c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:29.572477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704ce1a-bb1a-47c0-a577-79ec66ad77c8 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:29.582872 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 77/152] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:18:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:29.587532 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafaeb8c-5ce3-4838-8955-9cb3df18e189 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:29.665885 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:29.698955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafaeb8c-5ce3-4838-8955-9cb3df18e189 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:29.745601 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531e5ac-3c14-4aa0-af59-ca3112ee2c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:29.746482 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531e5ac-3c14-4aa0-af59-ca3112ee2c1d None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:29.746797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531e5ac-3c14-4aa0-af59-ca3112ee2c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:29.747076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531e5ac-3c14-4aa0-af59-ca3112ee2c1d None admin] PATH_INFO: `/v3/users/1a07c7c0378b48d9b37b3826e79a85c5` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:29.749151 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531e5ac-3c14-4aa0-af59-ca3112ee2c1d None admin] RBAC: Authorizing `identity:get_user(user_id=1a07c7c0378b48d9b37b3826e79a85c5)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:29.750641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531e5ac-3c14-4aa0-af59-ca3112ee2c1d None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:29.752447 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 76/153] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:29 2022] GET /identity/v3/users/1a07c7c0378b48d9b37b3826e79a85c5 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:29.757964 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704ce1a-bb1a-47c0-a577-79ec66ad77c8 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:29.875695 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:29.880006 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704ce1a-bb1a-47c0-a577-79ec66ad77c8 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:29.920624 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a9402-6983-4050-ad73-2f95d04e218c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:29.921295 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a9402-6983-4050-ad73-2f95d04e218c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:29.921614 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a9402-6983-4050-ad73-2f95d04e218c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:29.921926 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a9402-6983-4050-ad73-2f95d04e218c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:30.005085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a9402-6983-4050-ad73-2f95d04e218c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:30.007222 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a9402-6983-4050-ad73-2f95d04e218c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:30.130757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:30.136764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 78/154] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:18:30.142531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531e5ac-3c14-4aa0-af59-ca3112ee2c1d None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:30.270826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531e5ac-3c14-4aa0-af59-ca3112ee2c1d None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:30.313129 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856a7f2-00b3-4d1c-ae8c-47a85e1ae0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:30.313999 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856a7f2-00b3-4d1c-ae8c-47a85e1ae0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:30.314284 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856a7f2-00b3-4d1c-ae8c-47a85e1ae0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:30.314587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856a7f2-00b3-4d1c-ae8c-47a85e1ae0d7 None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:30.319238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856a7f2-00b3-4d1c-ae8c-47a85e1ae0d7 None admin] RBAC: Authorizing `identity:get_project(project_id=3fd6ed2a258c474293105ba1798cee00)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:30.320712 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856a7f2-00b3-4d1c-ae8c-47a85e1ae0d7 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:30.323344 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 77/155] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:30 2022] GET /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:30.329278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a9402-6983-4050-ad73-2f95d04e218c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:30.450642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a9402-6983-4050-ad73-2f95d04e218c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:30.488596 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0e2e2-b480-4402-b814-4c8e263d7646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:30.489274 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0e2e2-b480-4402-b814-4c8e263d7646 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:30.489592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0e2e2-b480-4402-b814-4c8e263d7646 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:30.489902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0e2e2-b480-4402-b814-4c8e263d7646 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:30.490842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0e2e2-b480-4402-b814-4c8e263d7646 None admin] RBAC: Adding query filter params (role.id=3dac847973464a2cb123dc2c9083baf3, scope.project.id=3fd6ed2a258c474293105ba1798cee00, user.id=1a07c7c0378b48d9b37b3826e79a85c5) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:30.491170 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0e2e2-b480-4402-b814-4c8e263d7646 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:30.492912 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0e2e2-b480-4402-b814-4c8e263d7646 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:30.503472 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 79/156] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:18:30 2022] GET /identity/v3/role_assignments?user.id=1a07c7c0378b48d9b37b3826e79a85c5&scope.project.id=3fd6ed2a258c474293105ba1798cee00&role.id=3dac847973464a2cb123dc2c9083baf3 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:31.033955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625fde5-7a42-4d81-9727-c153e85068fc None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:31.034340 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625fde5-7a42-4d81-9727-c153e85068fc None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:31.034545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625fde5-7a42-4d81-9727-c153e85068fc None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:31.036413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 78/157] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:31.042412 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c03ef5-fa0a-4ce1-801f-948de523a08f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:31.042815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c03ef5-fa0a-4ce1-801f-948de523a08f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:31.043132 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c03ef5-fa0a-4ce1-801f-948de523a08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:31.068836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-53c03ef5-fa0a-4ce1-801f-948de523a08f None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:31.070130 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-53c03ef5-fa0a-4ce1-801f-948de523a08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:31.154052 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:31.166647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 80/158] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:31.209949 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625fde5-7a42-4d81-9727-c153e85068fc None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:31.220585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:31.330291 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625fde5-7a42-4d81-9727-c153e85068fc None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:31.372385 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e45c8-1931-4d85-98f4-201b56b79af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:31.373193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e45c8-1931-4d85-98f4-201b56b79af3 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:31.373482 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e45c8-1931-4d85-98f4-201b56b79af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:31.373765 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e45c8-1931-4d85-98f4-201b56b79af3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:31.387337 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e45c8-1931-4d85-98f4-201b56b79af3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:31.395426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-201e45c8-1931-4d85-98f4-201b56b79af3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:31.395426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:31.395426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:31.395426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:31.395426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:31.395426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:31.395426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:31.395426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:31.395426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:31.395426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:31.395426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:31.395426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:31.395426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:31.395426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:31.395426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:31.395426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:31.396303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:31.396303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:31.396303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:31.396303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:31.396303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:31.396303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:31.396303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:31.396303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:31.396303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:31.396303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:31.396303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:31.396303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:18:31.396303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:31.396303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:31.396303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:31.396303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:31.397118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:31.397118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:31.397118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:31.397118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:31.397118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:31.397118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:31.397118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:31.397118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:31.397118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:31.397118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:31.397118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:31.397118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:18:31.397118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 79/159] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:31.403565 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c03ef5-fa0a-4ce1-801f-948de523a08f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:31.520716 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaa41f-98a0-4454-90ff-31f970b5ee87 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:31.521359 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaa41f-98a0-4454-90ff-31f970b5ee87 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:31.521841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaa41f-98a0-4454-90ff-31f970b5ee87 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:31.525301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 80/160] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:31.528459 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ccfa9-d149-448b-a887-daf3113f4f50 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:31.528992 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ccfa9-d149-448b-a887-daf3113f4f50 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:31.529503 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ccfa9-d149-448b-a887-daf3113f4f50 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:31.534670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 81/161] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:31.536228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e68ac-27f7-41fb-83e6-4fa64ea4583f None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:31.536728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e68ac-27f7-41fb-83e6-4fa64ea4583f None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:31.537266 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e68ac-27f7-41fb-83e6-4fa64ea4583f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:31.538366 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c03ef5-fa0a-4ce1-801f-948de523a08f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:31.571165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-225e68ac-27f7-41fb-83e6-4fa64ea4583f None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:31.573302 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-225e68ac-27f7-41fb-83e6-4fa64ea4583f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:31.628124 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176c361-9152-4583-9bce-98a5faf33ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:31.628808 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176c361-9152-4583-9bce-98a5faf33ccb None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:31.629086 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176c361-9152-4583-9bce-98a5faf33ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:31.629358 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176c361-9152-4583-9bce-98a5faf33ccb None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:31.630113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176c361-9152-4583-9bce-98a5faf33ccb None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:31.630421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176c361-9152-4583-9bce-98a5faf33ccb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:31.631846 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176c361-9152-4583-9bce-98a5faf33ccb None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:31.645956 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 81/162] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:18:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:31.647256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a4678-ffe0-4b93-85a3-0af968c9c6ff None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:31.647546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a4678-ffe0-4b93-85a3-0af968c9c6ff None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:31.647823 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a4678-ffe0-4b93-85a3-0af968c9c6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:31.687528 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-af3a4678-ffe0-4b93-85a3-0af968c9c6ff None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:31.688729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-af3a4678-ffe0-4b93-85a3-0af968c9c6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:31.690994 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:31.709981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 82/163] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:31.710993 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e68ac-27f7-41fb-83e6-4fa64ea4583f None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:31.826396 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:31.872824 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 82/164] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:31.874017 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a4678-ffe0-4b93-85a3-0af968c9c6ff None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:31.926873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e68ac-27f7-41fb-83e6-4fa64ea4583f None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:32.009709 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1650021-2c6f-473e-aaeb-e61435b6d190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:32.011436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1650021-2c6f-473e-aaeb-e61435b6d190 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:32.011967 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1650021-2c6f-473e-aaeb-e61435b6d190 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:32.012447 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1650021-2c6f-473e-aaeb-e61435b6d190 None admin] PATH_INFO: `/v3/users/1a07c7c0378b48d9b37b3826e79a85c5` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:32.016529 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1650021-2c6f-473e-aaeb-e61435b6d190 None admin] RBAC: Authorizing `identity:get_user(user_id=1a07c7c0378b48d9b37b3826e79a85c5)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:32.018545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1650021-2c6f-473e-aaeb-e61435b6d190 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:32.021464 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 83/165] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:31 2022] GET /identity/v3/users/1a07c7c0378b48d9b37b3826e79a85c5 => generated 275 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:32.022737 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1650021-2c6f-473e-aaeb-e61435b6d190 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:32.112351 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a4678-ffe0-4b93-85a3-0af968c9c6ff None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:32.145138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:32.172891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5bddb-ac3a-4ca5-9790-a05fdbe9a03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:32.174911 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5bddb-ac3a-4ca5-9790-a05fdbe9a03a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:32.175822 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5bddb-ac3a-4ca5-9790-a05fdbe9a03a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:32.176608 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5bddb-ac3a-4ca5-9790-a05fdbe9a03a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:32.201272 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5bddb-ac3a-4ca5-9790-a05fdbe9a03a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:32.217550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-e4a5bddb-ac3a-4ca5-9790-a05fdbe9a03a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:18:32.217550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:32.217550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:32.217550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:32.217550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:32.217550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:32.217550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:32.217550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:32.217550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:32.217550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:32.217550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:32.217550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:32.217550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:32.217550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:32.217550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:32.217550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:32.219035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:32.219035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:32.219035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:32.219035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:32.219035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:32.219035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:32.219035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:32.219035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:32.219035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:32.219035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:32.219035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:32.219035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:18:32.219035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:32.219035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:32.219035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:32.219035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:32.220439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:32.220439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:32.220439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:32.220439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:32.220439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:32.220439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:32.220439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:32.220439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:32.220439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:32.220439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:32.220439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:18:32.220439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:18:32.220439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 83/166] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:18:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:32.220439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5bddb-ac3a-4ca5-9790-a05fdbe9a03a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:32.251824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1650021-2c6f-473e-aaeb-e61435b6d190 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:32.282921 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:32.326157 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7d695-bbcb-4fe3-933f-0b56095886c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:32.327006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7d695-bbcb-4fe3-933f-0b56095886c6 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:32.327293 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7d695-bbcb-4fe3-933f-0b56095886c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:32.327573 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7d695-bbcb-4fe3-933f-0b56095886c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:32.338153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5bddb-ac3a-4ca5-9790-a05fdbe9a03a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:32.345535 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7d695-bbcb-4fe3-933f-0b56095886c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:32.356648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-e8d7d695-bbcb-4fe3-933f-0b56095886c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:18:32.356648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:32.356648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:32.356648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:32.356648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:32.356648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:32.356648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:32.356648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:32.356648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:32.356648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:32.356648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:32.356648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:32.356648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:32.356648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:32.356648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:32.356648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:32.359134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:32.359134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:32.359134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:32.359134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:32.359134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:32.359134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:32.359134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:32.359134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:32.359134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:32.359134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:32.359134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:32.359134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:18:32.359134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:32.359134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:32.359134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:32.359134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:32.361562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:32.361562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:32.361562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:32.361562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:32.361562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:32.361562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:32.361562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:32.361562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:32.361562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:32.361562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:32.361562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:18:32.361562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:18:32.361562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 84/167] 10.222.0.25 () {56 vars in 1114 bytes} [Mon May 23 12:18:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:32.361562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98beaa-3d6b-45c6-abf8-bee97075497e None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:32.367588 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98beaa-3d6b-45c6-abf8-bee97075497e None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:32.367588 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98beaa-3d6b-45c6-abf8-bee97075497e None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:32.367588 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 85/168] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:32.367588 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98beaa-3d6b-45c6-abf8-bee97075497e None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:32.385169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e22583-663b-4df7-99df-174faca2c23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:32.385825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e22583-663b-4df7-99df-174faca2c23b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:32.386111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e22583-663b-4df7-99df-174faca2c23b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:32.386383 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e22583-663b-4df7-99df-174faca2c23b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:32.459235 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e22583-663b-4df7-99df-174faca2c23b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:32.461459 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e22583-663b-4df7-99df-174faca2c23b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:32.505688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98beaa-3d6b-45c6-abf8-bee97075497e None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:32.510396 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:32.539232 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:32.553286 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d475c8-7735-462d-bdb5-17f5ca28fb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:32.553966 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d475c8-7735-462d-bdb5-17f5ca28fb09 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:32.554253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d475c8-7735-462d-bdb5-17f5ca28fb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:32.554716 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d475c8-7735-462d-bdb5-17f5ca28fb09 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:32.555662 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d475c8-7735-462d-bdb5-17f5ca28fb09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:32.556494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d475c8-7735-462d-bdb5-17f5ca28fb09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:32.558378 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d475c8-7735-462d-bdb5-17f5ca28fb09 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:32.569544 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 86/169] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:32.571320 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a6363-cd9c-44f9-9866-405dabd273e0 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:32.572169 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a6363-cd9c-44f9-9866-405dabd273e0 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:32.572464 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a6363-cd9c-44f9-9866-405dabd273e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:32.581338 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 84/170] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:18:32.583267 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e52e0c-1f4f-4429-aacd-eb104c62d7c3 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:32.583765 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e52e0c-1f4f-4429-aacd-eb104c62d7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:32.584251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e52e0c-1f4f-4429-aacd-eb104c62d7c3 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:32.586163 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 85/171] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:32.587229 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e52e0c-1f4f-4429-aacd-eb104c62d7c3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:32.596372 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-553a6363-cd9c-44f9-9866-405dabd273e0 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:32.598072 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-553a6363-cd9c-44f9-9866-405dabd273e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:32.673691 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 87/172] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:32.675011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a6363-cd9c-44f9-9866-405dabd273e0 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:32.716409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e52e0c-1f4f-4429-aacd-eb104c62d7c3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:32.767469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce9f5f-db73-464f-a51c-e9ba3d22b284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:32.768404 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce9f5f-db73-464f-a51c-e9ba3d22b284 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:32.768694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce9f5f-db73-464f-a51c-e9ba3d22b284 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:32.768968 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce9f5f-db73-464f-a51c-e9ba3d22b284 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:32.770330 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce9f5f-db73-464f-a51c-e9ba3d22b284 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:32.770688 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce9f5f-db73-464f-a51c-e9ba3d22b284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:32.772383 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce9f5f-db73-464f-a51c-e9ba3d22b284 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:32.783135 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 86/173] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:18:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:32.784069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce9f5f-db73-464f-a51c-e9ba3d22b284 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:32.796677 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:32.810931 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a6363-cd9c-44f9-9866-405dabd273e0 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:32.829813 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:32.850730 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f5cbb-11de-4c7a-bed3-d55a48fa9c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:32.852134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f5cbb-11de-4c7a-bed3-d55a48fa9c30 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:32.852613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f5cbb-11de-4c7a-bed3-d55a48fa9c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:32.853612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f5cbb-11de-4c7a-bed3-d55a48fa9c30 None admin] PATH_INFO: `/v3/users/38b5788f4258438a9175f55196c13413` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:32.855063 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f5cbb-11de-4c7a-bed3-d55a48fa9c30 None admin] RBAC: Authorizing `identity:get_user(user_id=38b5788f4258438a9175f55196c13413)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:32.856876 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f5cbb-11de-4c7a-bed3-d55a48fa9c30 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:32.858971 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 88/174] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:32 2022] GET /identity/v3/users/38b5788f4258438a9175f55196c13413 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:32.860680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623736e-22c6-48bf-9871-0bf9e1d3d464 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:32.861298 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623736e-22c6-48bf-9871-0bf9e1d3d464 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:32.861778 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623736e-22c6-48bf-9871-0bf9e1d3d464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:32.879977 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-6623736e-22c6-48bf-9871-0bf9e1d3d464 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:32.881547 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-6623736e-22c6-48bf-9871-0bf9e1d3d464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:32.914312 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce9f5f-db73-464f-a51c-e9ba3d22b284 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:32.958243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe01c64-125a-4041-8137-c18d7a4d9042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:32.959121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe01c64-125a-4041-8137-c18d7a4d9042 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:32.959404 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe01c64-125a-4041-8137-c18d7a4d9042 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:32.959683 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe01c64-125a-4041-8137-c18d7a4d9042 None admin] PATH_INFO: `/v3/projects/11f4e69612c946569894c24a9ab0b35a` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:32.960882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe01c64-125a-4041-8137-c18d7a4d9042 None admin] RBAC: Authorizing `identity:get_project(project_id=11f4e69612c946569894c24a9ab0b35a)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:32.962977 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe01c64-125a-4041-8137-c18d7a4d9042 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:32.964676 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 87/175] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:32 2022] GET /identity/v3/projects/11f4e69612c946569894c24a9ab0b35a => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:32.965525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe01c64-125a-4041-8137-c18d7a4d9042 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:32.967816 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 89/176] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:32.968906 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623736e-22c6-48bf-9871-0bf9e1d3d464 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:33.064519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:33.078795 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623736e-22c6-48bf-9871-0bf9e1d3d464 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:33.091112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe01c64-125a-4041-8137-c18d7a4d9042 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:33.095950 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:33.116943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd9af7-4e4c-4033-9c0a-c48351252ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:33.117809 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd9af7-4e4c-4033-9c0a-c48351252ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:33.118098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd9af7-4e4c-4033-9c0a-c48351252ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:33.118947 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd9af7-4e4c-4033-9c0a-c48351252ad2 None admin] PATH_INFO: `/v3/users/1a07c7c0378b48d9b37b3826e79a85c5` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:33.120142 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd9af7-4e4c-4033-9c0a-c48351252ad2 None admin] RBAC: Authorizing `identity:get_user(user_id=1a07c7c0378b48d9b37b3826e79a85c5)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:33.121601 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd9af7-4e4c-4033-9c0a-c48351252ad2 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:33.123274 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 90/177] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:32 2022] GET /identity/v3/users/1a07c7c0378b48d9b37b3826e79a85c5 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:33.124037 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd9af7-4e4c-4033-9c0a-c48351252ad2 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:33.125755 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f8c3f-f930-472b-b5c5-6768c4158952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:33.126860 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f8c3f-f930-472b-b5c5-6768c4158952 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:33.127154 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f8c3f-f930-472b-b5c5-6768c4158952 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:33.128331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f8c3f-f930-472b-b5c5-6768c4158952 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:33.139211 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f8c3f-f930-472b-b5c5-6768c4158952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:33.146836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-241f8c3f-f930-472b-b5c5-6768c4158952 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:18:33.146836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:33.146836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:33.146836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:33.146836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:33.146836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:33.146836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:33.146836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:33.146836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:33.146836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:33.146836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:33.146836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:33.146836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:33.146836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:33.146836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:33.146836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:33.147732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:33.147732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:33.147732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:33.147732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:33.147732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:33.147732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:33.147732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:33.147732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:33.147732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:33.147732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:33.147732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:33.147732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:18:33.147732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:33.147732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:33.147732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:33.147732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:33.148503 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:33.148503 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:33.148503 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:33.148503 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:33.148503 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:33.148503 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:33.148503 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:33.148503 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:33.148503 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:33.148503 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:33.148503 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:18:33.148503 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:18:33.148503 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 88/178] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:18:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:33.149395 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69121c3d-b5f9-443c-bd6b-36e631797272 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:33.149713 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69121c3d-b5f9-443c-bd6b-36e631797272 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:33.149993 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69121c3d-b5f9-443c-bd6b-36e631797272 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:33.151276 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 89/179] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:33.155243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69121c3d-b5f9-443c-bd6b-36e631797272 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:33.229587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd9af7-4e4c-4033-9c0a-c48351252ad2 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:33.254601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69121c3d-b5f9-443c-bd6b-36e631797272 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:33.263901 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff34a78-8c2f-4199-aeba-0af5deb319ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:33.264554 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff34a78-8c2f-4199-aeba-0af5deb319ef None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:33.264836 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff34a78-8c2f-4199-aeba-0af5deb319ef None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:33.265109 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff34a78-8c2f-4199-aeba-0af5deb319ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:33.289090 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa30ed-67fc-438e-ac4a-febff4e642ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:33.289735 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa30ed-67fc-438e-ac4a-febff4e642ae None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:33.290018 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa30ed-67fc-438e-ac4a-febff4e642ae None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:33.290860 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa30ed-67fc-438e-ac4a-febff4e642ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:33.291689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa30ed-67fc-438e-ac4a-febff4e642ae None admin] RBAC: Adding query filter params (role.id=3dac847973464a2cb123dc2c9083baf3, scope.project.id=11f4e69612c946569894c24a9ab0b35a, user.id=1a07c7c0378b48d9b37b3826e79a85c5) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:33.292032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa30ed-67fc-438e-ac4a-febff4e642ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:33.293485 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa30ed-67fc-438e-ac4a-febff4e642ae None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:33.295306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:33.301070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 90/180] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:18:33 2022] GET /identity/v3/role_assignments?user.id=1a07c7c0378b48d9b37b3826e79a85c5&scope.project.id=11f4e69612c946569894c24a9ab0b35a&role.id=3dac847973464a2cb123dc2c9083baf3 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:33.301770 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa30ed-67fc-438e-ac4a-febff4e642ae None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:33.322921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:33.350702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff34a78-8c2f-4199-aeba-0af5deb319ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:33.352203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff34a78-8c2f-4199-aeba-0af5deb319ef None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:33.419399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa30ed-67fc-438e-ac4a-febff4e642ae None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:33.457863 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c329f-45c4-4050-809f-68658cf552d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:33.458719 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c329f-45c4-4050-809f-68658cf552d7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:33.459006 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c329f-45c4-4050-809f-68658cf552d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:33.459289 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c329f-45c4-4050-809f-68658cf552d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:33.467643 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 91/181] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:18:33.469100 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675ee31-2955-4db0-bf0a-ba33027afecc None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:33.469400 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675ee31-2955-4db0-bf0a-ba33027afecc None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:33.469683 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675ee31-2955-4db0-bf0a-ba33027afecc None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:33.471204 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 92/182] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:33.471828 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675ee31-2955-4db0-bf0a-ba33027afecc None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:33.476998 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c329f-45c4-4050-809f-68658cf552d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:33.485582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-843c329f-45c4-4050-809f-68658cf552d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:18:33.485582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:33.485582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:33.485582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:33.485582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:33.485582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:33.485582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:33.485582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:33.485582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:33.485582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:33.485582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:33.485582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:33.485582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:33.485582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:33.485582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:33.485582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:33.486665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:33.486665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:33.486665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:33.486665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:33.486665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:33.486665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:33.486665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:33.486665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:33.486665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:33.486665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:33.486665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:33.486665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:18:33.486665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:33.486665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:33.486665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:33.486665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:33.487469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:33.487469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:33.487469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:33.487469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:33.487469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:33.487469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:33.487469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:33.487469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:33.487469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:33.487469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:33.487469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:18:33.487469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:18:33.487469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 91/183] 10.222.0.25 () {56 vars in 1114 bytes} [Mon May 23 12:18:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:33.488112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c329f-45c4-4050-809f-68658cf552d7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:33.558437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:33.582487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:33.605049 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675ee31-2955-4db0-bf0a-ba33027afecc None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:33.609162 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c329f-45c4-4050-809f-68658cf552d7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:33.638163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff275ded-27a4-4f5c-a7c0-b9b615c9b7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:33.638830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff275ded-27a4-4f5c-a7c0-b9b615c9b7ac None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:33.639114 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff275ded-27a4-4f5c-a7c0-b9b615c9b7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:33.639390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff275ded-27a4-4f5c-a7c0-b9b615c9b7ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:33.642815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6b56a-b7cf-4ba3-8108-4b8a25e006fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:33.643478 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6b56a-b7cf-4ba3-8108-4b8a25e006fc None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:33.643770 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6b56a-b7cf-4ba3-8108-4b8a25e006fc None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:33.644050 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6b56a-b7cf-4ba3-8108-4b8a25e006fc None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:33.644799 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6b56a-b7cf-4ba3-8108-4b8a25e006fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:33.645111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6b56a-b7cf-4ba3-8108-4b8a25e006fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:33.646523 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6b56a-b7cf-4ba3-8108-4b8a25e006fc None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:33.654925 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 92/184] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:33.655944 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdc4dc-cbdd-475f-8495-148ae7eac32d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:33.656237 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdc4dc-cbdd-475f-8495-148ae7eac32d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:33.656525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdc4dc-cbdd-475f-8495-148ae7eac32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:33.674006 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-5ccdc4dc-cbdd-475f-8495-148ae7eac32d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:33.675253 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5ccdc4dc-cbdd-475f-8495-148ae7eac32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:33.707299 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff275ded-27a4-4f5c-a7c0-b9b615c9b7ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:33.708884 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff275ded-27a4-4f5c-a7c0-b9b615c9b7ac None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:33.743396 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 93/185] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:33.744167 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccdc4dc-cbdd-475f-8495-148ae7eac32d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:33.794259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:33.798937 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:33.813039 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 93/186] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:18:33.814375 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8f519-f1bc-45f3-9206-ef055054fed8 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:33.814697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8f519-f1bc-45f3-9206-ef055054fed8 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:33.814976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8f519-f1bc-45f3-9206-ef055054fed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:33.830535 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-59b8f519-f1bc-45f3-9206-ef055054fed8 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:33.831717 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-59b8f519-f1bc-45f3-9206-ef055054fed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:33.850507 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccdc4dc-cbdd-475f-8495-148ae7eac32d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:33.887111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da080e2-ae53-4fed-a59a-ee9f027498ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:33.887980 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da080e2-ae53-4fed-a59a-ee9f027498ef None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:33.888262 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da080e2-ae53-4fed-a59a-ee9f027498ef None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:33.888541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da080e2-ae53-4fed-a59a-ee9f027498ef None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:33.889745 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da080e2-ae53-4fed-a59a-ee9f027498ef None admin] RBAC: Authorizing `identity:get_project(project_id=3fd6ed2a258c474293105ba1798cee00)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:33.891272 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da080e2-ae53-4fed-a59a-ee9f027498ef None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:33.892974 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 94/187] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:33 2022] GET /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:33.893743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da080e2-ae53-4fed-a59a-ee9f027498ef None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:33.909952 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 94/188] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:33.910915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8f519-f1bc-45f3-9206-ef055054fed8 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:33.994348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da080e2-ae53-4fed-a59a-ee9f027498ef None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:34.014208 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:34.019024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8f519-f1bc-45f3-9206-ef055054fed8 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:34.031235 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39a9aa-4bc9-4925-afde-74fb4f7e19a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:34.031902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39a9aa-4bc9-4925-afde-74fb4f7e19a2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:34.032185 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39a9aa-4bc9-4925-afde-74fb4f7e19a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:34.032355 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:34.032457 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39a9aa-4bc9-4925-afde-74fb4f7e19a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:34.033208 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39a9aa-4bc9-4925-afde-74fb4f7e19a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:34.033509 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39a9aa-4bc9-4925-afde-74fb4f7e19a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:34.034940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39a9aa-4bc9-4925-afde-74fb4f7e19a2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:34.043679 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 95/189] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:18:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:34.044315 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39a9aa-4bc9-4925-afde-74fb4f7e19a2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:34.059384 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f196dd1-a41f-4a35-9a30-8b18b08f23a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:34.060259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f196dd1-a41f-4a35-9a30-8b18b08f23a8 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:34.060549 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f196dd1-a41f-4a35-9a30-8b18b08f23a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:34.060832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f196dd1-a41f-4a35-9a30-8b18b08f23a8 None admin] PATH_INFO: `/v3/users/eac7967411db465986c65259f2188224` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:34.074614 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f196dd1-a41f-4a35-9a30-8b18b08f23a8 None admin] RBAC: Authorizing `identity:get_user(user_id=eac7967411db465986c65259f2188224)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:34.076082 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f196dd1-a41f-4a35-9a30-8b18b08f23a8 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:34.077894 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 95/190] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:33 2022] GET /identity/v3/users/eac7967411db465986c65259f2188224 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:34.078519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f196dd1-a41f-4a35-9a30-8b18b08f23a8 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:34.145231 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39a9aa-4bc9-4925-afde-74fb4f7e19a2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:34.178980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f196dd1-a41f-4a35-9a30-8b18b08f23a8 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:34.179264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7327f4-32e3-4125-98db-be03454cabd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:34.186037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7327f4-32e3-4125-98db-be03454cabd2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:34.186322 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7327f4-32e3-4125-98db-be03454cabd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:34.186690 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7327f4-32e3-4125-98db-be03454cabd2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:34.188199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7327f4-32e3-4125-98db-be03454cabd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:34.190016 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7327f4-32e3-4125-98db-be03454cabd2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:34.191725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 96/191] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:18:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:34.192491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7327f4-32e3-4125-98db-be03454cabd2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:34.217266 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b180aa-7cbe-4d43-b256-9f051c6221b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:34.218137 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b180aa-7cbe-4d43-b256-9f051c6221b5 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:34.218423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b180aa-7cbe-4d43-b256-9f051c6221b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:34.218742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b180aa-7cbe-4d43-b256-9f051c6221b5 None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:34.219933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b180aa-7cbe-4d43-b256-9f051c6221b5 None admin] RBAC: Authorizing `identity:get_project(project_id=3fd6ed2a258c474293105ba1798cee00)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:34.221394 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b180aa-7cbe-4d43-b256-9f051c6221b5 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:34.223125 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 96/192] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:34 2022] GET /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:34.223889 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b180aa-7cbe-4d43-b256-9f051c6221b5 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:34.251703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:34.267302 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:34.302096 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7327f4-32e3-4125-98db-be03454cabd2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:34.328551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b180aa-7cbe-4d43-b256-9f051c6221b5 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:34.335995 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bc40a-a932-429b-8a14-fed8702cb1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:34.336649 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bc40a-a932-429b-8a14-fed8702cb1be None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:34.336939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bc40a-a932-429b-8a14-fed8702cb1be None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:34.337268 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bc40a-a932-429b-8a14-fed8702cb1be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:34.338091 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2bc40a-a932-429b-8a14-fed8702cb1be None admin] RBAC: Adding query filter params (role.id=3ae7c5e54e084ac4a1f94da93a667583, scope.project.id=3fd6ed2a258c474293105ba1798cee00, user.id=38b5788f4258438a9175f55196c13413) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:34.338406 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2bc40a-a932-429b-8a14-fed8702cb1be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:34.339908 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2bc40a-a932-429b-8a14-fed8702cb1be None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:34.345582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 97/193] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:18:34 2022] GET /identity/v3/role_assignments?user.id=38b5788f4258438a9175f55196c13413&scope.project.id=3fd6ed2a258c474293105ba1798cee00&role.id=3ae7c5e54e084ac4a1f94da93a667583 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:34.346363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bc40a-a932-429b-8a14-fed8702cb1be None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:34.373261 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec793263-94aa-4e84-929e-254475ac4457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:34.374073 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec793263-94aa-4e84-929e-254475ac4457 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:34.374368 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec793263-94aa-4e84-929e-254475ac4457 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:34.374678 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec793263-94aa-4e84-929e-254475ac4457 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:34.386833 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec793263-94aa-4e84-929e-254475ac4457 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:34.394710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-ec793263-94aa-4e84-929e-254475ac4457 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:18:34.394710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:34.394710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:34.394710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:34.394710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:34.394710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:34.394710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:34.394710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:34.394710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:34.394710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:34.394710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:34.394710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:34.394710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:34.394710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:34.394710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:34.394710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:34.395696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:34.395696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:34.395696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:34.395696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:34.395696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:34.395696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:34.395696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:34.395696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:34.395696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:34.395696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:34.395696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:34.395696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:18:34.395696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:34.395696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:34.395696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:34.395696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:34.396477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:34.396477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:34.396477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:34.396477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:34.396477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:34.396477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:34.396477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:34.396477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:34.396477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:34.396477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:34.396477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:18:34.396477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:18:34.401051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 97/194] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:34.402049 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec793263-94aa-4e84-929e-254475ac4457 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:34.465905 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bc40a-a932-429b-8a14-fed8702cb1be None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:34.485551 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:34.511699 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebe20d-2c94-4540-9318-a15f163f5906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:34.512508 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebe20d-2c94-4540-9318-a15f163f5906 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:34.512794 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebe20d-2c94-4540-9318-a15f163f5906 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:34.513072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebe20d-2c94-4540-9318-a15f163f5906 None admin] PATH_INFO: `/v3/users/eac7967411db465986c65259f2188224` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:34.514361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebe20d-2c94-4540-9318-a15f163f5906 None admin] RBAC: Authorizing `identity:get_user(user_id=eac7967411db465986c65259f2188224)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:34.515972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebe20d-2c94-4540-9318-a15f163f5906 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:34.517810 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:34.522676 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 98/195] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:34 2022] GET /identity/v3/users/eac7967411db465986c65259f2188224 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:34.523486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebe20d-2c94-4540-9318-a15f163f5906 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:34.527598 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec793263-94aa-4e84-929e-254475ac4457 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:34.569974 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2d900-6e00-4827-a1fe-4c77ce9d1582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:34.570694 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2d900-6e00-4827-a1fe-4c77ce9d1582 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:34.570973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2d900-6e00-4827-a1fe-4c77ce9d1582 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:34.571247 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2d900-6e00-4827-a1fe-4c77ce9d1582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:34.639459 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebe20d-2c94-4540-9318-a15f163f5906 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:34.643074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2d900-6e00-4827-a1fe-4c77ce9d1582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:34.644545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2d900-6e00-4827-a1fe-4c77ce9d1582 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:34.674271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ade75a-8c5b-4101-bd4c-6f9e69d08a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:34.674969 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ade75a-8c5b-4101-bd4c-6f9e69d08a2c None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:34.675251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ade75a-8c5b-4101-bd4c-6f9e69d08a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:34.675527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ade75a-8c5b-4101-bd4c-6f9e69d08a2c None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:34.676235 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ade75a-8c5b-4101-bd4c-6f9e69d08a2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:34.677671 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ade75a-8c5b-4101-bd4c-6f9e69d08a2c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:34.697224 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 99/196] 10.222.0.25 () {60 vars in 1132 bytes} [Mon May 23 12:18:34 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:18:34.698040 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ade75a-8c5b-4101-bd4c-6f9e69d08a2c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:34.737924 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:34.766706 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:34.772943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 98/197] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:18:34.774215 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2d900-6e00-4827-a1fe-4c77ce9d1582 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:34.825640 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ade75a-8c5b-4101-bd4c-6f9e69d08a2c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:34.865080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96c9ed-5f56-4d6b-a45f-69ec72a3891e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:34.865754 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96c9ed-5f56-4d6b-a45f-69ec72a3891e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:34.866042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96c9ed-5f56-4d6b-a45f-69ec72a3891e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:34.866322 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96c9ed-5f56-4d6b-a45f-69ec72a3891e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:34.867215 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96c9ed-5f56-4d6b-a45f-69ec72a3891e None admin] RBAC: Adding query filter params (role.id=d9ac3d950cc243aaa45c802dd5f3d844, scope.project.id=3fd6ed2a258c474293105ba1798cee00, user.id=1a07c7c0378b48d9b37b3826e79a85c5) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:34.867530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96c9ed-5f56-4d6b-a45f-69ec72a3891e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:34.869105 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96c9ed-5f56-4d6b-a45f-69ec72a3891e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:34.875720 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 100/198] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:18:34 2022] GET /identity/v3/role_assignments?user.id=1a07c7c0378b48d9b37b3826e79a85c5&scope.project.id=3fd6ed2a258c474293105ba1798cee00&role.id=d9ac3d950cc243aaa45c802dd5f3d844 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:34.876413 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96c9ed-5f56-4d6b-a45f-69ec72a3891e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:34.901748 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2d900-6e00-4827-a1fe-4c77ce9d1582 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:34.950990 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ea74c-cd99-4ad8-bb19-9cb404d79c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:34.951849 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ea74c-cd99-4ad8-bb19-9cb404d79c82 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:34.952236 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ea74c-cd99-4ad8-bb19-9cb404d79c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:34.952613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ea74c-cd99-4ad8-bb19-9cb404d79c82 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:34.953484 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ea74c-cd99-4ad8-bb19-9cb404d79c82 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:34.953895 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ea74c-cd99-4ad8-bb19-9cb404d79c82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:34.955449 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ea74c-cd99-4ad8-bb19-9cb404d79c82 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:34.966827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 99/199] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:18:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:34.969533 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ea74c-cd99-4ad8-bb19-9cb404d79c82 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:35.006937 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:35.012326 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96c9ed-5f56-4d6b-a45f-69ec72a3891e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:35.061946 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:35.070918 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe8e79-3144-47d4-ba51-efeafe2ca6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:35.072381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe8e79-3144-47d4-ba51-efeafe2ca6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:35.072799 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe8e79-3144-47d4-ba51-efeafe2ca6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:35.073216 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe8e79-3144-47d4-ba51-efeafe2ca6b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:35.122653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ea74c-cd99-4ad8-bb19-9cb404d79c82 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:35.166342 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd6da4-2043-4470-8f4d-5c176c9b6ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:35.167273 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd6da4-2043-4470-8f4d-5c176c9b6ecd None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:35.167559 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd6da4-2043-4470-8f4d-5c176c9b6ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:35.167840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd6da4-2043-4470-8f4d-5c176c9b6ecd None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:35.168767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe8e79-3144-47d4-ba51-efeafe2ca6b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:35.169991 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd6da4-2043-4470-8f4d-5c176c9b6ecd None admin] RBAC: Authorizing `identity:get_project(project_id=087acb6a0d3945e7bc219b099d7a6037)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:35.170738 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe8e79-3144-47d4-ba51-efeafe2ca6b6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:35.171475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd6da4-2043-4470-8f4d-5c176c9b6ecd None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:35.173366 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 100/200] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:34 2022] GET /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:35.174143 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd6da4-2043-4470-8f4d-5c176c9b6ecd None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:35.292553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd6da4-2043-4470-8f4d-5c176c9b6ecd None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:35.305454 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:35.312544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 101/201] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:18:35.313843 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe8e79-3144-47d4-ba51-efeafe2ca6b6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:35.322956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:35.335433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd17e7d-ad27-4b4e-9020-4cc8b70dba5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:35.336605 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd17e7d-ad27-4b4e-9020-4cc8b70dba5b None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:35.337110 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd17e7d-ad27-4b4e-9020-4cc8b70dba5b None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:35.337824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd17e7d-ad27-4b4e-9020-4cc8b70dba5b None admin] PATH_INFO: `/v3/users/95b0bb6a2fa64ff8939d387b47a7c9ac` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:35.339643 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd17e7d-ad27-4b4e-9020-4cc8b70dba5b None admin] RBAC: Authorizing `identity:get_user(user_id=95b0bb6a2fa64ff8939d387b47a7c9ac)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:35.341287 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd17e7d-ad27-4b4e-9020-4cc8b70dba5b None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:35.343761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 101/202] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:35 2022] GET /identity/v3/users/95b0bb6a2fa64ff8939d387b47a7c9ac => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:35.345147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd17e7d-ad27-4b4e-9020-4cc8b70dba5b None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:35.427461 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe8e79-3144-47d4-ba51-efeafe2ca6b6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:35.466356 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597a647-1f55-4761-a58b-1f38370478f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:35.467233 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597a647-1f55-4761-a58b-1f38370478f3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:35.467614 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597a647-1f55-4761-a58b-1f38370478f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:35.468019 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597a647-1f55-4761-a58b-1f38370478f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:35.469011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597a647-1f55-4761-a58b-1f38370478f3 None admin] RBAC: Adding query filter params (role.id=3ae7c5e54e084ac4a1f94da93a667583, scope.project.id=087acb6a0d3945e7bc219b099d7a6037, user.id=eac7967411db465986c65259f2188224) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:35.469429 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597a647-1f55-4761-a58b-1f38370478f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:35.471023 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597a647-1f55-4761-a58b-1f38370478f3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:35.477075 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 102/203] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:18:35 2022] GET /identity/v3/role_assignments?user.id=eac7967411db465986c65259f2188224&scope.project.id=087acb6a0d3945e7bc219b099d7a6037&role.id=3ae7c5e54e084ac4a1f94da93a667583 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:35.478073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597a647-1f55-4761-a58b-1f38370478f3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:35.488646 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd17e7d-ad27-4b4e-9020-4cc8b70dba5b None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:35.530663 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd63769-2f6b-45ee-b01d-0d3905b46b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:35.531671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd63769-2f6b-45ee-b01d-0d3905b46b80 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:35.532105 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd63769-2f6b-45ee-b01d-0d3905b46b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:35.532502 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd63769-2f6b-45ee-b01d-0d3905b46b80 None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:35.533953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd63769-2f6b-45ee-b01d-0d3905b46b80 None admin] RBAC: Authorizing `identity:get_project(project_id=087acb6a0d3945e7bc219b099d7a6037)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:35.535899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd63769-2f6b-45ee-b01d-0d3905b46b80 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:35.537770 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 102/204] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:35 2022] GET /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:35.543880 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd63769-2f6b-45ee-b01d-0d3905b46b80 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:35.582202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:35.660446 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597a647-1f55-4761-a58b-1f38370478f3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:35.668186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:35.709071 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61388a-0e38-4f21-8b61-eee5be094c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:35.710119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61388a-0e38-4f21-8b61-eee5be094c3f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:35.710641 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61388a-0e38-4f21-8b61-eee5be094c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:35.711125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61388a-0e38-4f21-8b61-eee5be094c3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:35.717280 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd63769-2f6b-45ee-b01d-0d3905b46b80 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:35.765173 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08af47-a3e6-48ad-b03d-09b91dd4f3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:35.765844 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08af47-a3e6-48ad-b03d-09b91dd4f3cf None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:35.766267 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08af47-a3e6-48ad-b03d-09b91dd4f3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:35.766529 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08af47-a3e6-48ad-b03d-09b91dd4f3cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:35.767698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08af47-a3e6-48ad-b03d-09b91dd4f3cf None admin] RBAC: Adding query filter params (role.id=d9ac3d950cc243aaa45c802dd5f3d844, scope.project.id=087acb6a0d3945e7bc219b099d7a6037, user.id=eac7967411db465986c65259f2188224) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:35.767890 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08af47-a3e6-48ad-b03d-09b91dd4f3cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:35.769359 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08af47-a3e6-48ad-b03d-09b91dd4f3cf None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:35.778216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 103/205] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:18:35 2022] GET /identity/v3/role_assignments?user.id=eac7967411db465986c65259f2188224&scope.project.id=087acb6a0d3945e7bc219b099d7a6037&role.id=d9ac3d950cc243aaa45c802dd5f3d844 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:35.789242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61388a-0e38-4f21-8b61-eee5be094c3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:35.791699 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61388a-0e38-4f21-8b61-eee5be094c3f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:35.864015 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:35.907921 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 103/206] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:18:35.913645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08af47-a3e6-48ad-b03d-09b91dd4f3cf None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:36.063465 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08af47-a3e6-48ad-b03d-09b91dd4f3cf None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:36.099018 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:36.103997 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764a9b5-922b-4a72-b74f-bf21c0800d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:36.104878 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764a9b5-922b-4a72-b74f-bf21c0800d76 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:36.105164 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764a9b5-922b-4a72-b74f-bf21c0800d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:36.105441 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764a9b5-922b-4a72-b74f-bf21c0800d76 None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:36.106762 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764a9b5-922b-4a72-b74f-bf21c0800d76 None admin] RBAC: Authorizing `identity:get_project(project_id=3fd6ed2a258c474293105ba1798cee00)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:36.108240 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764a9b5-922b-4a72-b74f-bf21c0800d76 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:36.110199 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 104/207] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:35 2022] GET /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:36.119659 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61388a-0e38-4f21-8b61-eee5be094c3f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:36.228345 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61388a-0e38-4f21-8b61-eee5be094c3f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:36.266356 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb9d42-04ee-4d65-9752-4b1a2ffa8915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:36.267070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb9d42-04ee-4d65-9752-4b1a2ffa8915 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:36.267522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb9d42-04ee-4d65-9752-4b1a2ffa8915 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:36.267802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb9d42-04ee-4d65-9752-4b1a2ffa8915 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:36.268671 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb9d42-04ee-4d65-9752-4b1a2ffa8915 None admin] RBAC: Adding query filter params (role.id=ee2f590e932841609deb8ed245e89ef4, scope.project.id=3fd6ed2a258c474293105ba1798cee00, user.id=95b0bb6a2fa64ff8939d387b47a7c9ac) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:36.268984 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb9d42-04ee-4d65-9752-4b1a2ffa8915 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:36.270673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb9d42-04ee-4d65-9752-4b1a2ffa8915 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:36.278091 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 104/208] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:18:36 2022] GET /identity/v3/role_assignments?user.id=95b0bb6a2fa64ff8939d387b47a7c9ac&scope.project.id=3fd6ed2a258c474293105ba1798cee00&role.id=ee2f590e932841609deb8ed245e89ef4 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:37.363517 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82eab5-4e9b-43a1-826d-6bcef422b944 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:37.364058 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82eab5-4e9b-43a1-826d-6bcef422b944 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:37.364058 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82eab5-4e9b-43a1-826d-6bcef422b944 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:37.365576 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 105/209] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:37.371319 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d725769-001e-47ae-a92a-1bec59cd7f4f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:37.372162 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d725769-001e-47ae-a92a-1bec59cd7f4f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:37.372638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d725769-001e-47ae-a92a-1bec59cd7f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:37.390364 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3d725769-001e-47ae-a92a-1bec59cd7f4f None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:37.391853 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3d725769-001e-47ae-a92a-1bec59cd7f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:37.415529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:37.465278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17a4a6-61b5-4f65-9468-b6548d480e04 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:37.465443 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 105/210] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:18:37.465972 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17a4a6-61b5-4f65-9468-b6548d480e04 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:37.466486 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17a4a6-61b5-4f65-9468-b6548d480e04 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:37.468080 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 106/211] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:18:37.473328 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281af2b2-d949-458c-ba18-c06b4a932e64 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:37.473625 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281af2b2-d949-458c-ba18-c06b4a932e64 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:37.473907 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281af2b2-d949-458c-ba18-c06b4a932e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:37.490748 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-281af2b2-d949-458c-ba18-c06b4a932e64 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:37.492008 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-281af2b2-d949-458c-ba18-c06b4a932e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:37.493713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17a4a6-61b5-4f65-9468-b6548d480e04 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:37.562252 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 106/212] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:37.586190 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281af2b2-d949-458c-ba18-c06b4a932e64 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:37.612361 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17a4a6-61b5-4f65-9468-b6548d480e04 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:37.651729 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd0cef-7977-4879-bb36-50b43d09b2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:37.652951 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd0cef-7977-4879-bb36-50b43d09b2bf None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:37.653437 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd0cef-7977-4879-bb36-50b43d09b2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:37.653919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd0cef-7977-4879-bb36-50b43d09b2bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:37.655432 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd0cef-7977-4879-bb36-50b43d09b2bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:37.657163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd0cef-7977-4879-bb36-50b43d09b2bf None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:37.659251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 107/213] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:18:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:37.664640 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd0cef-7977-4879-bb36-50b43d09b2bf None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:37.692892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:37.708169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281af2b2-d949-458c-ba18-c06b4a932e64 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:37.738431 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:37.754309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d4013-4ee0-45ff-950f-1b391e5716b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:37.755476 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d4013-4ee0-45ff-950f-1b391e5716b3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:37.756328 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d4013-4ee0-45ff-950f-1b391e5716b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:37.756815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d4013-4ee0-45ff-950f-1b391e5716b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:37.770538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d4013-4ee0-45ff-950f-1b391e5716b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:37.780915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd0cef-7977-4879-bb36-50b43d09b2bf None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:37.781613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-570d4013-4ee0-45ff-950f-1b391e5716b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:37.781613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:37.781613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:37.781613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:37.781613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:37.781613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:37.781613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:37.781613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:37.781613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:37.781613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:37.781613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:37.781613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:37.781613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:37.781613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:37.781613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:37.781613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:37.782468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:37.782468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:37.782468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:37.782468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:37.782468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:37.782468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:37.782468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:37.782468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:37.782468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:37.782468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:37.782468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:37.782468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:18:37.782468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:37.782468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:37.782468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:37.782468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:37.783266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:37.783266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:37.783266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:37.783266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:37.783266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:37.783266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:37.783266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:37.783266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:37.783266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:37.783266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:37.783266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:37.783266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:18:37.783849 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 107/214] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:18:37.789464 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d4013-4ee0-45ff-950f-1b391e5716b3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:37.828879 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6273af-99e8-40cd-a968-7863d89d710c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:37.829905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6273af-99e8-40cd-a968-7863d89d710c None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:37.830394 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6273af-99e8-40cd-a968-7863d89d710c None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:37.830929 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6273af-99e8-40cd-a968-7863d89d710c None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:37.831874 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6273af-99e8-40cd-a968-7863d89d710c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:37.833958 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6273af-99e8-40cd-a968-7863d89d710c None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:37.864067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 108/215] 10.222.0.25 () {60 vars in 1132 bytes} [Mon May 23 12:18:37 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:18:37.918759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d4013-4ee0-45ff-950f-1b391e5716b3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:37.964565 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f808afd-c268-4bca-9312-37622d54ccfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:37.965746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f808afd-c268-4bca-9312-37622d54ccfb None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:37.966248 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f808afd-c268-4bca-9312-37622d54ccfb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:37.966762 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f808afd-c268-4bca-9312-37622d54ccfb None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:37.967749 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f808afd-c268-4bca-9312-37622d54ccfb None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:37.968271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f808afd-c268-4bca-9312-37622d54ccfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:37.970004 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f808afd-c268-4bca-9312-37622d54ccfb None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:37.980926 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 108/216] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:18:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:37.987725 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6273af-99e8-40cd-a968-7863d89d710c None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:38.101061 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6273af-99e8-40cd-a968-7863d89d710c None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:38.122459 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0c05c-a9a7-40bf-8022-3fc59c00566a None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:38.123975 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0c05c-a9a7-40bf-8022-3fc59c00566a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:38.123975 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0c05c-a9a7-40bf-8022-3fc59c00566a None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:38.125855 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 109/217] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:38.128062 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:38.135277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e072ff-0089-449f-870e-68261c7d23f3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:38.135640 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e072ff-0089-449f-870e-68261c7d23f3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:38.136118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e072ff-0089-449f-870e-68261c7d23f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:38.153673 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7a8c2-b891-41b8-ab55-d39ef94d2aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:38.154617 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7a8c2-b891-41b8-ab55-d39ef94d2aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:38.154913 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7a8c2-b891-41b8-ab55-d39ef94d2aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:38.155196 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7a8c2-b891-41b8-ab55-d39ef94d2aa7 None admin] PATH_INFO: `/v3/users/39f3a4f8d1ad4751a4d8f5f94f10ef76` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:38.157518 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c2e072ff-0089-449f-870e-68261c7d23f3 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:38.158972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c2e072ff-0089-449f-870e-68261c7d23f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:38.168473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:38.174397 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7a8c2-b891-41b8-ab55-d39ef94d2aa7 None admin] RBAC: Authorizing `identity:get_user(user_id=39f3a4f8d1ad4751a4d8f5f94f10ef76)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:38.176718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7a8c2-b891-41b8-ab55-d39ef94d2aa7 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:38.179041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 109/218] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:37 2022] GET /identity/v3/users/39f3a4f8d1ad4751a4d8f5f94f10ef76 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:38.184054 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7a8c2-b891-41b8-ab55-d39ef94d2aa7 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:38.255426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 110/219] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:38.279637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e072ff-0089-449f-870e-68261c7d23f3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:38.317297 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7a8c2-b891-41b8-ab55-d39ef94d2aa7 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:38.356407 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1e109-3841-470a-8d55-aba873d85d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:38.356407 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1e109-3841-470a-8d55-aba873d85d15 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:38.356702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1e109-3841-470a-8d55-aba873d85d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:38.356984 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1e109-3841-470a-8d55-aba873d85d15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:38.406272 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e072ff-0089-449f-870e-68261c7d23f3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:38.410415 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:38.445600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1e109-3841-470a-8d55-aba873d85d15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:38.448383 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1e109-3841-470a-8d55-aba873d85d15 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:38.456359 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438fcb4-7e9c-4615-887c-19410fb31114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:38.457161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438fcb4-7e9c-4615-887c-19410fb31114 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:38.457444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438fcb4-7e9c-4615-887c-19410fb31114 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:38.457723 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438fcb4-7e9c-4615-887c-19410fb31114 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:38.466643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:38.469939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438fcb4-7e9c-4615-887c-19410fb31114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:38.478607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-0438fcb4-7e9c-4615-887c-19410fb31114 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:18:38.478607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:38.478607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:38.478607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:38.478607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:38.478607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:38.478607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:38.478607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:38.478607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:38.478607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:38.478607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:38.478607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:38.478607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:38.478607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:38.478607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:38.478607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:38.479510 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:38.479510 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:38.479510 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:38.479510 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:38.479510 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:38.479510 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:38.479510 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:38.479510 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:38.479510 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:38.479510 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:38.479510 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:38.479510 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:18:38.479510 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:38.479510 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:38.479510 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:38.479510 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:38.480298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:38.480298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:38.480298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:38.480298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:38.480298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:38.480298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:38.480298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:38.480298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:38.480298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:38.480298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:38.480298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:18:38.480298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:18:38.484994 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 111/220] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:18:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:18:38.486559 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8489d8-8eb2-4d5d-b734-b9a4d5fa448f None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:38.486929 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8489d8-8eb2-4d5d-b734-b9a4d5fa448f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:38.487283 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8489d8-8eb2-4d5d-b734-b9a4d5fa448f None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:38.488768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 112/221] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:38.489867 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8489d8-8eb2-4d5d-b734-b9a4d5fa448f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:38.574103 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 110/222] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 12:18:38.575505 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87e760-2a29-45de-92ce-5f056edbf1fc None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:38.575894 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87e760-2a29-45de-92ce-5f056edbf1fc None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:38.576241 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87e760-2a29-45de-92ce-5f056edbf1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:38.598915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-0f87e760-2a29-45de-92ce-5f056edbf1fc None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:38.600181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-0f87e760-2a29-45de-92ce-5f056edbf1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:38.616854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8489d8-8eb2-4d5d-b734-b9a4d5fa448f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:38.663376 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118550d6-6dae-4191-b68f-69c6657a68a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:38.664477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118550d6-6dae-4191-b68f-69c6657a68a3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:38.664823 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118550d6-6dae-4191-b68f-69c6657a68a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:38.665652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118550d6-6dae-4191-b68f-69c6657a68a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:38.666423 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118550d6-6dae-4191-b68f-69c6657a68a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:38.666886 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118550d6-6dae-4191-b68f-69c6657a68a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:38.668824 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118550d6-6dae-4191-b68f-69c6657a68a3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:38.681447 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 113/223] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:38.683815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 111/224] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:38.687617 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118550d6-6dae-4191-b68f-69c6657a68a3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:38.689218 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87e760-2a29-45de-92ce-5f056edbf1fc None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:38.707745 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:38.777682 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:38.810222 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87e760-2a29-45de-92ce-5f056edbf1fc None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:38.829999 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118550d6-6dae-4191-b68f-69c6657a68a3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:38.858691 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b998fbb-212f-4044-bec4-a2df13c86709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:38.860579 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b998fbb-212f-4044-bec4-a2df13c86709 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:38.860937 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b998fbb-212f-4044-bec4-a2df13c86709 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:38.861551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b998fbb-212f-4044-bec4-a2df13c86709 None admin] PATH_INFO: `/v3/users/eac7967411db465986c65259f2188224` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:38.863612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b998fbb-212f-4044-bec4-a2df13c86709 None admin] RBAC: Authorizing `identity:get_user(user_id=eac7967411db465986c65259f2188224)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:38.865150 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b998fbb-212f-4044-bec4-a2df13c86709 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:38.871957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 112/225] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:38 2022] GET /identity/v3/users/eac7967411db465986c65259f2188224 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:38.871957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b998fbb-212f-4044-bec4-a2df13c86709 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:38.872414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984bdc3-75ff-4bd4-91fa-5fa09d2f3e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:38.873519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984bdc3-75ff-4bd4-91fa-5fa09d2f3e75 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:38.873953 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984bdc3-75ff-4bd4-91fa-5fa09d2f3e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:38.874373 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984bdc3-75ff-4bd4-91fa-5fa09d2f3e75 None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:38.876251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984bdc3-75ff-4bd4-91fa-5fa09d2f3e75 None admin] RBAC: Authorizing `identity:get_project(project_id=087acb6a0d3945e7bc219b099d7a6037)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:38.877884 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984bdc3-75ff-4bd4-91fa-5fa09d2f3e75 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:38.879820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 114/226] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:38 2022] GET /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:38.880932 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984bdc3-75ff-4bd4-91fa-5fa09d2f3e75 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:38.974870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:38.990357 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984bdc3-75ff-4bd4-91fa-5fa09d2f3e75 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:39.009875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b998fbb-212f-4044-bec4-a2df13c86709 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:39.031077 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:39.041013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc353a-26fc-49e8-9694-fc524b9e0d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:39.042474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc353a-26fc-49e8-9694-fc524b9e0d7c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:39.043239 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc353a-26fc-49e8-9694-fc524b9e0d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:39.044125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc353a-26fc-49e8-9694-fc524b9e0d7c None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:39.045904 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc353a-26fc-49e8-9694-fc524b9e0d7c None admin] RBAC: Authorizing `identity:get_project(project_id=087acb6a0d3945e7bc219b099d7a6037)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:39.047776 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc353a-26fc-49e8-9694-fc524b9e0d7c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:39.048706 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb8e3e-3e46-487a-adb8-fc64ce081c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:39.049614 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb8e3e-3e46-487a-adb8-fc64ce081c6e None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:39.050005 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 115/227] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:38 2022] GET /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:39.050941 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc353a-26fc-49e8-9694-fc524b9e0d7c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:39.055376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb8e3e-3e46-487a-adb8-fc64ce081c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:39.055376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb8e3e-3e46-487a-adb8-fc64ce081c6e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:39.067224 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb8e3e-3e46-487a-adb8-fc64ce081c6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:39.075785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-d6fb8e3e-3e46-487a-adb8-fc64ce081c6e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:18:39.075785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:39.075785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:39.075785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:39.075785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:39.075785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:39.075785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:39.075785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:39.075785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:39.075785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:39.075785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:39.075785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:39.075785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:39.075785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:39.075785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:39.075785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:39.076840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:39.076840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:39.076840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:39.076840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:39.076840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:39.076840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:39.076840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:39.076840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:39.076840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:39.076840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:39.076840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:39.076840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:18:39.076840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:39.076840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:39.076840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:39.076840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:39.077814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:39.077814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:39.077814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:39.077814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:39.077814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:39.077814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:39.077814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:39.077814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:39.077814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:39.077814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:39.077814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:18:39.077814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:18:39.079830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 113/228] 10.222.0.25 () {56 vars in 1114 bytes} [Mon May 23 12:18:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:39.084560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb8e3e-3e46-487a-adb8-fc64ce081c6e None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:39.175397 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc353a-26fc-49e8-9694-fc524b9e0d7c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:39.215271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a42160-7659-4af7-9b5f-7036d124eb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:39.215836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a42160-7659-4af7-9b5f-7036d124eb66 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:39.216221 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a42160-7659-4af7-9b5f-7036d124eb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:39.216620 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a42160-7659-4af7-9b5f-7036d124eb66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:39.217537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a42160-7659-4af7-9b5f-7036d124eb66 None admin] RBAC: Adding query filter params (role.id=3dac847973464a2cb123dc2c9083baf3, scope.project.id=087acb6a0d3945e7bc219b099d7a6037, user.id=39f3a4f8d1ad4751a4d8f5f94f10ef76) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:39.217970 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a42160-7659-4af7-9b5f-7036d124eb66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:39.219562 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a42160-7659-4af7-9b5f-7036d124eb66 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:39.222908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb8e3e-3e46-487a-adb8-fc64ce081c6e None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:39.225638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 116/229] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:18:39 2022] GET /identity/v3/role_assignments?user.id=39f3a4f8d1ad4751a4d8f5f94f10ef76&scope.project.id=087acb6a0d3945e7bc219b099d7a6037&role.id=3dac847973464a2cb123dc2c9083baf3 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:39.226771 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a42160-7659-4af7-9b5f-7036d124eb66 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:39.265020 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf883e-e6c6-4d83-b540-e2fc2e873a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:39.266228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf883e-e6c6-4d83-b540-e2fc2e873a55 None admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:39.266677 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf883e-e6c6-4d83-b540-e2fc2e873a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:39.267084 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf883e-e6c6-4d83-b540-e2fc2e873a55 None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037/users/eac7967411db465986c65259f2188224/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:39.269816 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf883e-e6c6-4d83-b540-e2fc2e873a55 None admin] RBAC: Authorizing `identity:create_grant(project_id=087acb6a0d3945e7bc219b099d7a6037, user_id=eac7967411db465986c65259f2188224, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:39.271570 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf883e-e6c6-4d83-b540-e2fc2e873a55 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:39.284342 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:39.302640 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 114/230] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:18:39 2022] PUT /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037/users/eac7967411db465986c65259f2188224/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:18:39.323014 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:39.392200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a42160-7659-4af7-9b5f-7036d124eb66 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:39.438385 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427d29a-e5e2-48d7-addd-6b012893cdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:39.439911 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427d29a-e5e2-48d7-addd-6b012893cdcd None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:39.440405 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427d29a-e5e2-48d7-addd-6b012893cdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:39.440885 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427d29a-e5e2-48d7-addd-6b012893cdcd None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:39.441936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427d29a-e5e2-48d7-addd-6b012893cdcd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:39.442455 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427d29a-e5e2-48d7-addd-6b012893cdcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:39.444161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427d29a-e5e2-48d7-addd-6b012893cdcd None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:39.453946 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 117/231] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:18:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:39.459912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf883e-e6c6-4d83-b540-e2fc2e873a55 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:39.606198 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf883e-e6c6-4d83-b540-e2fc2e873a55 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:39.641073 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53800a-9299-4f78-8a4a-c00adff74f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:39.642133 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53800a-9299-4f78-8a4a-c00adff74f3d None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:39.642413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53800a-9299-4f78-8a4a-c00adff74f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:39.642720 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53800a-9299-4f78-8a4a-c00adff74f3d None admin] PATH_INFO: `/v3/users/eac7967411db465986c65259f2188224` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:39.643920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53800a-9299-4f78-8a4a-c00adff74f3d None admin] RBAC: Authorizing `identity:get_user(user_id=eac7967411db465986c65259f2188224)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:39.645388 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53800a-9299-4f78-8a4a-c00adff74f3d None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:39.647427 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 115/232] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:39 2022] GET /identity/v3/users/eac7967411db465986c65259f2188224 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:39.652819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427d29a-e5e2-48d7-addd-6b012893cdcd None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:39.797338 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427d29a-e5e2-48d7-addd-6b012893cdcd None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:39.833192 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:39.846898 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503d44e-9fa7-4374-be96-dd5a2604cc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:39.848070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503d44e-9fa7-4374-be96-dd5a2604cc6e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:39.848535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503d44e-9fa7-4374-be96-dd5a2604cc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:39.849140 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503d44e-9fa7-4374-be96-dd5a2604cc6e None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:39.851249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503d44e-9fa7-4374-be96-dd5a2604cc6e None admin] RBAC: Authorizing `identity:get_project(project_id=087acb6a0d3945e7bc219b099d7a6037)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:39.853462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503d44e-9fa7-4374-be96-dd5a2604cc6e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:39.855788 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 118/233] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:39 2022] GET /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:39.861275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53800a-9299-4f78-8a4a-c00adff74f3d None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:39.964849 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:40.018863 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53800a-9299-4f78-8a4a-c00adff74f3d None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:40.067369 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c3996-dd1e-4e27-889a-22b1f23795fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:40.068181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c3996-dd1e-4e27-889a-22b1f23795fd None admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:40.068471 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c3996-dd1e-4e27-889a-22b1f23795fd None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:40.068752 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c3996-dd1e-4e27-889a-22b1f23795fd None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037/users/eac7967411db465986c65259f2188224/roles/d9ac3d950cc243aaa45c802dd5f3d844` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:40.076382 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c3996-dd1e-4e27-889a-22b1f23795fd None admin] RBAC: Authorizing `identity:create_grant(project_id=087acb6a0d3945e7bc219b099d7a6037, user_id=eac7967411db465986c65259f2188224, role_id=d9ac3d950cc243aaa45c802dd5f3d844)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:40.077867 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c3996-dd1e-4e27-889a-22b1f23795fd None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:40.095052 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 116/234] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:18:39 2022] PUT /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037/users/eac7967411db465986c65259f2188224/roles/d9ac3d950cc243aaa45c802dd5f3d844 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:18:40.488846 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98a95d-caa2-4eee-bd47-ec8f7b41e626 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:40.489358 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98a95d-caa2-4eee-bd47-ec8f7b41e626 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:40.489476 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98a95d-caa2-4eee-bd47-ec8f7b41e626 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:40.490853 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 119/235] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:40.496614 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192cd19-53e2-45b2-9f6d-fe949adb5334 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:40.497031 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192cd19-53e2-45b2-9f6d-fe949adb5334 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:40.497202 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192cd19-53e2-45b2-9f6d-fe949adb5334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:40.514902 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-a192cd19-53e2-45b2-9f6d-fe949adb5334 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:40.516093 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-a192cd19-53e2-45b2-9f6d-fe949adb5334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:40.606670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179d0d4-bec9-49e6-8c10-c70aa74b04b5 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:40.607013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179d0d4-bec9-49e6-8c10-c70aa74b04b5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:40.607252 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179d0d4-bec9-49e6-8c10-c70aa74b04b5 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:40.608765 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 120/236] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:40.611022 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 117/237] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:40.614435 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041dd41-2f98-411e-9743-b00e2f0b6ef0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:40.614761 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041dd41-2f98-411e-9743-b00e2f0b6ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:40.615046 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041dd41-2f98-411e-9743-b00e2f0b6ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:40.634405 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2041dd41-2f98-411e-9743-b00e2f0b6ef0 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:40.635655 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2041dd41-2f98-411e-9743-b00e2f0b6ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:40.646993 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192cd19-53e2-45b2-9f6d-fe949adb5334 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:40.705881 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 121/238] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:18:40.735301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041dd41-2f98-411e-9743-b00e2f0b6ef0 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:40.772955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:40.869616 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192cd19-53e2-45b2-9f6d-fe949adb5334 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:40.871255 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041dd41-2f98-411e-9743-b00e2f0b6ef0 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:40.894640 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:40.920327 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb963e-1242-46d6-b1da-6966d0a77134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:40.921219 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df296d-e0a3-43df-8048-61e14dfa62a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:40.922273 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb963e-1242-46d6-b1da-6966d0a77134 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:40.923238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb963e-1242-46d6-b1da-6966d0a77134 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:40.923813 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df296d-e0a3-43df-8048-61e14dfa62a1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:40.924371 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb963e-1242-46d6-b1da-6966d0a77134 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:40.924837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df296d-e0a3-43df-8048-61e14dfa62a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:40.925788 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df296d-e0a3-43df-8048-61e14dfa62a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:40.928261 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df296d-e0a3-43df-8048-61e14dfa62a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:40.931625 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df296d-e0a3-43df-8048-61e14dfa62a1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:40.937557 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 122/239] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:18:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:40.942213 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df296d-e0a3-43df-8048-61e14dfa62a1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:40.942924 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb963e-1242-46d6-b1da-6966d0a77134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:40.951179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-3ceb963e-1242-46d6-b1da-6966d0a77134 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:18:40.951179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:40.951179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:40.951179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:40.951179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:40.951179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:40.951179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:40.951179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:40.951179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:40.951179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:40.951179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:40.951179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:40.951179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:40.951179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:40.951179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:40.951179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:40.952033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:40.952033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:40.952033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:40.952033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:40.952033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:40.952033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:40.952033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:40.952033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:40.952033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:40.952033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:40.952033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:40.952033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:18:40.952033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:40.952033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:40.952033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:40.952033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:40.952795 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:40.952795 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:40.952795 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:40.952795 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:40.952795 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:40.952795 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:40.952795 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:40.952795 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:40.952795 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:40.952795 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:40.952795 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:18:40.952795 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:18:40.955232 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 118/240] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:18:40.962681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb963e-1242-46d6-b1da-6966d0a77134 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:41.106159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb963e-1242-46d6-b1da-6966d0a77134 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:41.123555 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:41.160886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49d6eb-a157-4f84-a0fc-490269b17a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:41.161571 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49d6eb-a157-4f84-a0fc-490269b17a5b None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:41.161860 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49d6eb-a157-4f84-a0fc-490269b17a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:41.162143 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49d6eb-a157-4f84-a0fc-490269b17a5b None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:41.162933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49d6eb-a157-4f84-a0fc-490269b17a5b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:41.163248 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49d6eb-a157-4f84-a0fc-490269b17a5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:41.164661 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49d6eb-a157-4f84-a0fc-490269b17a5b None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:41.179611 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df296d-e0a3-43df-8048-61e14dfa62a1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:41.190869 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 119/241] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:18:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:41.196165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49d6eb-a157-4f84-a0fc-490269b17a5b None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:41.249121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7aff7-af51-43c8-8171-134d1e5725ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:41.249798 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7aff7-af51-43c8-8171-134d1e5725ba None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:41.250087 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7aff7-af51-43c8-8171-134d1e5725ba None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:41.250367 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7aff7-af51-43c8-8171-134d1e5725ba None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:41.251111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7aff7-af51-43c8-8171-134d1e5725ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:41.252580 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7aff7-af51-43c8-8171-134d1e5725ba None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:41.291426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 123/242] 10.222.0.25 () {60 vars in 1132 bytes} [Mon May 23 12:18:40 2022] POST /identity/v3/users => generated 293 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:18:41.364498 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49d6eb-a157-4f84-a0fc-490269b17a5b None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:41.413257 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198134a8-997a-4753-96ae-56d7d8fc4ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:41.414146 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198134a8-997a-4753-96ae-56d7d8fc4ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:41.414434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198134a8-997a-4753-96ae-56d7d8fc4ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:41.414766 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198134a8-997a-4753-96ae-56d7d8fc4ed1 None admin] PATH_INFO: `/v3/users/278b26c1e6f843f994b8f0002bab7bc5` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:41.437350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198134a8-997a-4753-96ae-56d7d8fc4ed1 None admin] RBAC: Authorizing `identity:get_user(user_id=278b26c1e6f843f994b8f0002bab7bc5)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:41.438883 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198134a8-997a-4753-96ae-56d7d8fc4ed1 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:41.440850 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 120/243] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:41 2022] GET /identity/v3/users/278b26c1e6f843f994b8f0002bab7bc5 => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:41.446917 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7aff7-af51-43c8-8171-134d1e5725ba None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:41.499620 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:41.559434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7aff7-af51-43c8-8171-134d1e5725ba None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:41.595918 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c9d11-7323-400e-a4ef-ffcb6ffc0fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:41.596585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c9d11-7323-400e-a4ef-ffcb6ffc0fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:41.596875 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c9d11-7323-400e-a4ef-ffcb6ffc0fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:41.597158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c9d11-7323-400e-a4ef-ffcb6ffc0fa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:41.673089 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c9d11-7323-400e-a4ef-ffcb6ffc0fa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:41.676271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c9d11-7323-400e-a4ef-ffcb6ffc0fa6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:41.723823 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:41.787466 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 124/244] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:18:41.793256 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198134a8-997a-4753-96ae-56d7d8fc4ed1 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:41.829844 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:41.899028 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198134a8-997a-4753-96ae-56d7d8fc4ed1 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:41.939541 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c84ada-75d0-46c0-85fa-a8ac85c6528e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:41.940620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c84ada-75d0-46c0-85fa-a8ac85c6528e None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:41.941060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c84ada-75d0-46c0-85fa-a8ac85c6528e None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:41.941473 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c84ada-75d0-46c0-85fa-a8ac85c6528e None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:41.942827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c84ada-75d0-46c0-85fa-a8ac85c6528e None admin] RBAC: Authorizing `identity:get_project(project_id=087acb6a0d3945e7bc219b099d7a6037)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:41.944437 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c84ada-75d0-46c0-85fa-a8ac85c6528e None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:41.946719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 121/245] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:41 2022] GET /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:41.952613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c9d11-7323-400e-a4ef-ffcb6ffc0fa6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:41.971955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8953b-f085-46f6-ad92-20c94ccde637 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:41.972251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8953b-f085-46f6-ad92-20c94ccde637 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:41.972535 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8953b-f085-46f6-ad92-20c94ccde637 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:41.974056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 122/246] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:18:41.980596 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92343c9a-5e37-4d98-9c1f-cca8db3b0b29 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:41.980867 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92343c9a-5e37-4d98-9c1f-cca8db3b0b29 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:41.981168 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92343c9a-5e37-4d98-9c1f-cca8db3b0b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:42.008534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-92343c9a-5e37-4d98-9c1f-cca8db3b0b29 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:42.010067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-92343c9a-5e37-4d98-9c1f-cca8db3b0b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:42.068632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c9d11-7323-400e-a4ef-ffcb6ffc0fa6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:42.104695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 123/247] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:18:42.119016 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4893571-d48c-41ec-901d-ac4af64fc174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:42.120017 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4893571-d48c-41ec-901d-ac4af64fc174 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:42.120469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4893571-d48c-41ec-901d-ac4af64fc174 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:42.120911 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4893571-d48c-41ec-901d-ac4af64fc174 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:42.121958 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4893571-d48c-41ec-901d-ac4af64fc174 None admin] RBAC: Adding query filter params (role.id=ee2f590e932841609deb8ed245e89ef4, scope.project.id=087acb6a0d3945e7bc219b099d7a6037, user.id=278b26c1e6f843f994b8f0002bab7bc5) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:42.122493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4893571-d48c-41ec-901d-ac4af64fc174 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:42.124326 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4893571-d48c-41ec-901d-ac4af64fc174 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:42.132701 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 125/248] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:18:41 2022] GET /identity/v3/role_assignments?user.id=278b26c1e6f843f994b8f0002bab7bc5&scope.project.id=087acb6a0d3945e7bc219b099d7a6037&role.id=ee2f590e932841609deb8ed245e89ef4 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:42.146615 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92343c9a-5e37-4d98-9c1f-cca8db3b0b29 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:42.185394 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:42.272900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92343c9a-5e37-4d98-9c1f-cca8db3b0b29 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:42.314495 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98945edd-6609-4515-b651-e8ff9f2a9114 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:42.314834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98945edd-6609-4515-b651-e8ff9f2a9114 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:42.315128 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98945edd-6609-4515-b651-e8ff9f2a9114 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:42.316667 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 126/249] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:42.316787 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88a242-40ab-4eb1-90e0-ba51b7b9673c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:42.317488 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88a242-40ab-4eb1-90e0-ba51b7b9673c None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:42.317776 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88a242-40ab-4eb1-90e0-ba51b7b9673c None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:42.318059 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88a242-40ab-4eb1-90e0-ba51b7b9673c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:42.324025 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6939b-e16f-4afc-a8da-22af8ef533e2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:42.324666 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6939b-e16f-4afc-a8da-22af8ef533e2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:42.325146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6939b-e16f-4afc-a8da-22af8ef533e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:42.332566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88a242-40ab-4eb1-90e0-ba51b7b9673c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:42.340502 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-cf88a242-40ab-4eb1-90e0-ba51b7b9673c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:42.340502 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:42.340502 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:42.340502 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:42.340502 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:42.340502 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:42.340502 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:42.340502 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:42.340502 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:42.340502 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:42.340502 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:42.340502 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:42.340502 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:42.340502 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:42.340502 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:42.340502 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:42.341539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:42.341539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:42.341539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:42.341539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:42.341539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:42.341539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:42.341539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:42.341539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:42.341539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:42.341539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:42.341539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:42.341539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:18:42.341539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:42.341539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:42.341539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:42.341539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:42.342318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:42.342318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:42.342318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:42.342318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:42.342318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:42.342318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:42.342318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:42.342318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:42.342318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:42.342318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:42.342318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:42.342318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:18:42.342318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 124/250] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:42.347777 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88a242-40ab-4eb1-90e0-ba51b7b9673c None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:42.351926 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-45d6939b-e16f-4afc-a8da-22af8ef533e2 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:42.354005 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-45d6939b-e16f-4afc-a8da-22af8ef533e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:42.367300 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:42.467948 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 127/251] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:18:42.504256 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:42.511646 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88a242-40ab-4eb1-90e0-ba51b7b9673c None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:42.528754 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6939b-e16f-4afc-a8da-22af8ef533e2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:42.589016 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ad6f7-4eac-4059-8cbf-84bf1567747d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:42.590054 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ad6f7-4eac-4059-8cbf-84bf1567747d None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:42.590593 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ad6f7-4eac-4059-8cbf-84bf1567747d None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:42.591090 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ad6f7-4eac-4059-8cbf-84bf1567747d None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:42.592053 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ad6f7-4eac-4059-8cbf-84bf1567747d None admin] RBAC: Adding query filter params (name=member) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:42.592563 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ad6f7-4eac-4059-8cbf-84bf1567747d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:42.594250 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ad6f7-4eac-4059-8cbf-84bf1567747d None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:42.613605 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 125/252] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:18:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:42.621970 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ad6f7-4eac-4059-8cbf-84bf1567747d None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:42.707118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6939b-e16f-4afc-a8da-22af8ef533e2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:42.782782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ad6f7-4eac-4059-8cbf-84bf1567747d None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:42.785583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de9f31-82ff-4642-8f0c-144aa92ced2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:42.786809 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de9f31-82ff-4642-8f0c-144aa92ced2e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:42.787321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de9f31-82ff-4642-8f0c-144aa92ced2e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:42.787803 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de9f31-82ff-4642-8f0c-144aa92ced2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:42.808237 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:42.819079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de9f31-82ff-4642-8f0c-144aa92ced2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:42.834555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-46de9f31-82ff-4642-8f0c-144aa92ced2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:18:42.834555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:42.834555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:42.834555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:42.834555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:42.834555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:42.834555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:42.834555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:42.834555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:42.834555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:42.834555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:42.834555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:42.834555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:42.834555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:42.834555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:42.834555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:42.835498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:42.835498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:42.835498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:42.835498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:42.835498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:42.835498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:42.835498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:42.835498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:42.835498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:42.835498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:42.835498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:42.835498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:18:42.835498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:42.835498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:42.835498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:42.835498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:42.836297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:42.836297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:42.836297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:42.836297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:42.836297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:42.836297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:42.836297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:42.836297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:42.836297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:42.836297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:42.836297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:18:42.836297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:18:42.839493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 128/253] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:18:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:18:42.848938 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de9f31-82ff-4642-8f0c-144aa92ced2e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:42.853451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456f1e3-267e-4914-be97-a9268e3331ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:42.854397 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456f1e3-267e-4914-be97-a9268e3331ae None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:42.854710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456f1e3-267e-4914-be97-a9268e3331ae None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:42.855009 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456f1e3-267e-4914-be97-a9268e3331ae None admin] PATH_INFO: `/v3/users/39f3a4f8d1ad4751a4d8f5f94f10ef76` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:42.856262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456f1e3-267e-4914-be97-a9268e3331ae None admin] RBAC: Authorizing `identity:get_user(user_id=39f3a4f8d1ad4751a4d8f5f94f10ef76)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:42.857961 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456f1e3-267e-4914-be97-a9268e3331ae None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:42.868225 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 126/254] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:42 2022] GET /identity/v3/users/39f3a4f8d1ad4751a4d8f5f94f10ef76 => generated 297 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:42.873461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456f1e3-267e-4914-be97-a9268e3331ae None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:42.911750 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:43.070189 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de9f31-82ff-4642-8f0c-144aa92ced2e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:43.082619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456f1e3-267e-4914-be97-a9268e3331ae None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:43.136603 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81c99e-dbbc-44d6-bbb4-cc1332785042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:43.138098 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81c99e-dbbc-44d6-bbb4-cc1332785042 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:43.138707 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81c99e-dbbc-44d6-bbb4-cc1332785042 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:43.139587 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81c99e-dbbc-44d6-bbb4-cc1332785042 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:43.140837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81c99e-dbbc-44d6-bbb4-cc1332785042 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:43.141769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81c99e-dbbc-44d6-bbb4-cc1332785042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:43.143824 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81c99e-dbbc-44d6-bbb4-cc1332785042 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:43.145893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae082739-0b48-4124-964c-d1fcfee78a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:43.146965 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae082739-0b48-4124-964c-d1fcfee78a95 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:43.147410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae082739-0b48-4124-964c-d1fcfee78a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:43.147826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae082739-0b48-4124-964c-d1fcfee78a95 None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:43.151126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae082739-0b48-4124-964c-d1fcfee78a95 None admin] RBAC: Authorizing `identity:get_project(project_id=087acb6a0d3945e7bc219b099d7a6037)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:43.152751 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae082739-0b48-4124-964c-d1fcfee78a95 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:43.154635 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 127/255] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:42 2022] GET /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037 => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:43.156976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a9e70-f717-4f3a-aad6-9c7c6e2f7a6c None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:43.159577 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a9e70-f717-4f3a-aad6-9c7c6e2f7a6c None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:43.160791 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a9e70-f717-4f3a-aad6-9c7c6e2f7a6c None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:43.162271 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 128/256] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:43.164410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a9e70-f717-4f3a-aad6-9c7c6e2f7a6c None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:43.166945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 129/257] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:43.170667 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf9c98-8f2a-4770-b6e4-f323d0aaf21a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:43.171297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf9c98-8f2a-4770-b6e4-f323d0aaf21a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:43.171738 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf9c98-8f2a-4770-b6e4-f323d0aaf21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:43.191639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-fbaf9c98-8f2a-4770-b6e4-f323d0aaf21a None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:43.193047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fbaf9c98-8f2a-4770-b6e4-f323d0aaf21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:43.303419 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:43.307906 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 130/258] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:43.309033 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf9c98-8f2a-4770-b6e4-f323d0aaf21a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:43.357363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:43.375383 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a9e70-f717-4f3a-aad6-9c7c6e2f7a6c None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:43.438272 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04f37b-a749-4f08-80fe-61ddddfeee5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:43.439237 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04f37b-a749-4f08-80fe-61ddddfeee5e None admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:43.439570 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04f37b-a749-4f08-80fe-61ddddfeee5e None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:43.439850 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04f37b-a749-4f08-80fe-61ddddfeee5e None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037/users/39f3a4f8d1ad4751a4d8f5f94f10ef76/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:43.443178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04f37b-a749-4f08-80fe-61ddddfeee5e None admin] RBAC: Authorizing `identity:create_grant(project_id=087acb6a0d3945e7bc219b099d7a6037, user_id=39f3a4f8d1ad4751a4d8f5f94f10ef76, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:43.444632 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04f37b-a749-4f08-80fe-61ddddfeee5e None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:43.469381 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 129/259] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:18:43 2022] PUT /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037/users/39f3a4f8d1ad4751a4d8f5f94f10ef76/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:18:43.470171 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04f37b-a749-4f08-80fe-61ddddfeee5e None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:43.505731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf9c98-8f2a-4770-b6e4-f323d0aaf21a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:43.578365 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca05e0-468d-4cb7-a508-92b19ebfe0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:43.579278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca05e0-468d-4cb7-a508-92b19ebfe0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:43.579561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca05e0-468d-4cb7-a508-92b19ebfe0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:43.579836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca05e0-468d-4cb7-a508-92b19ebfe0d4 None admin] PATH_INFO: `/v3/users/eac7967411db465986c65259f2188224` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:43.581233 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca05e0-468d-4cb7-a508-92b19ebfe0d4 None admin] RBAC: Authorizing `identity:get_user(user_id=eac7967411db465986c65259f2188224)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:43.584135 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca05e0-468d-4cb7-a508-92b19ebfe0d4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:43.586817 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 131/260] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:43 2022] GET /identity/v3/users/eac7967411db465986c65259f2188224 => generated 283 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:43.592112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca05e0-468d-4cb7-a508-92b19ebfe0d4 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:43.639594 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04f37b-a749-4f08-80fe-61ddddfeee5e None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:43.707212 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff48e3-fe4a-40f6-9839-920f4b6a691d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:43.708044 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff48e3-fe4a-40f6-9839-920f4b6a691d None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:43.708333 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff48e3-fe4a-40f6-9839-920f4b6a691d None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:43.708618 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff48e3-fe4a-40f6-9839-920f4b6a691d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:43.731010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff48e3-fe4a-40f6-9839-920f4b6a691d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:43.742643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:43.744866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-2aff48e3-fe4a-40f6-9839-920f4b6a691d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:18:43.744866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:43.744866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:43.744866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:43.744866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:43.744866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:43.744866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:43.744866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:43.744866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:43.744866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:43.744866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:43.744866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:43.744866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:43.744866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:43.744866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:43.744866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:43.745756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:43.745756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:43.745756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:43.745756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:43.745756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:43.745756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:43.745756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:43.745756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:43.745756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:43.745756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:43.745756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:43.745756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:18:43.745756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:43.745756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:43.745756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:43.745756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:43.746560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:43.746560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:43.746560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:43.746560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:43.746560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:43.746560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:43.746560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:43.746560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:43.746560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:43.746560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:43.746560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:18:43.746560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:18:43.747671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 130/261] 10.222.0.25 () {56 vars in 1114 bytes} [Mon May 23 12:18:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:43.751968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff48e3-fe4a-40f6-9839-920f4b6a691d None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:43.779607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:43.850483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca05e0-468d-4cb7-a508-92b19ebfe0d4 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:43.920744 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998a2a2-b25e-462d-beab-f12ea2af08d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:43.921328 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998a2a2-b25e-462d-beab-f12ea2af08d7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:43.921617 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998a2a2-b25e-462d-beab-f12ea2af08d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:43.921895 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998a2a2-b25e-462d-beab-f12ea2af08d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:43.965692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff48e3-fe4a-40f6-9839-920f4b6a691d None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:44.031493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081a127-f3dd-4b14-9037-f4e36bdef3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:44.032173 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081a127-f3dd-4b14-9037-f4e36bdef3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:44.032461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081a127-f3dd-4b14-9037-f4e36bdef3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:44.032741 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081a127-f3dd-4b14-9037-f4e36bdef3f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:44.034653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081a127-f3dd-4b14-9037-f4e36bdef3f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:44.034970 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081a127-f3dd-4b14-9037-f4e36bdef3f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:44.036378 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081a127-f3dd-4b14-9037-f4e36bdef3f1 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:44.049078 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998a2a2-b25e-462d-beab-f12ea2af08d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:44.050609 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998a2a2-b25e-462d-beab-f12ea2af08d7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:44.055338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 131/262] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:18:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:44.060451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081a127-f3dd-4b14-9037-f4e36bdef3f1 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:44.158848 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:44.179447 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:44.236279 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 132/263] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:18:44.240093 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081a127-f3dd-4b14-9037-f4e36bdef3f1 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:44.242160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998a2a2-b25e-462d-beab-f12ea2af08d7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:44.312904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a5e62-2be1-4cd7-9b73-7350dc5eae13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:44.314190 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a5e62-2be1-4cd7-9b73-7350dc5eae13 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:44.314713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a5e62-2be1-4cd7-9b73-7350dc5eae13 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:44.315281 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a5e62-2be1-4cd7-9b73-7350dc5eae13 None admin] PATH_INFO: `/v3/users/eac7967411db465986c65259f2188224` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:44.319235 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a5e62-2be1-4cd7-9b73-7350dc5eae13 None admin] RBAC: Authorizing `identity:get_user(user_id=eac7967411db465986c65259f2188224)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:44.321598 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a5e62-2be1-4cd7-9b73-7350dc5eae13 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:44.323845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 132/264] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:44 2022] GET /identity/v3/users/eac7967411db465986c65259f2188224 => generated 283 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:44.340048 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a5e62-2be1-4cd7-9b73-7350dc5eae13 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:44.375520 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998a2a2-b25e-462d-beab-f12ea2af08d7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:44.421375 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f8a51-b61c-4926-a2d2-3e54b00b8f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:44.422616 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f8a51-b61c-4926-a2d2-3e54b00b8f32 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:44.423152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f8a51-b61c-4926-a2d2-3e54b00b8f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:44.423573 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f8a51-b61c-4926-a2d2-3e54b00b8f32 None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:44.427493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f8a51-b61c-4926-a2d2-3e54b00b8f32 None admin] RBAC: Authorizing `identity:get_project(project_id=087acb6a0d3945e7bc219b099d7a6037)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:44.429228 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f8a51-b61c-4926-a2d2-3e54b00b8f32 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:44.432164 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 133/265] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:44 2022] GET /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:44.437429 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f8a51-b61c-4926-a2d2-3e54b00b8f32 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:44.480788 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a5e62-2be1-4cd7-9b73-7350dc5eae13 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:44.486926 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:44.519325 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c727d-e030-4b37-a151-36a37c0ce6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:44.520447 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c727d-e030-4b37-a151-36a37c0ce6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:44.521024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c727d-e030-4b37-a151-36a37c0ce6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:44.521508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c727d-e030-4b37-a151-36a37c0ce6d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:44.533657 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:44.630147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f8a51-b61c-4926-a2d2-3e54b00b8f32 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:44.643300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c727d-e030-4b37-a151-36a37c0ce6d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:44.644797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c727d-e030-4b37-a151-36a37c0ce6d9 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:44.716087 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44a8c5-14e1-4953-ab7f-b990aa6bd8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:44.717092 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44a8c5-14e1-4953-ab7f-b990aa6bd8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:44.717683 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44a8c5-14e1-4953-ab7f-b990aa6bd8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:44.718185 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44a8c5-14e1-4953-ab7f-b990aa6bd8f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:44.719329 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44a8c5-14e1-4953-ab7f-b990aa6bd8f8 None admin] RBAC: Adding query filter params (role.id=3ae7c5e54e084ac4a1f94da93a667583, scope.project.id=087acb6a0d3945e7bc219b099d7a6037, user.id=eac7967411db465986c65259f2188224) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:44.719847 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44a8c5-14e1-4953-ab7f-b990aa6bd8f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:44.721627 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44a8c5-14e1-4953-ab7f-b990aa6bd8f8 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:44.736652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 134/266] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:18:44 2022] GET /identity/v3/role_assignments?user.id=eac7967411db465986c65259f2188224&scope.project.id=087acb6a0d3945e7bc219b099d7a6037&role.id=3ae7c5e54e084ac4a1f94da93a667583 => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:44.761650 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 133/267] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 12:18:44.767781 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44a8c5-14e1-4953-ab7f-b990aa6bd8f8 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:44.885461 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:44.900200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44a8c5-14e1-4953-ab7f-b990aa6bd8f8 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:44.942544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f2321-e56d-4220-a26d-66a000ea3677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:44.943779 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f2321-e56d-4220-a26d-66a000ea3677 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:44.944296 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f2321-e56d-4220-a26d-66a000ea3677 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:44.944882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f2321-e56d-4220-a26d-66a000ea3677 None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:44.951755 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f2321-e56d-4220-a26d-66a000ea3677 None admin] RBAC: Authorizing `identity:get_project(project_id=087acb6a0d3945e7bc219b099d7a6037)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:44.954604 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f2321-e56d-4220-a26d-66a000ea3677 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:44.957923 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 135/268] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:44 2022] GET /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:44.967510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c727d-e030-4b37-a151-36a37c0ce6d9 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:45.029505 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:45.091642 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c727d-e030-4b37-a151-36a37c0ce6d9 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:45.131772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30769c34-2f9e-479a-9673-689c75cae598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:45.132453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30769c34-2f9e-479a-9673-689c75cae598 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:45.132739 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30769c34-2f9e-479a-9673-689c75cae598 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:45.133017 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30769c34-2f9e-479a-9673-689c75cae598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:45.133929 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30769c34-2f9e-479a-9673-689c75cae598 None admin] RBAC: Adding query filter params (role.id=d9ac3d950cc243aaa45c802dd5f3d844, scope.project.id=087acb6a0d3945e7bc219b099d7a6037, user.id=eac7967411db465986c65259f2188224) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:45.134248 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30769c34-2f9e-479a-9673-689c75cae598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:45.135816 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30769c34-2f9e-479a-9673-689c75cae598 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:45.142972 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 134/269] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:18:44 2022] GET /identity/v3/role_assignments?user.id=eac7967411db465986c65259f2188224&scope.project.id=087acb6a0d3945e7bc219b099d7a6037&role.id=d9ac3d950cc243aaa45c802dd5f3d844 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:45.363732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b869fd9-5696-44e2-b95c-c0e2348912a8 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:45.364420 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b869fd9-5696-44e2-b95c-c0e2348912a8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:45.364910 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b869fd9-5696-44e2-b95c-c0e2348912a8 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:45.366494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 136/270] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:45.372468 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6090c07-cdae-4387-966a-16d8d447171f None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:45.372764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6090c07-cdae-4387-966a-16d8d447171f None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:45.373046 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6090c07-cdae-4387-966a-16d8d447171f None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:45.374166 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dd93c-80c2-4972-9ca9-b54540cce826 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:45.374560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 135/271] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:45.374681 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dd93c-80c2-4972-9ca9-b54540cce826 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:45.375048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dd93c-80c2-4972-9ca9-b54540cce826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:45.380135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ae2a8-9824-47be-85e8-ba70c4695f71 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:45.380644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ae2a8-9824-47be-85e8-ba70c4695f71 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:45.381124 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ae2a8-9824-47be-85e8-ba70c4695f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:45.396966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-716dd93c-80c2-4972-9ca9-b54540cce826 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:45.398200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-716dd93c-80c2-4972-9ca9-b54540cce826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:45.412136 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-962ae2a8-9824-47be-85e8-ba70c4695f71 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:45.414425 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-962ae2a8-9824-47be-85e8-ba70c4695f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:45.488463 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 137/272] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:45.501490 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 136/273] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:18:45.515178 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dd93c-80c2-4972-9ca9-b54540cce826 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:45.523540 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1081a-2970-4456-9849-53e3e5de5aaf None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:45.523832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1081a-2970-4456-9849-53e3e5de5aaf None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:45.525182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1081a-2970-4456-9849-53e3e5de5aaf None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:45.526216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 137/274] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:18:45.531747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6db58-e315-42e3-8d2c-6a13ea815950 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:45.532092 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6db58-e315-42e3-8d2c-6a13ea815950 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:45.532371 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6db58-e315-42e3-8d2c-6a13ea815950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:45.551743 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-7bb6db58-e315-42e3-8d2c-6a13ea815950 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:45.553163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-7bb6db58-e315-42e3-8d2c-6a13ea815950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:45.585883 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:45.615174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:45.626442 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dd93c-80c2-4972-9ca9-b54540cce826 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:45.634258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 138/275] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:45.635243 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6db58-e315-42e3-8d2c-6a13ea815950 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:45.664799 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3b04b-a8e3-4a9f-a9d5-2f42a71b7086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:45.665600 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3b04b-a8e3-4a9f-a9d5-2f42a71b7086 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:45.665888 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3b04b-a8e3-4a9f-a9d5-2f42a71b7086 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:45.666165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3b04b-a8e3-4a9f-a9d5-2f42a71b7086 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:45.676702 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3b04b-a8e3-4a9f-a9d5-2f42a71b7086 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:45.684601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-8df3b04b-a8e3-4a9f-a9d5-2f42a71b7086 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:45.684601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:45.684601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:45.684601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:45.684601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:45.684601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:45.684601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:45.684601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:45.684601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:45.684601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:45.684601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:45.684601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:45.684601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:45.684601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:45.684601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:45.684601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:45.685593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:45.685593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:45.685593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:45.685593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:45.685593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:45.685593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:45.685593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:45.685593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:45.685593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:45.685593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:45.685593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:45.685593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:18:45.685593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:45.685593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:45.685593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:45.685593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:45.686546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:45.686546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:45.686546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:45.686546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:45.686546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:45.686546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:45.686546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:45.686546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:45.686546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:45.686546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:45.686546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:45.686546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:18:45.688556 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 138/276] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:45.694031 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3b04b-a8e3-4a9f-a9d5-2f42a71b7086 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:45.749448 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6db58-e315-42e3-8d2c-6a13ea815950 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:45.784453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d1016-72dd-4086-abcf-939e1ba16192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:45.785272 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d1016-72dd-4086-abcf-939e1ba16192 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:45.785558 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d1016-72dd-4086-abcf-939e1ba16192 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:45.785832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d1016-72dd-4086-abcf-939e1ba16192 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:45.787012 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d1016-72dd-4086-abcf-939e1ba16192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:45.788484 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d1016-72dd-4086-abcf-939e1ba16192 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:45.790432 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 139/277] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:18:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:45.791240 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d1016-72dd-4086-abcf-939e1ba16192 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:45.807854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3b04b-a8e3-4a9f-a9d5-2f42a71b7086 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:45.831377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:45.841149 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92034e-a7de-4a6a-8dc1-a24ca22d8a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:45.841975 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92034e-a7de-4a6a-8dc1-a24ca22d8a50 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:45.842265 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92034e-a7de-4a6a-8dc1-a24ca22d8a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:45.842560 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92034e-a7de-4a6a-8dc1-a24ca22d8a50 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:45.853227 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92034e-a7de-4a6a-8dc1-a24ca22d8a50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:45.861119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-fb92034e-a7de-4a6a-8dc1-a24ca22d8a50 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:18:45.861119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:45.861119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:45.861119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:45.861119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:45.861119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:45.861119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:45.861119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:45.861119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:45.861119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:45.861119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:45.861119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:45.861119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:45.861119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:45.861119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:45.861119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:45.862280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:45.862280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:45.862280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:45.862280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:45.862280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:45.862280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:45.862280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:45.862280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:45.862280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:45.862280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:45.862280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:45.862280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:18:45.862280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:45.862280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:45.862280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:45.862280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:45.863095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:45.863095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:45.863095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:45.863095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:45.863095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:45.863095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:45.863095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:45.863095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:45.863095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:45.863095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:45.863095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:18:45.863095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:18:45.863095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 139/278] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:45.863095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92034e-a7de-4a6a-8dc1-a24ca22d8a50 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:45.877579 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:45.914398 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d1016-72dd-4086-abcf-939e1ba16192 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:45.952638 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdef80-0ce1-43af-9bd6-ad1de45952eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:45.953775 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdef80-0ce1-43af-9bd6-ad1de45952eb None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:45.954464 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdef80-0ce1-43af-9bd6-ad1de45952eb None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:45.954921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdef80-0ce1-43af-9bd6-ad1de45952eb None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:45.955809 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdef80-0ce1-43af-9bd6-ad1de45952eb None admin] RBAC: Adding query filter params (name=member) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:45.956280 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdef80-0ce1-43af-9bd6-ad1de45952eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:45.958583 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdef80-0ce1-43af-9bd6-ad1de45952eb None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:45.968763 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92034e-a7de-4a6a-8dc1-a24ca22d8a50 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:45.970236 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 140/279] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:18:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:45.971618 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdef80-0ce1-43af-9bd6-ad1de45952eb None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:46.010207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ade11-aaa4-4ac6-a1fa-8f2af54dac55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:46.010901 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ade11-aaa4-4ac6-a1fa-8f2af54dac55 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:46.011186 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ade11-aaa4-4ac6-a1fa-8f2af54dac55 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:46.011456 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ade11-aaa4-4ac6-a1fa-8f2af54dac55 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:46.012154 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ade11-aaa4-4ac6-a1fa-8f2af54dac55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:46.013615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ade11-aaa4-4ac6-a1fa-8f2af54dac55 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:46.046533 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 140/280] 10.222.0.25 () {60 vars in 1132 bytes} [Mon May 23 12:18:45 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:18:46.046533 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ade11-aaa4-4ac6-a1fa-8f2af54dac55 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:46.098983 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:46.109384 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdef80-0ce1-43af-9bd6-ad1de45952eb None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:46.148727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:46.152476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71513eea-e936-49c6-b4b7-c8aa6174e990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:46.155014 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71513eea-e936-49c6-b4b7-c8aa6174e990 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:46.155613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71513eea-e936-49c6-b4b7-c8aa6174e990 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:46.156147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71513eea-e936-49c6-b4b7-c8aa6174e990 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:46.157239 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71513eea-e936-49c6-b4b7-c8aa6174e990 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:46.157820 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71513eea-e936-49c6-b4b7-c8aa6174e990 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:46.159642 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71513eea-e936-49c6-b4b7-c8aa6174e990 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:46.176537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 141/281] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:18:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:46.178392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71513eea-e936-49c6-b4b7-c8aa6174e990 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:46.191882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ade11-aaa4-4ac6-a1fa-8f2af54dac55 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:46.245153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb82fee-37f8-4891-a638-d0645a3532e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:46.245153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb82fee-37f8-4891-a638-d0645a3532e3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:46.245153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb82fee-37f8-4891-a638-d0645a3532e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:46.245153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb82fee-37f8-4891-a638-d0645a3532e3 None admin] PATH_INFO: `/v3/users/5bd977ce46b5406ebe8147e2b70da7c5` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:46.261554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb82fee-37f8-4891-a638-d0645a3532e3 None admin] RBAC: Authorizing `identity:get_user(user_id=5bd977ce46b5406ebe8147e2b70da7c5)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:46.263089 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb82fee-37f8-4891-a638-d0645a3532e3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:46.264922 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 141/282] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:46 2022] GET /identity/v3/users/5bd977ce46b5406ebe8147e2b70da7c5 => generated 293 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:46.270434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb82fee-37f8-4891-a638-d0645a3532e3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:46.307211 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71513eea-e936-49c6-b4b7-c8aa6174e990 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:46.356296 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88162fbc-d28c-4927-9c0b-c9c258471dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:46.357683 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88162fbc-d28c-4927-9c0b-c9c258471dfc None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:46.357975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88162fbc-d28c-4927-9c0b-c9c258471dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:46.358465 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88162fbc-d28c-4927-9c0b-c9c258471dfc None admin] PATH_INFO: `/v3/users/278b26c1e6f843f994b8f0002bab7bc5` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:46.359922 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88162fbc-d28c-4927-9c0b-c9c258471dfc None admin] RBAC: Authorizing `identity:get_user(user_id=278b26c1e6f843f994b8f0002bab7bc5)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:46.361401 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88162fbc-d28c-4927-9c0b-c9c258471dfc None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:46.363241 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 142/283] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:46 2022] GET /identity/v3/users/278b26c1e6f843f994b8f0002bab7bc5 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:46.370420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88162fbc-d28c-4927-9c0b-c9c258471dfc None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:46.400171 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:46.414445 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb82fee-37f8-4891-a638-d0645a3532e3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:46.449480 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:46.469807 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee8ad1-69cf-4ac5-9fa7-b7e0fa198d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:46.470953 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee8ad1-69cf-4ac5-9fa7-b7e0fa198d34 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:46.471773 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee8ad1-69cf-4ac5-9fa7-b7e0fa198d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:46.472373 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee8ad1-69cf-4ac5-9fa7-b7e0fa198d34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:46.473477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee8ad1-69cf-4ac5-9fa7-b7e0fa198d34 None admin] RBAC: Adding query filter params (role.id=3dac847973464a2cb123dc2c9083baf3, user.id=5bd977ce46b5406ebe8147e2b70da7c5, scope.system=all) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:46.474134 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee8ad1-69cf-4ac5-9fa7-b7e0fa198d34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:46.476088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee8ad1-69cf-4ac5-9fa7-b7e0fa198d34 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:46.484759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 142/284] 10.222.0.25 () {56 vars in 1308 bytes} [Mon May 23 12:18:46 2022] GET /identity/v3/role_assignments?user.id=5bd977ce46b5406ebe8147e2b70da7c5&scope.system=all&role.id=3dac847973464a2cb123dc2c9083baf3 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:46.498159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88162fbc-d28c-4927-9c0b-c9c258471dfc None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:46.537834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a46136-0a35-4b93-bbe8-d7df5c75c104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:46.538748 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a46136-0a35-4b93-bbe8-d7df5c75c104 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:46.539035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a46136-0a35-4b93-bbe8-d7df5c75c104 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:46.539317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a46136-0a35-4b93-bbe8-d7df5c75c104 None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:46.540605 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a46136-0a35-4b93-bbe8-d7df5c75c104 None admin] RBAC: Authorizing `identity:get_project(project_id=087acb6a0d3945e7bc219b099d7a6037)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:46.542174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a46136-0a35-4b93-bbe8-d7df5c75c104 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:46.544782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 143/285] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:46 2022] GET /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:46.550911 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee8ad1-69cf-4ac5-9fa7-b7e0fa198d34 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:46.624944 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8827e-ba31-487f-a3b9-0f52a4c49224 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:46.625267 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8827e-ba31-487f-a3b9-0f52a4c49224 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:46.625512 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8827e-ba31-487f-a3b9-0f52a4c49224 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:46.627240 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 144/286] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:18:46.638778 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff24ae-363b-4e9b-805f-b16f8f3a7ddd None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:46.638971 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff24ae-363b-4e9b-805f-b16f8f3a7ddd None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:46.639249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff24ae-363b-4e9b-805f-b16f8f3a7ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:46.671790 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-5aff24ae-363b-4e9b-805f-b16f8f3a7ddd None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:46.672990 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-5aff24ae-363b-4e9b-805f-b16f8f3a7ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:46.704190 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee8ad1-69cf-4ac5-9fa7-b7e0fa198d34 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:46.749035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da102f-1de4-4979-86b4-7c488f50bd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:46.749932 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da102f-1de4-4979-86b4-7c488f50bd95 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:46.750217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da102f-1de4-4979-86b4-7c488f50bd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:46.750490 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da102f-1de4-4979-86b4-7c488f50bd95 None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037/users/278b26c1e6f843f994b8f0002bab7bc5/roles/ee2f590e932841609deb8ed245e89ef4` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:46.753165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da102f-1de4-4979-86b4-7c488f50bd95 None admin] RBAC: Authorizing `identity:create_grant(project_id=087acb6a0d3945e7bc219b099d7a6037, user_id=278b26c1e6f843f994b8f0002bab7bc5, role_id=ee2f590e932841609deb8ed245e89ef4)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:46.754688 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da102f-1de4-4979-86b4-7c488f50bd95 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:46.771369 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 143/287] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:18:46 2022] PUT /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037/users/278b26c1e6f843f994b8f0002bab7bc5/roles/ee2f590e932841609deb8ed245e89ef4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:18:46.783220 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 145/288] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:18:46.807818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da102f-1de4-4979-86b4-7c488f50bd95 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:46.865213 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:46.924322 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da102f-1de4-4979-86b4-7c488f50bd95 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:46.962418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f8d88-791d-432b-aea8-bad419c4507d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:46.963269 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f8d88-791d-432b-aea8-bad419c4507d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:46.963552 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f8d88-791d-432b-aea8-bad419c4507d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:46.963825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f8d88-791d-432b-aea8-bad419c4507d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:46.975341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f8d88-791d-432b-aea8-bad419c4507d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:46.983161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-914f8d88-791d-432b-aea8-bad419c4507d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:46.983161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:46.983161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:46.983161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:46.983161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:46.983161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:46.983161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:46.983161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:46.983161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:46.983161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:46.983161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:46.983161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:46.983161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:46.983161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:46.983161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:46.983161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:46.984299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:46.984299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:46.984299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:46.984299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:46.984299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:46.984299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:46.984299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:46.984299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:46.984299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:46.984299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:46.984299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:46.984299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:18:46.984299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:46.984299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:46.984299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:46.984299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:46.985069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:46.985069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:46.985069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:46.985069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:46.985069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:46.985069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:46.985069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:46.985069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:46.985069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:46.985069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:46.985069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:46.985069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:18:46.985069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 144/289] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:46.990970 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff24ae-363b-4e9b-805f-b16f8f3a7ddd None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:47.017525 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:47.098380 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff24ae-363b-4e9b-805f-b16f8f3a7ddd None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:47.135587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f0c99-a092-406c-8547-9e08966a481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:47.136514 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f0c99-a092-406c-8547-9e08966a481b None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:47.136802 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f0c99-a092-406c-8547-9e08966a481b None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:47.137078 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f0c99-a092-406c-8547-9e08966a481b None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:47.137828 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f0c99-a092-406c-8547-9e08966a481b None admin] RBAC: Adding query filter params (name=member) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:47.138137 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f0c99-a092-406c-8547-9e08966a481b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:47.139549 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f0c99-a092-406c-8547-9e08966a481b None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:47.148622 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 146/290] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:18:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:47.154023 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f8d88-791d-432b-aea8-bad419c4507d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:47.260240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f8d88-791d-432b-aea8-bad419c4507d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:47.269560 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:47.295588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0abe17-7dcb-42ac-bdfb-0d3da0a74b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:47.296468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0abe17-7dcb-42ac-bdfb-0d3da0a74b7e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:47.296755 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0abe17-7dcb-42ac-bdfb-0d3da0a74b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:47.297032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0abe17-7dcb-42ac-bdfb-0d3da0a74b7e None admin] PATH_INFO: `/v3/users/39f3a4f8d1ad4751a4d8f5f94f10ef76` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:47.298241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0abe17-7dcb-42ac-bdfb-0d3da0a74b7e None admin] RBAC: Authorizing `identity:get_user(user_id=39f3a4f8d1ad4751a4d8f5f94f10ef76)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:47.299743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0abe17-7dcb-42ac-bdfb-0d3da0a74b7e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:47.301538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 145/291] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:47 2022] GET /identity/v3/users/39f3a4f8d1ad4751a4d8f5f94f10ef76 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:47.307382 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f0c99-a092-406c-8547-9e08966a481b None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:47.396888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:47.413491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f0c99-a092-406c-8547-9e08966a481b None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:47.452276 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b34575-fc24-43a6-b079-4fefc7c23fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:47.452849 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b34575-fc24-43a6-b079-4fefc7c23fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:47.453136 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b34575-fc24-43a6-b079-4fefc7c23fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:47.453413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b34575-fc24-43a6-b079-4fefc7c23fc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:47.523130 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b34575-fc24-43a6-b079-4fefc7c23fc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:47.524640 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b34575-fc24-43a6-b079-4fefc7c23fc4 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:47.613988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:47.626375 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 147/292] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:18:47.632022 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0abe17-7dcb-42ac-bdfb-0d3da0a74b7e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:47.734803 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0abe17-7dcb-42ac-bdfb-0d3da0a74b7e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:47.770036 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8e00d-4fd3-46a0-86dc-9d4cee6d5b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:47.770936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8e00d-4fd3-46a0-86dc-9d4cee6d5b7a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:47.771224 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8e00d-4fd3-46a0-86dc-9d4cee6d5b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:47.771501 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8e00d-4fd3-46a0-86dc-9d4cee6d5b7a None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:47.772697 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8e00d-4fd3-46a0-86dc-9d4cee6d5b7a None admin] RBAC: Authorizing `identity:get_project(project_id=087acb6a0d3945e7bc219b099d7a6037)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:47.774231 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8e00d-4fd3-46a0-86dc-9d4cee6d5b7a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:47.776331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 146/293] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:47 2022] GET /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:47.782043 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b34575-fc24-43a6-b079-4fefc7c23fc4 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:47.895486 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b34575-fc24-43a6-b079-4fefc7c23fc4 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:47.938701 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc539e-801f-40c7-89a8-14639bebe7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:47.939408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc539e-801f-40c7-89a8-14639bebe7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:47.939696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc539e-801f-40c7-89a8-14639bebe7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:47.939974 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc539e-801f-40c7-89a8-14639bebe7e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:47.940808 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc539e-801f-40c7-89a8-14639bebe7e4 None admin] RBAC: Adding query filter params (role.id=3dac847973464a2cb123dc2c9083baf3, scope.project.id=087acb6a0d3945e7bc219b099d7a6037, user.id=39f3a4f8d1ad4751a4d8f5f94f10ef76) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:47.941126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc539e-801f-40c7-89a8-14639bebe7e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:47.942621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc539e-801f-40c7-89a8-14639bebe7e4 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:47.949210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 148/294] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:18:47 2022] GET /identity/v3/role_assignments?user.id=39f3a4f8d1ad4751a4d8f5f94f10ef76&scope.project.id=087acb6a0d3945e7bc219b099d7a6037&role.id=3dac847973464a2cb123dc2c9083baf3 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:49.032109 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34020c5c-c5ea-4384-a6a9-c5a853815f41 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:49.033131 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34020c5c-c5ea-4384-a6a9-c5a853815f41 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:49.033618 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34020c5c-c5ea-4384-a6a9-c5a853815f41 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:49.035521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 147/295] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:49.041767 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666e17f-69ab-4f23-971d-e8fb85116a50 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:49.042666 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666e17f-69ab-4f23-971d-e8fb85116a50 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:49.043163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666e17f-69ab-4f23-971d-e8fb85116a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:49.054348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbf0f5-cc7b-41b8-81df-8e150e905b5f None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:49.054674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbf0f5-cc7b-41b8-81df-8e150e905b5f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:49.055104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbf0f5-cc7b-41b8-81df-8e150e905b5f None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:49.057120 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 148/296] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:49.063241 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-3666e17f-69ab-4f23-971d-e8fb85116a50 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:49.064227 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87041ef-3d91-44d2-ab4b-88533658aadb None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:49.064442 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-3666e17f-69ab-4f23-971d-e8fb85116a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:49.064918 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87041ef-3d91-44d2-ab4b-88533658aadb None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:49.065393 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87041ef-3d91-44d2-ab4b-88533658aadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:49.083429 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-e87041ef-3d91-44d2-ab4b-88533658aadb None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:49.085153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e87041ef-3d91-44d2-ab4b-88533658aadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:49.119346 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:49.133058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:49.147306 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 149/297] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:49.147306 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498cbda-b276-41d3-91ff-9837f43f111c None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:49.147306 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498cbda-b276-41d3-91ff-9837f43f111c None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:49.147306 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498cbda-b276-41d3-91ff-9837f43f111c None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:49.147306 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 150/298] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:49.156179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be7c09-d246-4bc7-ac52-a4ca0447babe None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:49.156473 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be7c09-d246-4bc7-ac52-a4ca0447babe None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:49.156757 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be7c09-d246-4bc7-ac52-a4ca0447babe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:49.173045 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-72be7c09-d246-4bc7-ac52-a4ca0447babe None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:49.174230 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-72be7c09-d246-4bc7-ac52-a4ca0447babe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:49.174655 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 149/299] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:18:49.175853 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87041ef-3d91-44d2-ab4b-88533658aadb None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:49.256071 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 151/300] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:18:49.257280 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be7c09-d246-4bc7-ac52-a4ca0447babe None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:49.291512 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87041ef-3d91-44d2-ab4b-88533658aadb None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:49.328045 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fd052-edf1-4734-8d48-ab3001830458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:49.328738 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fd052-edf1-4734-8d48-ab3001830458 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:49.329021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fd052-edf1-4734-8d48-ab3001830458 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:49.329299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fd052-edf1-4734-8d48-ab3001830458 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:49.330492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fd052-edf1-4734-8d48-ab3001830458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:49.332224 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fd052-edf1-4734-8d48-ab3001830458 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:49.334102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 150/301] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:18:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:49.334774 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fd052-edf1-4734-8d48-ab3001830458 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:49.386632 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be7c09-d246-4bc7-ac52-a4ca0447babe None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:49.389881 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:49.396267 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:49.423704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23618a-4c47-4a96-9f50-c7cd8609f1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:49.424508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23618a-4c47-4a96-9f50-c7cd8609f1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:49.424792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23618a-4c47-4a96-9f50-c7cd8609f1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:49.425477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23618a-4c47-4a96-9f50-c7cd8609f1b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:49.436694 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23618a-4c47-4a96-9f50-c7cd8609f1b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:49.444404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-0d23618a-4c47-4a96-9f50-c7cd8609f1b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:49.444404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:49.444404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:49.444404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:49.444404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:49.444404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:49.444404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:49.444404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:49.444404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:49.444404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:49.444404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:49.444404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:49.444404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:49.444404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:49.444404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:49.444404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:49.445259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:49.445259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:49.445259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:49.445259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:49.445259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:49.445259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:49.445259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:49.445259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:49.445259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:49.445259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:49.445259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:49.445259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:18:49.445259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:49.445259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:49.445259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:49.445259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:49.446585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:49.446585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:49.446585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:49.446585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:49.446585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:49.446585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:49.446585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:49.446585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:49.446585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:49.446585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:49.446585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:49.446585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:18:49.446585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 152/302] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:49.451369 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23618a-4c47-4a96-9f50-c7cd8609f1b0 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:49.452976 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fd052-edf1-4734-8d48-ab3001830458 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:49.491439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eda120-fe9b-4164-a1c9-1c8d3ad3202b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:49.492232 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eda120-fe9b-4164-a1c9-1c8d3ad3202b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:49.493070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eda120-fe9b-4164-a1c9-1c8d3ad3202b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:49.493343 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eda120-fe9b-4164-a1c9-1c8d3ad3202b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:49.504990 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eda120-fe9b-4164-a1c9-1c8d3ad3202b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:49.513202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-12eda120-fe9b-4164-a1c9-1c8d3ad3202b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:18:49.513202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:49.513202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:49.513202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:49.513202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:49.513202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:49.513202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:49.513202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:49.513202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:49.513202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:49.513202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:49.513202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:49.513202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:49.513202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:49.513202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:49.513202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:49.514072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:49.514072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:49.514072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:49.514072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:49.514072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:49.514072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:49.514072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:49.514072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:49.514072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:49.514072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:49.514072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:49.514072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:18:49.514072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:49.514072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:49.514072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:49.514072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:49.514878 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:49.514878 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:49.514878 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:49.514878 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:49.514878 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:49.514878 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:49.514878 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:49.514878 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:49.514878 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:49.514878 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:49.514878 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:18:49.514878 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:18:49.514878 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 151/303] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:49.515527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eda120-fe9b-4164-a1c9-1c8d3ad3202b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:49.560495 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23618a-4c47-4a96-9f50-c7cd8609f1b0 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:49.595502 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d307118-bf3b-478e-8716-2a1091a420b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:49.596166 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d307118-bf3b-478e-8716-2a1091a420b8 None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:49.596448 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d307118-bf3b-478e-8716-2a1091a420b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:49.596724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d307118-bf3b-478e-8716-2a1091a420b8 None admin] PATH_INFO: `/v3/groups` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:49.597400 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d307118-bf3b-478e-8716-2a1091a420b8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:49.598876 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d307118-bf3b-478e-8716-2a1091a420b8 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:49.613899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 153/304] 10.222.0.25 () {60 vars in 1134 bytes} [Mon May 23 12:18:49 2022] POST /identity/v3/groups => generated 229 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:18:49.614727 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d307118-bf3b-478e-8716-2a1091a420b8 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:49.623173 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eda120-fe9b-4164-a1c9-1c8d3ad3202b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:49.625537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:49.649386 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:49.668021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598675ac-9e58-4983-8fc8-96ed6e31d468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:49.668703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598675ac-9e58-4983-8fc8-96ed6e31d468 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:49.669009 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598675ac-9e58-4983-8fc8-96ed6e31d468 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:49.669262 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598675ac-9e58-4983-8fc8-96ed6e31d468 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:49.670078 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598675ac-9e58-4983-8fc8-96ed6e31d468 None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:49.670393 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598675ac-9e58-4983-8fc8-96ed6e31d468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:49.671905 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598675ac-9e58-4983-8fc8-96ed6e31d468 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:49.682035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 152/305] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:18:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:49.683823 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecca1c6-a998-4460-b296-19e5d975792f None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:49.684330 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecca1c6-a998-4460-b296-19e5d975792f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:49.684825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecca1c6-a998-4460-b296-19e5d975792f None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:49.686429 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 153/306] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:49.687846 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecca1c6-a998-4460-b296-19e5d975792f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:49.750314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d307118-bf3b-478e-8716-2a1091a420b8 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:49.787571 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8ab1d-10f4-4c80-9f65-d444029da905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:49.788254 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8ab1d-10f4-4c80-9f65-d444029da905 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:49.788543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8ab1d-10f4-4c80-9f65-d444029da905 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:49.788824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8ab1d-10f4-4c80-9f65-d444029da905 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:49.789724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8ab1d-10f4-4c80-9f65-d444029da905 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:49.790054 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8ab1d-10f4-4c80-9f65-d444029da905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:49.791641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8ab1d-10f4-4c80-9f65-d444029da905 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:49.805932 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecca1c6-a998-4460-b296-19e5d975792f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:49.806791 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 154/307] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:18:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:49.808290 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05bc0d-0c99-4416-a136-e352d5d21305 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:49.808594 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05bc0d-0c99-4416-a136-e352d5d21305 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:49.809555 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05bc0d-0c99-4416-a136-e352d5d21305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:49.827336 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-5f05bc0d-0c99-4416-a136-e352d5d21305 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:49.829939 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-5f05bc0d-0c99-4416-a136-e352d5d21305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:49.843120 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658d6a3-06cd-4ca3-8dc8-f7a5e36b600b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:49.844355 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658d6a3-06cd-4ca3-8dc8-f7a5e36b600b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:49.844640 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658d6a3-06cd-4ca3-8dc8-f7a5e36b600b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:49.844913 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658d6a3-06cd-4ca3-8dc8-f7a5e36b600b None admin] PATH_INFO: `/v3/users/5bd977ce46b5406ebe8147e2b70da7c5` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:49.846093 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658d6a3-06cd-4ca3-8dc8-f7a5e36b600b None admin] RBAC: Authorizing `identity:get_user(user_id=5bd977ce46b5406ebe8147e2b70da7c5)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:49.847578 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658d6a3-06cd-4ca3-8dc8-f7a5e36b600b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:49.849409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 154/308] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:49 2022] GET /identity/v3/users/5bd977ce46b5406ebe8147e2b70da7c5 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:49.850014 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658d6a3-06cd-4ca3-8dc8-f7a5e36b600b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:49.898838 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:49.926807 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 155/309] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:49.927527 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05bc0d-0c99-4416-a136-e352d5d21305 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:49.961012 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:49.985600 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658d6a3-06cd-4ca3-8dc8-f7a5e36b600b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:50.021734 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea77be5-c736-4103-b813-a052a731d9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:50.022668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea77be5-c736-4103-b813-a052a731d9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:50.022960 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea77be5-c736-4103-b813-a052a731d9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:50.023257 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea77be5-c736-4103-b813-a052a731d9e2 None admin] PATH_INFO: `/v3/users/6d99ca34ab9a4587afd069c80fd2280b` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:50.037731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea77be5-c736-4103-b813-a052a731d9e2 None admin] RBAC: Authorizing `identity:get_user(user_id=6d99ca34ab9a4587afd069c80fd2280b)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:50.040333 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea77be5-c736-4103-b813-a052a731d9e2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:50.042175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 155/310] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:49 2022] GET /identity/v3/users/6d99ca34ab9a4587afd069c80fd2280b => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:50.047557 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea77be5-c736-4103-b813-a052a731d9e2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:50.051583 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05bc0d-0c99-4416-a136-e352d5d21305 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:50.089855 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50edbd6-3214-4072-966d-f65acb7958e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:50.091036 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50edbd6-3214-4072-966d-f65acb7958e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:50.091503 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50edbd6-3214-4072-966d-f65acb7958e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:50.091958 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50edbd6-3214-4072-966d-f65acb7958e2 None admin] PATH_INFO: `/v3/system/users/5bd977ce46b5406ebe8147e2b70da7c5/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:50.093656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50edbd6-3214-4072-966d-f65acb7958e2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5bd977ce46b5406ebe8147e2b70da7c5, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:50.095271 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50edbd6-3214-4072-966d-f65acb7958e2 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:50.106664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 156/311] 10.222.0.25 () {58 vars in 1334 bytes} [Mon May 23 12:18:49 2022] PUT /identity/v3/system/users/5bd977ce46b5406ebe8147e2b70da7c5/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:18:50.107521 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50edbd6-3214-4072-966d-f65acb7958e2 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:50.167124 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:50.181564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea77be5-c736-4103-b813-a052a731d9e2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:50.222450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:50.238432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef86936-2aed-4996-8bce-9c7dcf2fd728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:50.239830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef86936-2aed-4996-8bce-9c7dcf2fd728 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:50.240322 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef86936-2aed-4996-8bce-9c7dcf2fd728 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:50.240792 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef86936-2aed-4996-8bce-9c7dcf2fd728 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:50.253637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50edbd6-3214-4072-966d-f65acb7958e2 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:50.255564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef86936-2aed-4996-8bce-9c7dcf2fd728 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:50.264152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-aef86936-2aed-4996-8bce-9c7dcf2fd728 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:18:50.264152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:50.264152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:50.264152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:50.264152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:50.264152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:50.264152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:50.264152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:50.264152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:50.264152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:50.264152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:50.264152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:50.264152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:50.264152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:50.264152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:50.264152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:50.265104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:50.265104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:50.265104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:50.265104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:50.265104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:50.265104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:50.265104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:50.265104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:50.265104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:50.265104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:50.265104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:50.265104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:18:50.265104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:50.265104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:50.265104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:50.265104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:50.265868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:50.265868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:50.265868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:50.265868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:50.265868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:50.265868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:50.265868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:50.265868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:50.265868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:50.265868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:50.265868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:18:50.265868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:18:50.265868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 156/312] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:50.272712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef86936-2aed-4996-8bce-9c7dcf2fd728 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:50.302717 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18686b38-c0c7-4308-b71d-1d7d684f66ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:50.303384 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18686b38-c0c7-4308-b71d-1d7d684f66ea None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:50.303675 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18686b38-c0c7-4308-b71d-1d7d684f66ea None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:50.303957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18686b38-c0c7-4308-b71d-1d7d684f66ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:50.307901 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18686b38-c0c7-4308-b71d-1d7d684f66ea None admin] RBAC: Adding query filter params (role.id=ee2f590e932841609deb8ed245e89ef4, user.id=6d99ca34ab9a4587afd069c80fd2280b, scope.system=all) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:50.307901 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18686b38-c0c7-4308-b71d-1d7d684f66ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:50.307901 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18686b38-c0c7-4308-b71d-1d7d684f66ea None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:50.313148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 157/313] 10.222.0.25 () {56 vars in 1308 bytes} [Mon May 23 12:18:50 2022] GET /identity/v3/role_assignments?user.id=6d99ca34ab9a4587afd069c80fd2280b&scope.system=all&role.id=ee2f590e932841609deb8ed245e89ef4 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:50.400923 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef86936-2aed-4996-8bce-9c7dcf2fd728 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:50.440299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d7f0a-00af-4996-9d43-72b88a13d484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:50.440981 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d7f0a-00af-4996-9d43-72b88a13d484 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:50.441268 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d7f0a-00af-4996-9d43-72b88a13d484 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:50.441551 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d7f0a-00af-4996-9d43-72b88a13d484 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:50.442331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d7f0a-00af-4996-9d43-72b88a13d484 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:50.442675 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d7f0a-00af-4996-9d43-72b88a13d484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:50.444140 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d7f0a-00af-4996-9d43-72b88a13d484 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:50.454132 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 157/314] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:18:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:50.460196 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18686b38-c0c7-4308-b71d-1d7d684f66ea None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:50.569333 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18686b38-c0c7-4308-b71d-1d7d684f66ea None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:50.606242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d71e9-4a16-4544-82a9-a31f81d1a288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:50.607143 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d71e9-4a16-4544-82a9-a31f81d1a288 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:50.607430 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d71e9-4a16-4544-82a9-a31f81d1a288 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:50.607710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d71e9-4a16-4544-82a9-a31f81d1a288 None admin] PATH_INFO: `/v3/users/278b26c1e6f843f994b8f0002bab7bc5` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:50.609162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d71e9-4a16-4544-82a9-a31f81d1a288 None admin] RBAC: Authorizing `identity:get_user(user_id=278b26c1e6f843f994b8f0002bab7bc5)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:50.610651 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d71e9-4a16-4544-82a9-a31f81d1a288 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:50.616732 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 158/315] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:50 2022] GET /identity/v3/users/278b26c1e6f843f994b8f0002bab7bc5 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:50.618172 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d7f0a-00af-4996-9d43-72b88a13d484 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:50.634900 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:50.731626 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d7f0a-00af-4996-9d43-72b88a13d484 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:50.767638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf51f51-8dc9-409e-a612-9819c89ad52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:50.768291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf51f51-8dc9-409e-a612-9819c89ad52a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:50.768581 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf51f51-8dc9-409e-a612-9819c89ad52a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:50.768862 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf51f51-8dc9-409e-a612-9819c89ad52a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:50.843864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf51f51-8dc9-409e-a612-9819c89ad52a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:50.845403 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf51f51-8dc9-409e-a612-9819c89ad52a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:50.860634 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:50.957256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 158/316] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:18:50.958660 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d71e9-4a16-4544-82a9-a31f81d1a288 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:50.979222 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:51.068500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d71e9-4a16-4544-82a9-a31f81d1a288 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:51.104164 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82301e98-2022-431d-9061-ea90e3937060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:51.105021 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82301e98-2022-431d-9061-ea90e3937060 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:51.105305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82301e98-2022-431d-9061-ea90e3937060 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:51.105583 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82301e98-2022-431d-9061-ea90e3937060 None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:51.106800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82301e98-2022-431d-9061-ea90e3937060 None admin] RBAC: Authorizing `identity:get_project(project_id=087acb6a0d3945e7bc219b099d7a6037)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:51.108264 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82301e98-2022-431d-9061-ea90e3937060 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:51.110321 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 159/317] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:50 2022] GET /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:51.116465 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf51f51-8dc9-409e-a612-9819c89ad52a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:51.226791 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf51f51-8dc9-409e-a612-9819c89ad52a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:51.241640 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:51.266287 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec01a0d-8d33-4225-b924-cdd34890d774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:51.267737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec01a0d-8d33-4225-b924-cdd34890d774 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:51.268084 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec01a0d-8d33-4225-b924-cdd34890d774 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:51.268368 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec01a0d-8d33-4225-b924-cdd34890d774 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:51.269211 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec01a0d-8d33-4225-b924-cdd34890d774 None admin] RBAC: Adding query filter params (role.id=ee2f590e932841609deb8ed245e89ef4, scope.project.id=087acb6a0d3945e7bc219b099d7a6037, user.id=278b26c1e6f843f994b8f0002bab7bc5) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:51.269523 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec01a0d-8d33-4225-b924-cdd34890d774 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:51.273366 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec01a0d-8d33-4225-b924-cdd34890d774 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:51.286627 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 159/318] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:18:51 2022] GET /identity/v3/role_assignments?user.id=278b26c1e6f843f994b8f0002bab7bc5&scope.project.id=087acb6a0d3945e7bc219b099d7a6037&role.id=ee2f590e932841609deb8ed245e89ef4 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:51.927348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2aaa7-5c56-46e1-9843-2f2d7e846b83 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:51.927649 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2aaa7-5c56-46e1-9843-2f2d7e846b83 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:51.927964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2aaa7-5c56-46e1-9843-2f2d7e846b83 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:51.929419 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 160/319] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:51.934916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fc21b-e1f0-429a-a768-a6a7e839b13c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:51.935318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fc21b-e1f0-429a-a768-a6a7e839b13c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:51.935605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fc21b-e1f0-429a-a768-a6a7e839b13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:51.952264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0b4fc21b-e1f0-429a-a768-a6a7e839b13c None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:51.953469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0b4fc21b-e1f0-429a-a768-a6a7e839b13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:52.024015 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 160/320] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:52.046337 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2aaa7-5c56-46e1-9843-2f2d7e846b83 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:52.141060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:52.159219 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2aaa7-5c56-46e1-9843-2f2d7e846b83 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:52.197392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fc21d-d886-4d3a-935c-4e4acfb91b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:52.198362 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fc21d-d886-4d3a-935c-4e4acfb91b2a None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:52.198709 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fc21d-d886-4d3a-935c-4e4acfb91b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:52.199021 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fc21d-d886-4d3a-935c-4e4acfb91b2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:52.200189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fc21d-d886-4d3a-935c-4e4acfb91b2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:52.201652 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fc21d-d886-4d3a-935c-4e4acfb91b2a None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:52.203462 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 161/321] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:18:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:52.208813 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fc21b-e1f0-429a-a768-a6a7e839b13c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:52.319449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fc21b-e1f0-429a-a768-a6a7e839b13c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:52.327348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:52.355717 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87778778-5627-411e-9ecc-f847652b9800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:52.356382 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87778778-5627-411e-9ecc-f847652b9800 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:52.356665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87778778-5627-411e-9ecc-f847652b9800 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:52.356940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87778778-5627-411e-9ecc-f847652b9800 None admin] PATH_INFO: `/v3/groups` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:52.357636 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87778778-5627-411e-9ecc-f847652b9800 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:52.359382 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87778778-5627-411e-9ecc-f847652b9800 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:52.374904 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 161/322] 10.222.0.25 () {60 vars in 1134 bytes} [Mon May 23 12:18:52 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:18:52.448712 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206f0aa-fc51-465b-b125-fadb2c08ff8d None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:52.449026 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206f0aa-fc51-465b-b125-fadb2c08ff8d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:52.449211 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206f0aa-fc51-465b-b125-fadb2c08ff8d None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:52.450912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 162/323] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:52.456878 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86485d95-204a-4f1e-afad-895e94de6d0e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:52.457181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86485d95-204a-4f1e-afad-895e94de6d0e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:52.457450 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86485d95-204a-4f1e-afad-895e94de6d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:52.475932 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-86485d95-204a-4f1e-afad-895e94de6d0e None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:52.477291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-86485d95-204a-4f1e-afad-895e94de6d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:52.557360 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 162/324] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:52.581718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206f0aa-fc51-465b-b125-fadb2c08ff8d None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:52.701109 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206f0aa-fc51-465b-b125-fadb2c08ff8d None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:52.732291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf27fb6-6852-43f7-b7c2-0cd3f4307d71 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:52.732613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf27fb6-6852-43f7-b7c2-0cd3f4307d71 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:52.732862 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf27fb6-6852-43f7-b7c2-0cd3f4307d71 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:52.734493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 163/325] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:18:52.743764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bf442-577c-4d3a-bf01-39acc14fd1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:52.743937 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f567d1-85b2-41e5-8175-8fc265d4f63e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:52.744155 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f567d1-85b2-41e5-8175-8fc265d4f63e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:52.744354 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f567d1-85b2-41e5-8175-8fc265d4f63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:52.745302 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bf442-577c-4d3a-bf01-39acc14fd1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:52.745591 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bf442-577c-4d3a-bf01-39acc14fd1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:52.745866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bf442-577c-4d3a-bf01-39acc14fd1e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:52.760685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bf442-577c-4d3a-bf01-39acc14fd1e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:52.763895 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-35f567d1-85b2-41e5-8175-8fc265d4f63e None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:52.765094 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-35f567d1-85b2-41e5-8175-8fc265d4f63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:52.770772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-2b7bf442-577c-4d3a-bf01-39acc14fd1e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:52.770772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:52.770772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:52.770772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:52.770772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:52.770772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:52.770772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:52.770772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:52.770772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:52.770772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:52.770772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:52.770772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:52.770772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:52.770772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:52.770772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:52.770772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:52.771680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:52.771680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:52.771680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:52.771680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:52.771680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:52.771680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:52.771680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:52.771680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:52.771680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:52.771680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:52.771680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:52.771680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:18:52.771680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:52.771680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:52.771680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:52.771680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:52.772494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:52.772494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:52.772494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:52.772494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:52.772494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:52.772494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:52.772494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:52.772494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:52.772494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:52.772494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:52.772494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:52.772494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:18:52.776056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 163/326] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:52.782299 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bf442-577c-4d3a-bf01-39acc14fd1e5 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:52.803515 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:52.859954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 164/327] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:52.881914 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f567d1-85b2-41e5-8175-8fc265d4f63e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:52.922239 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:52.922533 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bf442-577c-4d3a-bf01-39acc14fd1e5 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:52.966852 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e81511-f7ae-4e34-9a66-80106c0933fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:52.967765 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e81511-f7ae-4e34-9a66-80106c0933fc None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:52.968214 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e81511-f7ae-4e34-9a66-80106c0933fc None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:52.968646 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e81511-f7ae-4e34-9a66-80106c0933fc None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:52.969680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e81511-f7ae-4e34-9a66-80106c0933fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:52.970329 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e81511-f7ae-4e34-9a66-80106c0933fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:52.972048 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e81511-f7ae-4e34-9a66-80106c0933fc None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:52.982730 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 164/328] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:18:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:52.989504 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e81511-f7ae-4e34-9a66-80106c0933fc None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:53.019590 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f567d1-85b2-41e5-8175-8fc265d4f63e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:53.064282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c348207-c7a5-4060-b437-fa89e63c1f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:53.065090 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c348207-c7a5-4060-b437-fa89e63c1f0f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:53.065520 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c348207-c7a5-4060-b437-fa89e63c1f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:53.065937 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c348207-c7a5-4060-b437-fa89e63c1f0f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:53.080231 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c348207-c7a5-4060-b437-fa89e63c1f0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:53.089173 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:53.091521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-9c348207-c7a5-4060-b437-fa89e63c1f0f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:18:53.091521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:53.091521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:53.091521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:53.091521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:53.091521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:53.091521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:53.091521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:53.091521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:53.091521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:53.091521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:53.091521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:53.091521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:53.091521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:53.091521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:53.091521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:53.092444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:53.092444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:53.092444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:53.092444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:53.092444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:53.092444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:53.092444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:53.092444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:53.092444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:53.092444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:53.092444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:53.092444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:18:53.092444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:53.092444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:53.092444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:53.092444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:53.093215 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:53.093215 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:53.093215 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:53.093215 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:53.093215 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:53.093215 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:53.093215 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:53.093215 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:53.093215 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:53.093215 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:53.093215 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:18:53.093215 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:18:53.098058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 165/329] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:18:53.099459 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c348207-c7a5-4060-b437-fa89e63c1f0f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:53.125309 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e81511-f7ae-4e34-9a66-80106c0933fc None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:53.163778 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec2b2a-235d-4894-ba8c-458335a891ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:53.165950 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec2b2a-235d-4894-ba8c-458335a891ff None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:53.166413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec2b2a-235d-4894-ba8c-458335a891ff None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:53.166871 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec2b2a-235d-4894-ba8c-458335a891ff None admin] PATH_INFO: `/v3/users/5bd977ce46b5406ebe8147e2b70da7c5` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:53.168279 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec2b2a-235d-4894-ba8c-458335a891ff None admin] RBAC: Authorizing `identity:get_user(user_id=5bd977ce46b5406ebe8147e2b70da7c5)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:53.169962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec2b2a-235d-4894-ba8c-458335a891ff None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:53.172289 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 165/330] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:52 2022] GET /identity/v3/users/5bd977ce46b5406ebe8147e2b70da7c5 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:53.183523 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec2b2a-235d-4894-ba8c-458335a891ff None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:53.232722 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:53.251708 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c348207-c7a5-4060-b437-fa89e63c1f0f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:53.307574 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504f60e-d24f-46c0-a4f1-f221a344c78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:53.308256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504f60e-d24f-46c0-a4f1-f221a344c78c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:53.308544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504f60e-d24f-46c0-a4f1-f221a344c78c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:53.308823 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504f60e-d24f-46c0-a4f1-f221a344c78c None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:53.309589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504f60e-d24f-46c0-a4f1-f221a344c78c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:53.309902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504f60e-d24f-46c0-a4f1-f221a344c78c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:53.311455 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504f60e-d24f-46c0-a4f1-f221a344c78c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:53.330341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 166/331] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:18:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:53.332520 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504f60e-d24f-46c0-a4f1-f221a344c78c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:53.355935 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec2b2a-235d-4894-ba8c-458335a891ff None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:53.401145 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b428f-3108-4121-bb27-8c12e5eeb876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:53.402233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b428f-3108-4121-bb27-8c12e5eeb876 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:53.402744 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b428f-3108-4121-bb27-8c12e5eeb876 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:53.403271 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b428f-3108-4121-bb27-8c12e5eeb876 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:53.404315 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b428f-3108-4121-bb27-8c12e5eeb876 None admin] RBAC: Adding query filter params (role.id=3dac847973464a2cb123dc2c9083baf3, user.id=5bd977ce46b5406ebe8147e2b70da7c5, scope.system=all) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:53.404837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b428f-3108-4121-bb27-8c12e5eeb876 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:53.406551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b428f-3108-4121-bb27-8c12e5eeb876 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:53.416747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:53.424535 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 166/332] 10.222.0.25 () {56 vars in 1308 bytes} [Mon May 23 12:18:53 2022] GET /identity/v3/role_assignments?user.id=5bd977ce46b5406ebe8147e2b70da7c5&scope.system=all&role.id=3dac847973464a2cb123dc2c9083baf3 => generated 510 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:53.504735 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504f60e-d24f-46c0-a4f1-f221a344c78c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:53.553824 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4a088-141c-4280-9e46-50eb6b007a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:53.554758 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4a088-141c-4280-9e46-50eb6b007a66 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:53.555088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4a088-141c-4280-9e46-50eb6b007a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:53.555372 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4a088-141c-4280-9e46-50eb6b007a66 None admin] PATH_INFO: `/v3/users/6d99ca34ab9a4587afd069c80fd2280b` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:53.556728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4a088-141c-4280-9e46-50eb6b007a66 None admin] RBAC: Authorizing `identity:get_user(user_id=6d99ca34ab9a4587afd069c80fd2280b)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:53.558449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4a088-141c-4280-9e46-50eb6b007a66 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:53.560429 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 167/333] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:53 2022] GET /identity/v3/users/6d99ca34ab9a4587afd069c80fd2280b => generated 293 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:53.566375 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b428f-3108-4121-bb27-8c12e5eeb876 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:53.690081 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b428f-3108-4121-bb27-8c12e5eeb876 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:53.730760 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21fb7a-366e-42e6-9f48-a3e8e968f6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:53.731627 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21fb7a-366e-42e6-9f48-a3e8e968f6ba None admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:53.731912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21fb7a-366e-42e6-9f48-a3e8e968f6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:53.732190 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21fb7a-366e-42e6-9f48-a3e8e968f6ba None admin] PATH_INFO: `/v3/system/users/6d99ca34ab9a4587afd069c80fd2280b/roles/ee2f590e932841609deb8ed245e89ef4` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:53.733954 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21fb7a-366e-42e6-9f48-a3e8e968f6ba None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6d99ca34ab9a4587afd069c80fd2280b, role_id=ee2f590e932841609deb8ed245e89ef4)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:53.735395 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21fb7a-366e-42e6-9f48-a3e8e968f6ba None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:53.746603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 167/334] 10.222.0.25 () {58 vars in 1334 bytes} [Mon May 23 12:18:53 2022] PUT /identity/v3/system/users/6d99ca34ab9a4587afd069c80fd2280b/roles/ee2f590e932841609deb8ed245e89ef4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:18:55.373503 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec711299-26c5-4c05-85d3-b117d113a093 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:55.374645 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec711299-26c5-4c05-85d3-b117d113a093 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:55.375138 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec711299-26c5-4c05-85d3-b117d113a093 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:55.377254 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 168/335] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:55.382336 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24baf2b-c512-4b16-9a7f-81d502612123 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:55.383180 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24baf2b-c512-4b16-9a7f-81d502612123 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:55.383637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24baf2b-c512-4b16-9a7f-81d502612123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:55.411485 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-e24baf2b-c512-4b16-9a7f-81d502612123 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:55.412946 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e24baf2b-c512-4b16-9a7f-81d502612123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:55.483150 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:55.497163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 168/336] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:55.506126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c88b3-af43-4af5-a5a6-d611f49f7312 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:55.506420 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c88b3-af43-4af5-a5a6-d611f49f7312 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:55.506731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c88b3-af43-4af5-a5a6-d611f49f7312 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:55.508946 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 169/337] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:55.514401 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33812b-9ecc-4be1-ae7b-50477e08e69c None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:55.514728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33812b-9ecc-4be1-ae7b-50477e08e69c None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:55.515012 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33812b-9ecc-4be1-ae7b-50477e08e69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:55.531690 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c88b3-af43-4af5-a5a6-d611f49f7312 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:55.540695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-0b33812b-9ecc-4be1-ae7b-50477e08e69c None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:55.541026 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-0b33812b-9ecc-4be1-ae7b-50477e08e69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:55.576793 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:55.656521 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 169/338] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:55.713474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c88b3-af43-4af5-a5a6-d611f49f7312 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:55.734721 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33812b-9ecc-4be1-ae7b-50477e08e69c None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:55.774023 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438713f-65d6-47b8-b4d2-43e17795dded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:55.779070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438713f-65d6-47b8-b4d2-43e17795dded None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:55.779365 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438713f-65d6-47b8-b4d2-43e17795dded None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:55.779669 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438713f-65d6-47b8-b4d2-43e17795dded None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:55.791893 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438713f-65d6-47b8-b4d2-43e17795dded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:55.804230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-3438713f-65d6-47b8-b4d2-43e17795dded None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:55.804230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:55.804230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:55.804230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:55.804230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:55.804230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:55.804230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:55.804230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:55.804230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:55.804230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:55.804230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:55.804230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:55.804230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:55.804230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:55.804230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:55.804230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:55.805704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:55.805704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:55.805704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:55.805704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:55.805704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:55.805704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:55.805704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:55.805704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:55.805704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:55.805704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:55.805704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:55.805704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:18:55.805704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:55.805704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:55.805704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:55.805704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:55.806519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:55.806519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:55.806519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:55.806519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:55.806519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:55.806519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:55.806519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:55.806519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:55.806519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:55.806519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:55.806519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:55.806519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:18:55.813269 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 170/339] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:18:55.814250 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438713f-65d6-47b8-b4d2-43e17795dded None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:55.860544 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33812b-9ecc-4be1-ae7b-50477e08e69c None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:55.894923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:55.900810 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b73db-fabf-4b9c-853f-700121d6c558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:55.902141 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b73db-fabf-4b9c-853f-700121d6c558 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:55.902636 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b73db-fabf-4b9c-853f-700121d6c558 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:55.903109 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b73db-fabf-4b9c-853f-700121d6c558 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:55.915639 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b73db-fabf-4b9c-853f-700121d6c558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:55.925713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-013b73db-fabf-4b9c-853f-700121d6c558 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:18:55.925713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:55.925713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:55.925713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:55.925713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:55.925713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:55.925713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:55.925713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:55.925713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:55.925713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:55.925713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:55.925713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:55.925713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:55.925713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:55.925713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:55.925713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:55.926637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:55.926637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:55.926637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:55.926637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:55.926637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:55.926637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:55.926637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:55.926637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:55.926637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:55.926637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:55.926637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:55.926637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:18:55.926637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:55.926637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:55.926637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:55.926637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:55.927440 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:55.927440 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:55.927440 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:55.927440 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:55.927440 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:55.927440 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:55.927440 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:55.927440 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:55.927440 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:55.927440 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:55.927440 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:18:55.927440 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:18:55.930193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 170/340] 10.222.0.25 () {56 vars in 1114 bytes} [Mon May 23 12:18:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:18:55.939982 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b73db-fabf-4b9c-853f-700121d6c558 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:55.955100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:56.044647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438713f-65d6-47b8-b4d2-43e17795dded None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:56.063039 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b73db-fabf-4b9c-853f-700121d6c558 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:56.115996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf0af1-fd10-47b1-97a8-c39ce4c8228a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:56.117003 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf0af1-fd10-47b1-97a8-c39ce4c8228a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:56.117474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf0af1-fd10-47b1-97a8-c39ce4c8228a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:56.117936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf0af1-fd10-47b1-97a8-c39ce4c8228a None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:56.118877 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf0af1-fd10-47b1-97a8-c39ce4c8228a None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:56.119343 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf0af1-fd10-47b1-97a8-c39ce4c8228a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:56.120897 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf0af1-fd10-47b1-97a8-c39ce4c8228a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:56.133895 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cdac3-8f27-42cb-82b6-f1519f512c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:56.134844 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cdac3-8f27-42cb-82b6-f1519f512c3e None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:56.136519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cdac3-8f27-42cb-82b6-f1519f512c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:56.136944 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cdac3-8f27-42cb-82b6-f1519f512c3e None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:56.138745 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07cdac3-8f27-42cb-82b6-f1519f512c3e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:56.139449 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07cdac3-8f27-42cb-82b6-f1519f512c3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:56.139606 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 171/341] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:18:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:56.141170 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07cdac3-8f27-42cb-82b6-f1519f512c3e None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:56.143959 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf0af1-fd10-47b1-97a8-c39ce4c8228a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:56.161689 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 171/342] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:18:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:56.167618 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cdac3-8f27-42cb-82b6-f1519f512c3e None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:56.258892 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:56.308212 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cdac3-8f27-42cb-82b6-f1519f512c3e None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:56.351537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dca6da-2e2c-4351-96b4-0f0e2b7847c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:56.353262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dca6da-2e2c-4351-96b4-0f0e2b7847c7 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:56.353262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dca6da-2e2c-4351-96b4-0f0e2b7847c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:56.356778 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dca6da-2e2c-4351-96b4-0f0e2b7847c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:56.434346 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dca6da-2e2c-4351-96b4-0f0e2b7847c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:56.435960 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dca6da-2e2c-4351-96b4-0f0e2b7847c7 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:56.494981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:56.526676 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf0af1-fd10-47b1-97a8-c39ce4c8228a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:56.558199 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 172/343] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:18:56.560086 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd60e5-8b44-4d44-ab8e-88512c849e48 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:56.561194 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd60e5-8b44-4d44-ab8e-88512c849e48 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:56.561699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd60e5-8b44-4d44-ab8e-88512c849e48 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:56.563700 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 173/344] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:56.564789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd60e5-8b44-4d44-ab8e-88512c849e48 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:56.653653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab5a51-a283-4f77-aa6a-78d2c27b6552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:56.656319 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab5a51-a283-4f77-aa6a-78d2c27b6552 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:56.656832 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab5a51-a283-4f77-aa6a-78d2c27b6552 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:56.657307 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab5a51-a283-4f77-aa6a-78d2c27b6552 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:56.685939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:56.761265 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd60e5-8b44-4d44-ab8e-88512c849e48 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:56.825672 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab5a51-a283-4f77-aa6a-78d2c27b6552 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:56.827895 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab5a51-a283-4f77-aa6a-78d2c27b6552 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:56.841590 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b14d9-c941-44dd-a90c-969c13cec6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:56.843476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b14d9-c941-44dd-a90c-969c13cec6ea None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:56.844243 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b14d9-c941-44dd-a90c-969c13cec6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:56.844780 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b14d9-c941-44dd-a90c-969c13cec6ea None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:56.846381 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b14d9-c941-44dd-a90c-969c13cec6ea None admin] RBAC: Authorizing `identity:get_project(project_id=3fd6ed2a258c474293105ba1798cee00)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:56.848232 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b14d9-c941-44dd-a90c-969c13cec6ea None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:56.854794 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 174/345] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:56 2022] GET /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00 => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:56.857654 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef871c2-efd6-41a4-b056-9efc35edf68d None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:56.858185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef871c2-efd6-41a4-b056-9efc35edf68d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:56.858949 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef871c2-efd6-41a4-b056-9efc35edf68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:56.898147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-4ef871c2-efd6-41a4-b056-9efc35edf68d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:56.901849 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-4ef871c2-efd6-41a4-b056-9efc35edf68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:56.922914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:57.065281 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 172/346] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 922 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:18:57.066755 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab5a51-a283-4f77-aa6a-78d2c27b6552 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:57.069265 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 175/347] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:57.075826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef871c2-efd6-41a4-b056-9efc35edf68d None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:57.177743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:57.213093 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef871c2-efd6-41a4-b056-9efc35edf68d None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:57.261735 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70ed3e-24e7-4c1f-a7e4-297a66b3f9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:57.262803 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70ed3e-24e7-4c1f-a7e4-297a66b3f9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:57.263319 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70ed3e-24e7-4c1f-a7e4-297a66b3f9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:57.263778 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70ed3e-24e7-4c1f-a7e4-297a66b3f9e2 None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:57.265159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70ed3e-24e7-4c1f-a7e4-297a66b3f9e2 None admin] RBAC: Authorizing `identity:get_project(project_id=3fd6ed2a258c474293105ba1798cee00)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:57.266774 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70ed3e-24e7-4c1f-a7e4-297a66b3f9e2 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:57.273163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 176/348] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:57 2022] GET /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:18:57.274237 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70ed3e-24e7-4c1f-a7e4-297a66b3f9e2 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:57.291565 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab5a51-a283-4f77-aa6a-78d2c27b6552 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:57.292264 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:57.337321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9494b33-6f7c-458d-8c82-4bbba8144bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:57.338259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9494b33-6f7c-458d-8c82-4bbba8144bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:57.338655 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9494b33-6f7c-458d-8c82-4bbba8144bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:57.339005 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9494b33-6f7c-458d-8c82-4bbba8144bb5 None admin] PATH_INFO: `/v3/groups/19f868c18e87475ab117486b3738a6ba` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:57.346769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9494b33-6f7c-458d-8c82-4bbba8144bb5 None admin] RBAC: Authorizing `identity:get_group(group_id=19f868c18e87475ab117486b3738a6ba)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:57.348354 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9494b33-6f7c-458d-8c82-4bbba8144bb5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:57.350144 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 173/349] 10.222.0.25 () {56 vars in 1180 bytes} [Mon May 23 12:18:57 2022] GET /identity/v3/groups/19f868c18e87475ab117486b3738a6ba => generated 226 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:57.352823 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e34f9-cd37-4096-915b-210da2339d60 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:57.353238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e34f9-cd37-4096-915b-210da2339d60 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:57.353529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e34f9-cd37-4096-915b-210da2339d60 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:57.354804 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 174/350] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:57.355511 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e34f9-cd37-4096-915b-210da2339d60 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:57.416477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70ed3e-24e7-4c1f-a7e4-297a66b3f9e2 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:57.474687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f4228-602b-4cfc-b9de-a73cdc2fad21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:57.475637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f4228-602b-4cfc-b9de-a73cdc2fad21 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:57.475994 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f4228-602b-4cfc-b9de-a73cdc2fad21 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:57.476346 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f4228-602b-4cfc-b9de-a73cdc2fad21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:57.491131 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f4228-602b-4cfc-b9de-a73cdc2fad21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:57.495805 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e34f9-cd37-4096-915b-210da2339d60 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:57.497811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:57.503160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-549f4228-602b-4cfc-b9de-a73cdc2fad21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:57.503160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:57.503160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:57.503160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:57.503160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:57.503160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:57.503160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:57.503160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:57.503160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:57.503160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:57.503160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:57.503160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:57.503160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:57.503160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:57.503160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:57.503160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:57.504148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:57.504148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:57.504148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:57.504148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:57.504148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:57.504148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:57.504148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:57.504148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:57.504148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:57.504148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:57.504148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:57.504148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:18:57.504148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:57.504148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:57.504148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:57.504148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:57.504957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:57.504957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:57.504957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:57.504957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:57.504957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:57.504957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:57.504957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:57.504957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:57.504957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:57.504957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:57.504957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:18:57.504957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:18:57.507547 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 177/351] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:57.509541 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050da9ce-8c43-4e85-b0aa-e503025a69c2 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:57.509836 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050da9ce-8c43-4e85-b0aa-e503025a69c2 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:57.510124 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050da9ce-8c43-4e85-b0aa-e503025a69c2 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:57.512688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 178/352] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:57.512688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050da9ce-8c43-4e85-b0aa-e503025a69c2 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:57.548500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98fb92-cf06-4c5d-8a17-b3ace0f12545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:57.549468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98fb92-cf06-4c5d-8a17-b3ace0f12545 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:57.550920 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98fb92-cf06-4c5d-8a17-b3ace0f12545 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:57.551255 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98fb92-cf06-4c5d-8a17-b3ace0f12545 None admin] PATH_INFO: `/v3/groups/19f868c18e87475ab117486b3738a6ba` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:57.553836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98fb92-cf06-4c5d-8a17-b3ace0f12545 None admin] RBAC: Authorizing `identity:get_group(group_id=19f868c18e87475ab117486b3738a6ba)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:57.555417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98fb92-cf06-4c5d-8a17-b3ace0f12545 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:57.557106 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 175/353] 10.222.0.25 () {56 vars in 1180 bytes} [Mon May 23 12:18:57 2022] GET /identity/v3/groups/19f868c18e87475ab117486b3738a6ba => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:57.558319 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613e814-5bd9-4496-90a5-7310d78ede8d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:57.558644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613e814-5bd9-4496-90a5-7310d78ede8d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:57.558926 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613e814-5bd9-4496-90a5-7310d78ede8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:57.578778 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7613e814-5bd9-4496-90a5-7310d78ede8d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:57.580042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7613e814-5bd9-4496-90a5-7310d78ede8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:57.604207 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:57.652888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050da9ce-8c43-4e85-b0aa-e503025a69c2 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:57.673015 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 176/354] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:57.682841 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613e814-5bd9-4496-90a5-7310d78ede8d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:57.703296 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9605e-4fad-4a76-91fd-950f12152b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:57.704204 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9605e-4fad-4a76-91fd-950f12152b12 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:57.704673 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9605e-4fad-4a76-91fd-950f12152b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:57.704953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9605e-4fad-4a76-91fd-950f12152b12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:57.705794 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9605e-4fad-4a76-91fd-950f12152b12 None admin] RBAC: Adding query filter params (group.id=19f868c18e87475ab117486b3738a6ba, role.id=d9ac3d950cc243aaa45c802dd5f3d844, scope.project.id=3fd6ed2a258c474293105ba1798cee00) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:57.706115 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9605e-4fad-4a76-91fd-950f12152b12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:57.707743 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9605e-4fad-4a76-91fd-950f12152b12 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:57.714982 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 179/355] 10.222.0.25 () {56 vars in 1376 bytes} [Mon May 23 12:18:57 2022] GET /identity/v3/role_assignments?group.id=19f868c18e87475ab117486b3738a6ba&scope.project.id=3fd6ed2a258c474293105ba1798cee00&role.id=d9ac3d950cc243aaa45c802dd5f3d844 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:57.716359 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153fa94-1ec7-4ddd-a958-08257c08aeb9 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:57.716665 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153fa94-1ec7-4ddd-a958-08257c08aeb9 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:57.716948 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153fa94-1ec7-4ddd-a958-08257c08aeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:57.735972 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-e153fa94-1ec7-4ddd-a958-08257c08aeb9 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:57.737224 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e153fa94-1ec7-4ddd-a958-08257c08aeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:57.827257 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:57.831415 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613e814-5bd9-4496-90a5-7310d78ede8d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:57.852681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 180/356] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:57.858787 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153fa94-1ec7-4ddd-a958-08257c08aeb9 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:57.888234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4775409-6820-4f3c-bd64-12f9d29f9174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:57.889144 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4775409-6820-4f3c-bd64-12f9d29f9174 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:57.889437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4775409-6820-4f3c-bd64-12f9d29f9174 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:57.889718 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4775409-6820-4f3c-bd64-12f9d29f9174 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:57.890637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4775409-6820-4f3c-bd64-12f9d29f9174 None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:57.890992 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4775409-6820-4f3c-bd64-12f9d29f9174 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:57.892802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4775409-6820-4f3c-bd64-12f9d29f9174 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:57.903257 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 177/357] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:18:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:57.904137 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4775409-6820-4f3c-bd64-12f9d29f9174 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:57.958026 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:58.001024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153fa94-1ec7-4ddd-a958-08257c08aeb9 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:58.028756 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4775409-6820-4f3c-bd64-12f9d29f9174 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:58.046438 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b07e98-440d-4c3a-a02c-05d477dde259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:58.047155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b07e98-440d-4c3a-a02c-05d477dde259 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:58.047442 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b07e98-440d-4c3a-a02c-05d477dde259 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:58.047720 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b07e98-440d-4c3a-a02c-05d477dde259 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:58.048554 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b07e98-440d-4c3a-a02c-05d477dde259 None admin] RBAC: Adding query filter params (group.id=19f868c18e87475ab117486b3738a6ba, role.id=3dac847973464a2cb123dc2c9083baf3, scope.project.id=3fd6ed2a258c474293105ba1798cee00) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:58.048866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b07e98-440d-4c3a-a02c-05d477dde259 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:58.050322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b07e98-440d-4c3a-a02c-05d477dde259 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:58.057611 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 181/358] 10.222.0.25 () {56 vars in 1376 bytes} [Mon May 23 12:18:57 2022] GET /identity/v3/role_assignments?group.id=19f868c18e87475ab117486b3738a6ba&scope.project.id=3fd6ed2a258c474293105ba1798cee00&role.id=3dac847973464a2cb123dc2c9083baf3 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:58.062552 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821defd-1862-4873-805f-8accef91c607 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:58.062552 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821defd-1862-4873-805f-8accef91c607 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:58.062552 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821defd-1862-4873-805f-8accef91c607 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:58.062552 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 182/359] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:18:58.062552 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821defd-1862-4873-805f-8accef91c607 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:58.088265 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa4222-b508-42b8-9635-b4a71c26ea95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:58.089106 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa4222-b508-42b8-9635-b4a71c26ea95 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:58.089391 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa4222-b508-42b8-9635-b4a71c26ea95 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:58.089663 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa4222-b508-42b8-9635-b4a71c26ea95 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:58.107674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa4222-b508-42b8-9635-b4a71c26ea95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:58.126079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-b4fa4222-b508-42b8-9635-b4a71c26ea95 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:18:58.126079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:58.126079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:58.126079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:58.126079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:58.126079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:58.126079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:58.126079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:58.126079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:58.126079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:58.126079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:58.126079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:58.126079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:58.126079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:58.126079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:58.126079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:58.127217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:58.127217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:58.127217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:58.127217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:58.127217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:58.127217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:58.127217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:58.127217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:58.127217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:58.127217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:58.127217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:58.127217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:18:58.127217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:58.127217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:58.127217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:58.127217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:58.128005 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:58.128005 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:58.128005 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:58.128005 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:58.128005 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:58.128005 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:58.128005 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:58.128005 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:58.128005 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:58.128005 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:58.128005 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:18:58.128005 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:18:58.130782 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 178/360] 10.222.0.25 () {56 vars in 1114 bytes} [Mon May 23 12:18:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:58.132025 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa4222-b508-42b8-9635-b4a71c26ea95 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:58.162761 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:58.197586 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821defd-1862-4873-805f-8accef91c607 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:58.235694 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:58.241472 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131ba10-0cdf-4554-9f6e-fc411aa83b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:58.243323 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131ba10-0cdf-4554-9f6e-fc411aa83b15 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:58.243461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131ba10-0cdf-4554-9f6e-fc411aa83b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:58.243626 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131ba10-0cdf-4554-9f6e-fc411aa83b15 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:58.257955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131ba10-0cdf-4554-9f6e-fc411aa83b15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:58.266536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-9131ba10-0cdf-4554-9f6e-fc411aa83b15 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:18:58.266536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:58.266536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:58.266536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:58.266536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:58.266536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:58.266536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:58.266536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:58.266536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:58.266536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:58.266536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:58.266536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:58.266536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:58.266536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:58.266536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:58.266536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:58.267575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:58.267575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:58.267575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:58.267575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:58.267575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:58.267575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:58.267575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:58.267575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:58.267575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:58.267575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:58.267575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:58.267575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:18:58.267575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:58.267575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:58.267575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:58.267575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:58.269222 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:58.269222 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:58.269222 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:58.269222 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:58.269222 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:58.269222 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:58.269222 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:58.269222 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:58.269222 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:58.269222 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:58.269222 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 12:18:58.269222 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:18:58.269222 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 183/361] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:58.269902 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924c8db-83a5-408e-af11-427adebc3d3c None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:58.269902 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924c8db-83a5-408e-af11-427adebc3d3c None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:58.270259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924c8db-83a5-408e-af11-427adebc3d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:58.274659 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa4222-b508-42b8-9635-b4a71c26ea95 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:58.290129 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-e924c8db-83a5-408e-af11-427adebc3d3c None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:18:58.291375 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e924c8db-83a5-408e-af11-427adebc3d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:18:58.316302 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a745d9-852f-4504-8d22-6ace7d6f88df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:58.317378 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a745d9-852f-4504-8d22-6ace7d6f88df None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:58.317898 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a745d9-852f-4504-8d22-6ace7d6f88df None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:58.318457 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a745d9-852f-4504-8d22-6ace7d6f88df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:58.377285 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 184/362] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:18:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:18:58.386640 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924c8db-83a5-408e-af11-427adebc3d3c None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:58.406887 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a745d9-852f-4504-8d22-6ace7d6f88df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:58.409251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a745d9-852f-4504-8d22-6ace7d6f88df None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:58.436230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:58.521289 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924c8db-83a5-408e-af11-427adebc3d3c None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:58.543918 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:58.549980 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 179/363] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:18:58.551591 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a745d9-852f-4504-8d22-6ace7d6f88df None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:58.566652 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28801f1a-db58-470c-b60a-c9be7ee754e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:58.567582 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28801f1a-db58-470c-b60a-c9be7ee754e1 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:58.567717 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28801f1a-db58-470c-b60a-c9be7ee754e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:58.567926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28801f1a-db58-470c-b60a-c9be7ee754e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:58.568720 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28801f1a-db58-470c-b60a-c9be7ee754e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:58.569028 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28801f1a-db58-470c-b60a-c9be7ee754e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:58.571064 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28801f1a-db58-470c-b60a-c9be7ee754e1 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:58.580900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 185/364] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:18:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:58.581814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28801f1a-db58-470c-b60a-c9be7ee754e1 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:58.707663 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a745d9-852f-4504-8d22-6ace7d6f88df None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:58.729133 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28801f1a-db58-470c-b60a-c9be7ee754e1 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:58.752066 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:58.774040 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45c3ba-d343-47c8-9091-eeecbb866211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:58.774796 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45c3ba-d343-47c8-9091-eeecbb866211 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:58.775244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45c3ba-d343-47c8-9091-eeecbb866211 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:58.775349 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45c3ba-d343-47c8-9091-eeecbb866211 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:58.776225 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45c3ba-d343-47c8-9091-eeecbb866211 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:58.776403 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45c3ba-d343-47c8-9091-eeecbb866211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:58.777803 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45c3ba-d343-47c8-9091-eeecbb866211 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:58.787837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3079b3-879b-4dd8-abce-3aa7c6a1d2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:58.788635 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3079b3-879b-4dd8-abce-3aa7c6a1d2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:58.788948 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3079b3-879b-4dd8-abce-3aa7c6a1d2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:58.789747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3079b3-879b-4dd8-abce-3aa7c6a1d2d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:58.792201 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 180/365] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:18:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:58.796788 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45c3ba-d343-47c8-9091-eeecbb866211 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:58.816003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3079b3-879b-4dd8-abce-3aa7c6a1d2d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:18:58.826410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-2e3079b3-879b-4dd8-abce-3aa7c6a1d2d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:18:58.826410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:18:58.826410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:18:58.826410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:18:58.826410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:18:58.826410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:18:58.826410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:18:58.826410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:18:58.826410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:18:58.826410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:18:58.826410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:18:58.826410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:18:58.826410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:18:58.826410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:18:58.826410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:18:58.826410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:18:58.827300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:18:58.827300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:18:58.827300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:18:58.827300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:18:58.827300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:18:58.827300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:18:58.827300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:18:58.827300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:18:58.827300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:18:58.827300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:18:58.827300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:18:58.827300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:18:58.827300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:18:58.827300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:18:58.827300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:18:58.827300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:18:58.828060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:18:58.828060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:18:58.828060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:18:58.828060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:18:58.828060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:18:58.828060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:18:58.828060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:18:58.828060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:18:58.828060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:18:58.828060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:18:58.828060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:18:58.828060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:18:58.831586 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 186/366] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:18:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:18:58.832872 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3079b3-879b-4dd8-abce-3aa7c6a1d2d0 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:58.891555 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:58.943071 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45c3ba-d343-47c8-9091-eeecbb866211 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:58.963596 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3079b3-879b-4dd8-abce-3aa7c6a1d2d0 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:58.989970 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f14fd2-f940-457c-9ef9-ac39a29036cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:58.991247 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f14fd2-f940-457c-9ef9-ac39a29036cb None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:58.991856 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f14fd2-f940-457c-9ef9-ac39a29036cb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:58.992962 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f14fd2-f940-457c-9ef9-ac39a29036cb None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:58.995088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f14fd2-f940-457c-9ef9-ac39a29036cb None admin] RBAC: Authorizing `identity:get_project(project_id=087acb6a0d3945e7bc219b099d7a6037)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:58.997202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f14fd2-f940-457c-9ef9-ac39a29036cb None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:58.999804 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 181/367] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:58 2022] GET /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:59.001288 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f14fd2-f940-457c-9ef9-ac39a29036cb None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:59.013055 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a79c71-a99d-418e-b6f5-47eb85bdc972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:59.013719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a79c71-a99d-418e-b6f5-47eb85bdc972 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:59.014008 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a79c71-a99d-418e-b6f5-47eb85bdc972 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:59.014286 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a79c71-a99d-418e-b6f5-47eb85bdc972 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:59.080474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:59.112519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a79c71-a99d-418e-b6f5-47eb85bdc972 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:59.114373 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a79c71-a99d-418e-b6f5-47eb85bdc972 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:59.156553 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f14fd2-f940-457c-9ef9-ac39a29036cb None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:59.164685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:59.207001 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98ca56-eaa9-4ca2-92fc-01d121c0c867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:59.208381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98ca56-eaa9-4ca2-92fc-01d121c0c867 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:59.208671 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98ca56-eaa9-4ca2-92fc-01d121c0c867 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:59.208949 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98ca56-eaa9-4ca2-92fc-01d121c0c867 None admin] PATH_INFO: `/v3/users/6d99ca34ab9a4587afd069c80fd2280b` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:59.210666 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98ca56-eaa9-4ca2-92fc-01d121c0c867 None admin] RBAC: Authorizing `identity:get_user(user_id=6d99ca34ab9a4587afd069c80fd2280b)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:59.212712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98ca56-eaa9-4ca2-92fc-01d121c0c867 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:59.215334 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 182/368] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:18:58 2022] GET /identity/v3/users/6d99ca34ab9a4587afd069c80fd2280b => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:59.216254 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98ca56-eaa9-4ca2-92fc-01d121c0c867 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:59.252415 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 187/369] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:18:59.253572 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a79c71-a99d-418e-b6f5-47eb85bdc972 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:59.355669 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98ca56-eaa9-4ca2-92fc-01d121c0c867 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:59.389611 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:59.400924 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a79c71-a99d-418e-b6f5-47eb85bdc972 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:59.419299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a17d3-2e66-40b0-9640-1adcebc4c4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:59.420705 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a17d3-2e66-40b0-9640-1adcebc4c4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:59.421139 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a17d3-2e66-40b0-9640-1adcebc4c4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:59.421423 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a17d3-2e66-40b0-9640-1adcebc4c4d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:59.422177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a17d3-2e66-40b0-9640-1adcebc4c4d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:59.422484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a17d3-2e66-40b0-9640-1adcebc4c4d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:59.423912 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a17d3-2e66-40b0-9640-1adcebc4c4d6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:59.434552 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 183/370] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:18:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:59.435390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a17d3-2e66-40b0-9640-1adcebc4c4d6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:59.456768 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2853811-087a-4af6-82ee-c404d960c4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:59.458147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2853811-087a-4af6-82ee-c404d960c4cd None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:59.458832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2853811-087a-4af6-82ee-c404d960c4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:59.459482 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2853811-087a-4af6-82ee-c404d960c4cd None admin] PATH_INFO: `/v3/groups/19f868c18e87475ab117486b3738a6ba` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:59.461510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2853811-087a-4af6-82ee-c404d960c4cd None admin] RBAC: Authorizing `identity:get_group(group_id=19f868c18e87475ab117486b3738a6ba)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:59.463353 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2853811-087a-4af6-82ee-c404d960c4cd None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:59.465625 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 188/371] 10.222.0.25 () {56 vars in 1180 bytes} [Mon May 23 12:18:59 2022] GET /identity/v3/groups/19f868c18e87475ab117486b3738a6ba => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:59.466845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2853811-087a-4af6-82ee-c404d960c4cd None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:59.482991 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:59.564830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a17d3-2e66-40b0-9640-1adcebc4c4d6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:59.588223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2853811-087a-4af6-82ee-c404d960c4cd None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:59.605309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a76c8-8017-4d6f-bd62-85d590cc5243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:59.605968 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a76c8-8017-4d6f-bd62-85d590cc5243 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:59.606253 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a76c8-8017-4d6f-bd62-85d590cc5243 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:59.606553 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a76c8-8017-4d6f-bd62-85d590cc5243 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:59.607747 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a76c8-8017-4d6f-bd62-85d590cc5243 None admin] RBAC: Adding query filter params (role.id=ee2f590e932841609deb8ed245e89ef4, user.id=6d99ca34ab9a4587afd069c80fd2280b, scope.system=all) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:59.608061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a76c8-8017-4d6f-bd62-85d590cc5243 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:59.610445 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a76c8-8017-4d6f-bd62-85d590cc5243 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:59.625813 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 184/372] 10.222.0.25 () {56 vars in 1308 bytes} [Mon May 23 12:18:59 2022] GET /identity/v3/role_assignments?user.id=6d99ca34ab9a4587afd069c80fd2280b&scope.system=all&role.id=ee2f590e932841609deb8ed245e89ef4 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:59.630764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a76c8-8017-4d6f-bd62-85d590cc5243 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:59.640104 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7f0b8-2cad-41be-8b50-8143c0bbf0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:59.642772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7f0b8-2cad-41be-8b50-8143c0bbf0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:59.646728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7f0b8-2cad-41be-8b50-8143c0bbf0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:59.647292 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7f0b8-2cad-41be-8b50-8143c0bbf0a4 None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:59.649067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7f0b8-2cad-41be-8b50-8143c0bbf0a4 None admin] RBAC: Authorizing `identity:get_project(project_id=087acb6a0d3945e7bc219b099d7a6037)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:59.651579 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7f0b8-2cad-41be-8b50-8143c0bbf0a4 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:59.657748 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 189/373] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:18:59 2022] GET /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:59.658984 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7f0b8-2cad-41be-8b50-8143c0bbf0a4 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:18:59.728233 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:59.833989 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:18:59.853270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a76c8-8017-4d6f-bd62-85d590cc5243 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:59.880768 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7f0b8-2cad-41be-8b50-8143c0bbf0a4 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:18:59.930691 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587e46e-2091-4587-b792-e2cb6d68ccef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:59.931417 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587e46e-2091-4587-b792-e2cb6d68ccef None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:59.931658 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587e46e-2091-4587-b792-e2cb6d68ccef None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:59.931936 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587e46e-2091-4587-b792-e2cb6d68ccef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:59.932590 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5ff66-d84c-44ff-b8a5-c54371be808d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:18:59.932762 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587e46e-2091-4587-b792-e2cb6d68ccef None admin] RBAC: Adding query filter params (group.id=19f868c18e87475ab117486b3738a6ba, role.id=3dac847973464a2cb123dc2c9083baf3, scope.project.id=087acb6a0d3945e7bc219b099d7a6037) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:18:59.933244 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587e46e-2091-4587-b792-e2cb6d68ccef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:18:59.933579 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5ff66-d84c-44ff-b8a5-c54371be808d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:18:59.934051 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5ff66-d84c-44ff-b8a5-c54371be808d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:18:59.934527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5ff66-d84c-44ff-b8a5-c54371be808d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:18:59.935733 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587e46e-2091-4587-b792-e2cb6d68ccef None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:18:59.942954 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 190/374] 10.222.0.25 () {56 vars in 1376 bytes} [Mon May 23 12:18:59 2022] GET /identity/v3/role_assignments?group.id=19f868c18e87475ab117486b3738a6ba&scope.project.id=087acb6a0d3945e7bc219b099d7a6037&role.id=3dac847973464a2cb123dc2c9083baf3 => generated 260 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:18:59.943955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587e46e-2091-4587-b792-e2cb6d68ccef None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:00.027895 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5ff66-d84c-44ff-b8a5-c54371be808d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:00.030000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5ff66-d84c-44ff-b8a5-c54371be808d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:00.083162 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:00.168753 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 185/375] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:18:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:19:00.174739 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5ff66-d84c-44ff-b8a5-c54371be808d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:00.243908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587e46e-2091-4587-b792-e2cb6d68ccef None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:00.297184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5ff66-d84c-44ff-b8a5-c54371be808d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:00.316496 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad90d1a-0a86-4d9a-94f5-87a2cd12758f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:00.317716 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad90d1a-0a86-4d9a-94f5-87a2cd12758f None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:00.318200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad90d1a-0a86-4d9a-94f5-87a2cd12758f None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:00.318678 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad90d1a-0a86-4d9a-94f5-87a2cd12758f None admin] PATH_INFO: `/v3/groups/19f868c18e87475ab117486b3738a6ba` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:00.321338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad90d1a-0a86-4d9a-94f5-87a2cd12758f None admin] RBAC: Authorizing `identity:get_group(group_id=19f868c18e87475ab117486b3738a6ba)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:00.323105 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad90d1a-0a86-4d9a-94f5-87a2cd12758f None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:00.325251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 191/376] 10.222.0.25 () {56 vars in 1180 bytes} [Mon May 23 12:18:59 2022] GET /identity/v3/groups/19f868c18e87475ab117486b3738a6ba => generated 226 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:00.340052 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad90d1a-0a86-4d9a-94f5-87a2cd12758f None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:00.346353 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821b224-bfff-4316-a3af-6fdb8b204e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:00.347261 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821b224-bfff-4316-a3af-6fdb8b204e14 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:00.347548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821b224-bfff-4316-a3af-6fdb8b204e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:00.347827 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821b224-bfff-4316-a3af-6fdb8b204e14 None admin] PATH_INFO: `/v3/projects/14be2fbaccef4510a5810ab627c88a01` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:00.349058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821b224-bfff-4316-a3af-6fdb8b204e14 None admin] RBAC: Authorizing `identity:get_project(project_id=14be2fbaccef4510a5810ab627c88a01)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:00.350686 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821b224-bfff-4316-a3af-6fdb8b204e14 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:00.354272 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 186/377] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:19:00 2022] GET /identity/v3/projects/14be2fbaccef4510a5810ab627c88a01 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:00.361290 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821b224-bfff-4316-a3af-6fdb8b204e14 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:00.362553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:00.390863 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:00.490351 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad90d1a-0a86-4d9a-94f5-87a2cd12758f None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:00.529978 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821b224-bfff-4316-a3af-6fdb8b204e14 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:00.536989 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ac1f1-ece4-43d7-a3e4-5afc49e46947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:00.537982 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ac1f1-ece4-43d7-a3e4-5afc49e46947 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:00.538572 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ac1f1-ece4-43d7-a3e4-5afc49e46947 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:00.539080 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ac1f1-ece4-43d7-a3e4-5afc49e46947 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:00.540117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ac1f1-ece4-43d7-a3e4-5afc49e46947 None admin] RBAC: Adding query filter params (group.id=19f868c18e87475ab117486b3738a6ba, role.id=d9ac3d950cc243aaa45c802dd5f3d844, scope.project.id=087acb6a0d3945e7bc219b099d7a6037) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:00.540640 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ac1f1-ece4-43d7-a3e4-5afc49e46947 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:00.543168 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ac1f1-ece4-43d7-a3e4-5afc49e46947 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:00.549488 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 192/378] 10.222.0.25 () {56 vars in 1376 bytes} [Mon May 23 12:19:00 2022] GET /identity/v3/role_assignments?group.id=19f868c18e87475ab117486b3738a6ba&scope.project.id=087acb6a0d3945e7bc219b099d7a6037&role.id=d9ac3d950cc243aaa45c802dd5f3d844 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:00.551027 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d251e01-e0dc-4415-b6f6-4a23bef217a1 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:00.551523 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d251e01-e0dc-4415-b6f6-4a23bef217a1 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:00.552010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d251e01-e0dc-4415-b6f6-4a23bef217a1 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:00.553549 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 193/379] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:00.560512 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b45c7-429b-4a57-a6fd-f9728bfed353 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:00.561045 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b45c7-429b-4a57-a6fd-f9728bfed353 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:00.561530 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b45c7-429b-4a57-a6fd-f9728bfed353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:00.573802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb0672-01bb-4da2-bcbb-b875eccd6f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:00.574811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb0672-01bb-4da2-bcbb-b875eccd6f95 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:00.575098 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb0672-01bb-4da2-bcbb-b875eccd6f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:00.575377 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb0672-01bb-4da2-bcbb-b875eccd6f95 None admin] PATH_INFO: `/v3/groups/68b9be7b901a45489d6103684816b481` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:00.582490 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb0672-01bb-4da2-bcbb-b875eccd6f95 None admin] RBAC: Authorizing `identity:get_group(group_id=68b9be7b901a45489d6103684816b481)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:00.584134 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb0672-01bb-4da2-bcbb-b875eccd6f95 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:00.584967 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-e58b45c7-429b-4a57-a6fd-f9728bfed353 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:00.586803 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 187/380] 10.222.0.25 () {56 vars in 1180 bytes} [Mon May 23 12:19:00 2022] GET /identity/v3/groups/68b9be7b901a45489d6103684816b481 => generated 229 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:00.587175 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e58b45c7-429b-4a57-a6fd-f9728bfed353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:00.592095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb0672-01bb-4da2-bcbb-b875eccd6f95 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:00.671012 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 194/381] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:00.672453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a5fb9-9da1-48d6-95ad-26bfd9299e70 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:00.672755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a5fb9-9da1-48d6-95ad-26bfd9299e70 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:00.673087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a5fb9-9da1-48d6-95ad-26bfd9299e70 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:00.678580 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 195/382] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:00.684085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd54468-374c-4755-8dfd-cdcc370f33c5 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:00.684262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd54468-374c-4755-8dfd-cdcc370f33c5 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:00.684460 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd54468-374c-4755-8dfd-cdcc370f33c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:00.694069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:00.697944 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:00.719260 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-6cd54468-374c-4755-8dfd-cdcc370f33c5 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:00.720156 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-6cd54468-374c-4755-8dfd-cdcc370f33c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:00.738777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb0672-01bb-4da2-bcbb-b875eccd6f95 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:00.784143 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b39e6-6023-4dc0-8c73-7ba1c73c24c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:00.784808 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b39e6-6023-4dc0-8c73-7ba1c73c24c9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:00.785091 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b39e6-6023-4dc0-8c73-7ba1c73c24c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:00.785366 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b39e6-6023-4dc0-8c73-7ba1c73c24c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:00.786212 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b39e6-6023-4dc0-8c73-7ba1c73c24c9 None admin] RBAC: Adding query filter params (group.id=68b9be7b901a45489d6103684816b481, role.id=3ae7c5e54e084ac4a1f94da93a667583, scope.project.id=14be2fbaccef4510a5810ab627c88a01) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:00.786607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b39e6-6023-4dc0-8c73-7ba1c73c24c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:00.788110 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b39e6-6023-4dc0-8c73-7ba1c73c24c9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:00.794659 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 188/383] 10.222.0.25 () {56 vars in 1376 bytes} [Mon May 23 12:19:00 2022] GET /identity/v3/role_assignments?group.id=68b9be7b901a45489d6103684816b481&scope.project.id=14be2fbaccef4510a5810ab627c88a01&role.id=3ae7c5e54e084ac4a1f94da93a667583 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:00.795509 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b39e6-6023-4dc0-8c73-7ba1c73c24c9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:00.827361 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 196/384] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:00.857961 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd54468-374c-4755-8dfd-cdcc370f33c5 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:00.965591 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b39e6-6023-4dc0-8c73-7ba1c73c24c9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:01.029160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd54468-374c-4755-8dfd-cdcc370f33c5 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:01.056689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a73af-96bd-49a8-9ce2-aa453e0f870b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:01.057565 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a73af-96bd-49a8-9ce2-aa453e0f870b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:01.057860 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a73af-96bd-49a8-9ce2-aa453e0f870b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:01.058138 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a73af-96bd-49a8-9ce2-aa453e0f870b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:01.066064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:01.083686 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a73af-96bd-49a8-9ce2-aa453e0f870b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:01.095118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-a98a73af-96bd-49a8-9ce2-aa453e0f870b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:19:01.095118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:01.095118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:01.095118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:01.095118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:01.095118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:01.095118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:01.095118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:01.095118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:01.095118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:01.095118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:01.095118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:01.095118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:01.095118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:01.095118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:01.095118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:01.096038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:01.096038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:01.096038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:01.096038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:01.096038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:01.096038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:01.096038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:01.096038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:01.096038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:01.096038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:01.096038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:01.096038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:01.096038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:01.096038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:01.096038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:01.096038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:01.096940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:01.096940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:01.096940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:01.096940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:01.096940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:01.096940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:01.096940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:01.096940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:01.096940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:01.096940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:01.096940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:19:01.096940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:01.098245 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 189/385] 10.222.0.25 () {56 vars in 1114 bytes} [Mon May 23 12:19:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:01.105201 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64669220-f40d-41ab-8dcc-c022d5f375b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:01.106412 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64669220-f40d-41ab-8dcc-c022d5f375b4 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:01.106876 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64669220-f40d-41ab-8dcc-c022d5f375b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:01.107291 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64669220-f40d-41ab-8dcc-c022d5f375b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:01.109571 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a73af-96bd-49a8-9ce2-aa453e0f870b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:01.112715 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:01.147163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64669220-f40d-41ab-8dcc-c022d5f375b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:01.156831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-64669220-f40d-41ab-8dcc-c022d5f375b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:19:01.156831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:01.156831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:01.156831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:01.156831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:01.156831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:01.156831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:01.156831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:01.156831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:01.156831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:01.156831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:01.156831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:01.156831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:01.156831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:01.156831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:01.156831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:01.157728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:01.157728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:01.157728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:01.157728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:01.157728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:01.157728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:01.157728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:01.157728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:01.157728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:01.157728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:01.157728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:01.157728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:01.157728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:01.157728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:01.157728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:01.157728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:01.158528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:01.158528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:01.158528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:01.158528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:01.158528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:01.158528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:01.158528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:01.158528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:01.158528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:01.158528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:01.158528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:19:01.158528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:01.158528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 197/386] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:19:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:01.164871 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64669220-f40d-41ab-8dcc-c022d5f375b4 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:01.293238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a73af-96bd-49a8-9ce2-aa453e0f870b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:01.329315 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b1a16-d82e-4335-aba9-8783fcffd48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:01.329987 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b1a16-d82e-4335-aba9-8783fcffd48c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:01.330276 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b1a16-d82e-4335-aba9-8783fcffd48c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:01.330584 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b1a16-d82e-4335-aba9-8783fcffd48c None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:01.331353 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b1a16-d82e-4335-aba9-8783fcffd48c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:01.331667 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b1a16-d82e-4335-aba9-8783fcffd48c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:01.333101 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b1a16-d82e-4335-aba9-8783fcffd48c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:01.344454 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 190/387] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:01.347270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64669220-f40d-41ab-8dcc-c022d5f375b4 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:01.356372 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b1a16-d82e-4335-aba9-8783fcffd48c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:01.436167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ccf77-d167-463a-9ed1-f3b7d5b12314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:01.436856 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ccf77-d167-463a-9ed1-f3b7d5b12314 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:01.437150 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ccf77-d167-463a-9ed1-f3b7d5b12314 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:01.437427 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ccf77-d167-463a-9ed1-f3b7d5b12314 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:01.438182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ccf77-d167-463a-9ed1-f3b7d5b12314 None admin] RBAC: Adding query filter params (name=member) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:01.438487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ccf77-d167-463a-9ed1-f3b7d5b12314 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:01.442785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ccf77-d167-463a-9ed1-f3b7d5b12314 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:01.449146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:01.459620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 198/388] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:19:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:01.474285 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ccf77-d167-463a-9ed1-f3b7d5b12314 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:01.527134 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b1a16-d82e-4335-aba9-8783fcffd48c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:01.554938 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:01.583420 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be993a1-d1c4-4f4e-b12a-eb83487a01d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:01.584292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be993a1-d1c4-4f4e-b12a-eb83487a01d3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:01.584581 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be993a1-d1c4-4f4e-b12a-eb83487a01d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:01.584862 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be993a1-d1c4-4f4e-b12a-eb83487a01d3 None admin] PATH_INFO: `/v3/groups/19f868c18e87475ab117486b3738a6ba` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:01.591360 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be993a1-d1c4-4f4e-b12a-eb83487a01d3 None admin] RBAC: Authorizing `identity:get_group(group_id=19f868c18e87475ab117486b3738a6ba)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:01.592757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be993a1-d1c4-4f4e-b12a-eb83487a01d3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:01.594821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 191/389] 10.222.0.25 () {56 vars in 1180 bytes} [Mon May 23 12:19:01 2022] GET /identity/v3/groups/19f868c18e87475ab117486b3738a6ba => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:01.600091 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be993a1-d1c4-4f4e-b12a-eb83487a01d3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:01.614588 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ccf77-d167-463a-9ed1-f3b7d5b12314 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:01.655182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19554d7c-3ae7-44fd-b261-baaef5bdb211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:01.656393 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19554d7c-3ae7-44fd-b261-baaef5bdb211 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:01.657247 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19554d7c-3ae7-44fd-b261-baaef5bdb211 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:01.658306 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19554d7c-3ae7-44fd-b261-baaef5bdb211 None admin] PATH_INFO: `/v3/groups/19f868c18e87475ab117486b3738a6ba` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:01.660754 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19554d7c-3ae7-44fd-b261-baaef5bdb211 None admin] RBAC: Authorizing `identity:get_group(group_id=19f868c18e87475ab117486b3738a6ba)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:01.669111 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19554d7c-3ae7-44fd-b261-baaef5bdb211 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:01.671464 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 199/390] 10.222.0.25 () {56 vars in 1180 bytes} [Mon May 23 12:19:01 2022] GET /identity/v3/groups/19f868c18e87475ab117486b3738a6ba => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:01.676883 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19554d7c-3ae7-44fd-b261-baaef5bdb211 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:01.766765 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be993a1-d1c4-4f4e-b12a-eb83487a01d3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:01.789868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19554d7c-3ae7-44fd-b261-baaef5bdb211 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:01.816376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:01.822555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:01.830363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc14cf-0ce8-4bb2-868d-029b490eb2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:01.831266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc14cf-0ce8-4bb2-868d-029b490eb2ea None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:01.831548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc14cf-0ce8-4bb2-868d-029b490eb2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:01.831825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc14cf-0ce8-4bb2-868d-029b490eb2ea None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:01.833014 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f900a-c427-4106-b972-ab9be7e2a759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:01.833870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f900a-c427-4106-b972-ab9be7e2a759 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:01.834157 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f900a-c427-4106-b972-ab9be7e2a759 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:01.834631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f900a-c427-4106-b972-ab9be7e2a759 None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:01.835877 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc14cf-0ce8-4bb2-868d-029b490eb2ea None admin] RBAC: Authorizing `identity:get_project(project_id=3fd6ed2a258c474293105ba1798cee00)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:01.836761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f900a-c427-4106-b972-ab9be7e2a759 None admin] RBAC: Authorizing `identity:get_project(project_id=3fd6ed2a258c474293105ba1798cee00)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:01.838240 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f900a-c427-4106-b972-ab9be7e2a759 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:01.839999 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 200/391] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:19:01 2022] GET /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:01.841371 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc14cf-0ce8-4bb2-868d-029b490eb2ea None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:01.843439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 192/392] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:19:01 2022] GET /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:01.850326 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc14cf-0ce8-4bb2-868d-029b490eb2ea None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:01.850448 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f900a-c427-4106-b972-ab9be7e2a759 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:02.030656 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc14cf-0ce8-4bb2-868d-029b490eb2ea None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:02.036248 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f900a-c427-4106-b972-ab9be7e2a759 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:02.097730 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9914e9-b6d0-44a4-9e90-f2a1ea12c35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:02.099564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9914e9-b6d0-44a4-9e90-f2a1ea12c35d None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:02.099856 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9914e9-b6d0-44a4-9e90-f2a1ea12c35d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:02.100139 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9914e9-b6d0-44a4-9e90-f2a1ea12c35d None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00/groups/19f868c18e87475ab117486b3738a6ba/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:02.102087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011a96a-c06a-4e00-849e-c162097e3ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:02.102935 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011a96a-c06a-4e00-849e-c162097e3ad3 None admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:02.103220 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011a96a-c06a-4e00-849e-c162097e3ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:02.103644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011a96a-c06a-4e00-849e-c162097e3ad3 None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00/groups/19f868c18e87475ab117486b3738a6ba/roles/d9ac3d950cc243aaa45c802dd5f3d844` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:02.105817 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9914e9-b6d0-44a4-9e90-f2a1ea12c35d None admin] RBAC: Authorizing `identity:create_grant(project_id=3fd6ed2a258c474293105ba1798cee00, group_id=19f868c18e87475ab117486b3738a6ba, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:02.107815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9914e9-b6d0-44a4-9e90-f2a1ea12c35d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:02.111126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011a96a-c06a-4e00-849e-c162097e3ad3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fd6ed2a258c474293105ba1798cee00, group_id=19f868c18e87475ab117486b3738a6ba, role_id=d9ac3d950cc243aaa45c802dd5f3d844)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:02.112557 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011a96a-c06a-4e00-849e-c162097e3ad3 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:02.135487 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 193/393] 10.222.0.25 () {58 vars in 1442 bytes} [Mon May 23 12:19:01 2022] PUT /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00/groups/19f868c18e87475ab117486b3738a6ba/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:19:02.138895 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 201/394] 10.222.0.25 () {58 vars in 1442 bytes} [Mon May 23 12:19:01 2022] PUT /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00/groups/19f868c18e87475ab117486b3738a6ba/roles/d9ac3d950cc243aaa45c802dd5f3d844 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:19:02.749834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83056f7e-11b8-49ec-9b85-e5da73b44330 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:02.750389 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83056f7e-11b8-49ec-9b85-e5da73b44330 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:02.750389 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83056f7e-11b8-49ec-9b85-e5da73b44330 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:02.752231 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 194/395] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:02.757655 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfcdd6-ef27-4a9f-9544-e51233e6a75d None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:02.758103 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfcdd6-ef27-4a9f-9544-e51233e6a75d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:02.758254 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfcdd6-ef27-4a9f-9544-e51233e6a75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:02.783660 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-b3bfcdd6-ef27-4a9f-9544-e51233e6a75d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:02.784870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-b3bfcdd6-ef27-4a9f-9544-e51233e6a75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:02.846279 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:02.873387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 202/396] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:02.907553 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83056f7e-11b8-49ec-9b85-e5da73b44330 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:02.993795 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:03.052896 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83056f7e-11b8-49ec-9b85-e5da73b44330 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:03.095384 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c7c04-7f9f-4e3a-85de-0962cdb91e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:03.096184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c7c04-7f9f-4e3a-85de-0962cdb91e2d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:03.096469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c7c04-7f9f-4e3a-85de-0962cdb91e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:03.096746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c7c04-7f9f-4e3a-85de-0962cdb91e2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:03.115446 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c7c04-7f9f-4e3a-85de-0962cdb91e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:03.123198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-f39c7c04-7f9f-4e3a-85de-0962cdb91e2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:19:03.123198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:03.123198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:03.123198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:03.123198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:03.123198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:03.123198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:03.123198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:03.123198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:03.123198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:03.123198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:03.123198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:03.123198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:03.123198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:03.123198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:03.123198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:03.124082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:03.124082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:03.124082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:03.124082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:03.124082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:03.124082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:03.124082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:03.124082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:03.124082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:03.124082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:03.124082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:03.124082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:03.124082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:03.124082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:03.124082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:03.124082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:03.124854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:03.124854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:03.124854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:03.124854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:03.124854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:03.124854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:03.124854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:03.124854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:03.124854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:03.124854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:03.124854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:19:03.124854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:03.128872 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 195/397] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:19:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:03.130179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfcdd6-ef27-4a9f-9544-e51233e6a75d None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:03.321169 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfcdd6-ef27-4a9f-9544-e51233e6a75d None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:03.371249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf8bc6-cc83-440d-8319-81bb8a7d9da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:03.371938 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf8bc6-cc83-440d-8319-81bb8a7d9da7 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:03.372226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf8bc6-cc83-440d-8319-81bb8a7d9da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:03.372505 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf8bc6-cc83-440d-8319-81bb8a7d9da7 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:03.373258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf8bc6-cc83-440d-8319-81bb8a7d9da7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:03.373561 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf8bc6-cc83-440d-8319-81bb8a7d9da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:03.374974 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf8bc6-cc83-440d-8319-81bb8a7d9da7 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:03.384232 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 203/398] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:19:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:03.389507 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c7c04-7f9f-4e3a-85de-0962cdb91e2d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:03.536488 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c7c04-7f9f-4e3a-85de-0962cdb91e2d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:03.555494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:03.586264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522846c-0f02-466c-a8c0-8d013898e288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:03.587082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522846c-0f02-466c-a8c0-8d013898e288 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:03.587369 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522846c-0f02-466c-a8c0-8d013898e288 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:03.587642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522846c-0f02-466c-a8c0-8d013898e288 None admin] PATH_INFO: `/v3/groups/19f868c18e87475ab117486b3738a6ba` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:03.588880 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522846c-0f02-466c-a8c0-8d013898e288 None admin] RBAC: Authorizing `identity:get_group(group_id=19f868c18e87475ab117486b3738a6ba)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:03.590338 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7522846c-0f02-466c-a8c0-8d013898e288 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:03.591973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 196/399] 10.222.0.25 () {56 vars in 1180 bytes} [Mon May 23 12:19:03 2022] GET /identity/v3/groups/19f868c18e87475ab117486b3738a6ba => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:03.597566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf8bc6-cc83-440d-8319-81bb8a7d9da7 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:03.654788 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3888c9-f1a9-4130-8379-fc5423d7bd2c None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:03.655101 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3888c9-f1a9-4130-8379-fc5423d7bd2c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:03.655350 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3888c9-f1a9-4130-8379-fc5423d7bd2c None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:03.656704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 197/400] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:03.656816 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:03.664684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535c9a6-4918-4182-8353-929cb217b62e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:03.664970 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535c9a6-4918-4182-8353-929cb217b62e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:03.665249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535c9a6-4918-4182-8353-929cb217b62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:03.696045 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f535c9a6-4918-4182-8353-929cb217b62e None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:03.697351 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f535c9a6-4918-4182-8353-929cb217b62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:03.719999 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf8bc6-cc83-440d-8319-81bb8a7d9da7 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:03.757076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094e34c-a176-43cc-9854-66fb9184d2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:03.758146 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094e34c-a176-43cc-9854-66fb9184d2ed None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:03.759142 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094e34c-a176-43cc-9854-66fb9184d2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:03.759564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094e34c-a176-43cc-9854-66fb9184d2ed None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:03.760905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094e34c-a176-43cc-9854-66fb9184d2ed None admin] RBAC: Authorizing `identity:get_project(project_id=087acb6a0d3945e7bc219b099d7a6037)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:03.762486 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094e34c-a176-43cc-9854-66fb9184d2ed None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:03.764711 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 204/401] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:19:03 2022] GET /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:03.765913 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01709d2-cf0d-4e11-9bc4-3d65afd0e225 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:03.766199 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01709d2-cf0d-4e11-9bc4-3d65afd0e225 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:03.766474 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01709d2-cf0d-4e11-9bc4-3d65afd0e225 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:03.777037 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 205/402] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:03.777037 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01709d2-cf0d-4e11-9bc4-3d65afd0e225 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:03.814523 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 198/403] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:19:03.814523 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03d5f5-2608-4821-9a09-4de5c08dd45b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:03.814523 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03d5f5-2608-4821-9a09-4de5c08dd45b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:03.814523 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03d5f5-2608-4821-9a09-4de5c08dd45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:03.839323 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2b03d5f5-2608-4821-9a09-4de5c08dd45b None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:03.840834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2b03d5f5-2608-4821-9a09-4de5c08dd45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:03.917590 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01709d2-cf0d-4e11-9bc4-3d65afd0e225 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:03.931393 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:03.934628 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 199/404] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:03.935734 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03d5f5-2608-4821-9a09-4de5c08dd45b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:03.966186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72178183-160a-4c7a-bb19-25b3f67c63e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:03.967131 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72178183-160a-4c7a-bb19-25b3f67c63e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:03.967422 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72178183-160a-4c7a-bb19-25b3f67c63e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:03.967807 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72178183-160a-4c7a-bb19-25b3f67c63e5 None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037/groups/19f868c18e87475ab117486b3738a6ba/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:03.969893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72178183-160a-4c7a-bb19-25b3f67c63e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=087acb6a0d3945e7bc219b099d7a6037, group_id=19f868c18e87475ab117486b3738a6ba, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:03.971386 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72178183-160a-4c7a-bb19-25b3f67c63e5 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:03.991112 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 206/405] 10.222.0.25 () {58 vars in 1442 bytes} [Mon May 23 12:19:03 2022] PUT /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037/groups/19f868c18e87475ab117486b3738a6ba/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:19:03.998531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72178183-160a-4c7a-bb19-25b3f67c63e5 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:04.006513 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:04.083778 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03d5f5-2608-4821-9a09-4de5c08dd45b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:04.127298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c08d9-ab90-4132-b59d-f87cccb71876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:04.128161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c08d9-ab90-4132-b59d-f87cccb71876 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:04.128451 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c08d9-ab90-4132-b59d-f87cccb71876 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:04.128785 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c08d9-ab90-4132-b59d-f87cccb71876 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:04.142337 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c08d9-ab90-4132-b59d-f87cccb71876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:04.151317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-c42c08d9-ab90-4132-b59d-f87cccb71876 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:19:04.151317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:04.151317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:04.151317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:04.151317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:04.151317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:04.151317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:04.151317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:04.151317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:04.151317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:04.151317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:04.151317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:04.151317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:04.151317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:04.151317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:04.151317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:04.152271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:04.152271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:04.152271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:04.152271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:04.152271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:04.152271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:04.152271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:04.152271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:04.152271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:04.152271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:04.152271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:04.152271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:04.152271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:04.152271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:04.152271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:04.152271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:04.153061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:04.153061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:04.153061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:04.153061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:04.153061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:04.153061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:04.153061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:04.153061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:04.153061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:04.153061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:04.153061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:19:04.153061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:04.153061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 200/406] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:19:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:04.159080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c08d9-ab90-4132-b59d-f87cccb71876 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:04.301042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c08d9-ab90-4132-b59d-f87cccb71876 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:04.302659 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:04.315467 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72178183-160a-4c7a-bb19-25b3f67c63e5 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:04.351961 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522b0c3-50ea-4f16-9646-d85b167cdf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:04.352735 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522b0c3-50ea-4f16-9646-d85b167cdf48 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:04.352845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84a9df-5846-4ef6-9b11-55268090f5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:04.353021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522b0c3-50ea-4f16-9646-d85b167cdf48 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:04.353295 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522b0c3-50ea-4f16-9646-d85b167cdf48 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:04.353613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84a9df-5846-4ef6-9b11-55268090f5dd None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:04.354012 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84a9df-5846-4ef6-9b11-55268090f5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:04.354130 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522b0c3-50ea-4f16-9646-d85b167cdf48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:04.354291 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84a9df-5846-4ef6-9b11-55268090f5dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:04.354381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522b0c3-50ea-4f16-9646-d85b167cdf48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:04.355976 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522b0c3-50ea-4f16-9646-d85b167cdf48 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:04.366853 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84a9df-5846-4ef6-9b11-55268090f5dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:04.372032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 201/407] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:19:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:04.373306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522b0c3-50ea-4f16-9646-d85b167cdf48 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:04.374988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-9e84a9df-5846-4ef6-9b11-55268090f5dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:19:04.374988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:04.374988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:04.374988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:04.374988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:04.374988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:04.374988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:04.374988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:04.374988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:04.374988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:04.374988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:04.374988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:04.374988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:04.374988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:04.374988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:04.374988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:04.375859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:04.375859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:04.375859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:04.375859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:04.375859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:04.375859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:04.375859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:04.375859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:04.375859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:04.375859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:04.375859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:04.375859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:04.375859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:04.375859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:04.375859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:04.375859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:04.376647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:04.376647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:04.376647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:04.376647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:04.376647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:04.376647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:04.376647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:04.376647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:04.376647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:04.376647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:04.376647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:19:04.376647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:04.376647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 207/408] 10.222.0.25 () {56 vars in 1114 bytes} [Mon May 23 12:19:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:04.382066 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84a9df-5846-4ef6-9b11-55268090f5dd None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:04.426870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:04.502993 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84a9df-5846-4ef6-9b11-55268090f5dd None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:04.509053 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522b0c3-50ea-4f16-9646-d85b167cdf48 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:04.540624 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2195faa-4bfc-4f7f-9546-6e44ed102179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:04.541913 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2195faa-4bfc-4f7f-9546-6e44ed102179 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:04.542405 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2195faa-4bfc-4f7f-9546-6e44ed102179 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:04.542935 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2195faa-4bfc-4f7f-9546-6e44ed102179 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:04.543923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2195faa-4bfc-4f7f-9546-6e44ed102179 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:04.544437 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2195faa-4bfc-4f7f-9546-6e44ed102179 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:04.546050 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2195faa-4bfc-4f7f-9546-6e44ed102179 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:04.554934 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc154b35-7ecd-48a2-a132-97fe33d058d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:04.555801 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc154b35-7ecd-48a2-a132-97fe33d058d4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:04.556084 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc154b35-7ecd-48a2-a132-97fe33d058d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:04.556357 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc154b35-7ecd-48a2-a132-97fe33d058d4 None admin] PATH_INFO: `/v3/groups/68b9be7b901a45489d6103684816b481` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:04.556674 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 208/409] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:04.561321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc154b35-7ecd-48a2-a132-97fe33d058d4 None admin] RBAC: Authorizing `identity:get_group(group_id=68b9be7b901a45489d6103684816b481)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:04.561321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc154b35-7ecd-48a2-a132-97fe33d058d4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:04.561321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 202/410] 10.222.0.25 () {56 vars in 1180 bytes} [Mon May 23 12:19:04 2022] GET /identity/v3/groups/68b9be7b901a45489d6103684816b481 => generated 229 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:04.562725 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2195faa-4bfc-4f7f-9546-6e44ed102179 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:04.566295 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc154b35-7ecd-48a2-a132-97fe33d058d4 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:04.606070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:04.694031 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc154b35-7ecd-48a2-a132-97fe33d058d4 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:04.734491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c616eda-bb29-442e-b795-d576e798c10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:04.735384 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616eda-bb29-442e-b795-d576e798c10a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:04.735670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616eda-bb29-442e-b795-d576e798c10a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:04.735949 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616eda-bb29-442e-b795-d576e798c10a None admin] PATH_INFO: `/v3/projects/14be2fbaccef4510a5810ab627c88a01` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:04.737555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c616eda-bb29-442e-b795-d576e798c10a None admin] RBAC: Authorizing `identity:get_project(project_id=14be2fbaccef4510a5810ab627c88a01)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:04.739207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c616eda-bb29-442e-b795-d576e798c10a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:04.741065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 203/411] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:19:04 2022] GET /identity/v3/projects/14be2fbaccef4510a5810ab627c88a01 => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:04.748031 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c616eda-bb29-442e-b795-d576e798c10a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:04.779451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:04.790354 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2195faa-4bfc-4f7f-9546-6e44ed102179 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:04.844016 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69a8dd-9cce-41ae-9266-57de26f500f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:04.844886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69a8dd-9cce-41ae-9266-57de26f500f5 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:04.845175 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69a8dd-9cce-41ae-9266-57de26f500f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:04.846000 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69a8dd-9cce-41ae-9266-57de26f500f5 None admin] PATH_INFO: `/v3/groups/19f868c18e87475ab117486b3738a6ba` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:04.847279 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69a8dd-9cce-41ae-9266-57de26f500f5 None admin] RBAC: Authorizing `identity:get_group(group_id=19f868c18e87475ab117486b3738a6ba)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:04.849612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69a8dd-9cce-41ae-9266-57de26f500f5 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:04.852112 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 209/412] 10.222.0.25 () {56 vars in 1180 bytes} [Mon May 23 12:19:04 2022] GET /identity/v3/groups/19f868c18e87475ab117486b3738a6ba => generated 226 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:04.854341 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f876a1-9c01-4ab8-a295-d58d9c0238da None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:04.854925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f876a1-9c01-4ab8-a295-d58d9c0238da None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:04.855209 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f876a1-9c01-4ab8-a295-d58d9c0238da None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:04.857606 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 210/413] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:04.858812 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f876a1-9c01-4ab8-a295-d58d9c0238da None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:04.874702 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:04.877842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c616eda-bb29-442e-b795-d576e798c10a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:04.915854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b60f2e-b140-410e-9950-dfe3ec22c294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:04.916747 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b60f2e-b140-410e-9950-dfe3ec22c294 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:04.917079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b60f2e-b140-410e-9950-dfe3ec22c294 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:04.917359 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b60f2e-b140-410e-9950-dfe3ec22c294 None admin] PATH_INFO: `/v3/projects/14be2fbaccef4510a5810ab627c88a01/groups/68b9be7b901a45489d6103684816b481/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:04.919464 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b60f2e-b140-410e-9950-dfe3ec22c294 None admin] RBAC: Authorizing `identity:create_grant(project_id=14be2fbaccef4510a5810ab627c88a01, group_id=68b9be7b901a45489d6103684816b481, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:04.920985 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b60f2e-b140-410e-9950-dfe3ec22c294 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:04.937248 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 204/414] 10.222.0.25 () {58 vars in 1442 bytes} [Mon May 23 12:19:04 2022] PUT /identity/v3/projects/14be2fbaccef4510a5810ab627c88a01/groups/68b9be7b901a45489d6103684816b481/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:19:04.938550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8101842-3979-42c1-a6d2-a864f5b12d48 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:04.938849 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8101842-3979-42c1-a6d2-a864f5b12d48 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:04.939132 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8101842-3979-42c1-a6d2-a864f5b12d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:04.980340 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a8101842-3979-42c1-a6d2-a864f5b12d48 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:04.981689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a8101842-3979-42c1-a6d2-a864f5b12d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:05.012199 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f876a1-9c01-4ab8-a295-d58d9c0238da None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:05.059665 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f13662-c358-43bc-a735-1b5d352f1f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:05.060553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f13662-c358-43bc-a735-1b5d352f1f64 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:05.060842 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f13662-c358-43bc-a735-1b5d352f1f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:05.061123 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f13662-c358-43bc-a735-1b5d352f1f64 None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:05.062429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f13662-c358-43bc-a735-1b5d352f1f64 None admin] RBAC: Authorizing `identity:get_project(project_id=087acb6a0d3945e7bc219b099d7a6037)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:05.063958 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f13662-c358-43bc-a735-1b5d352f1f64 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:05.065696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 211/415] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:19:04 2022] GET /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:05.067013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fb204-d91d-48b3-8645-1e2af84b4e5f None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:05.067310 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fb204-d91d-48b3-8645-1e2af84b4e5f None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:05.067591 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fb204-d91d-48b3-8645-1e2af84b4e5f None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:05.069071 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 212/416] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:05.073724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fb204-d91d-48b3-8645-1e2af84b4e5f None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:05.079429 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 205/417] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:05.086777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2e231-d43b-49a2-8062-4dbe6b9f1a98 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:05.087197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2e231-d43b-49a2-8062-4dbe6b9f1a98 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:05.087518 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2e231-d43b-49a2-8062-4dbe6b9f1a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:05.114156 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:05.128365 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f3f2e231-d43b-49a2-8062-4dbe6b9f1a98 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:05.129713 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f3f2e231-d43b-49a2-8062-4dbe6b9f1a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:05.206895 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fb204-d91d-48b3-8645-1e2af84b4e5f None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:05.217654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 206/418] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:05.219232 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2e231-d43b-49a2-8062-4dbe6b9f1a98 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:05.256809 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:05.260305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f96ae7-a531-4a63-b748-e098503d8f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:05.261298 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f96ae7-a531-4a63-b748-e098503d8f0b None admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:05.261690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f96ae7-a531-4a63-b748-e098503d8f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:05.262408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f96ae7-a531-4a63-b748-e098503d8f0b None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037/groups/19f868c18e87475ab117486b3738a6ba/roles/d9ac3d950cc243aaa45c802dd5f3d844` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:05.266481 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f96ae7-a531-4a63-b748-e098503d8f0b None admin] RBAC: Authorizing `identity:create_grant(project_id=087acb6a0d3945e7bc219b099d7a6037, group_id=19f868c18e87475ab117486b3738a6ba, role_id=d9ac3d950cc243aaa45c802dd5f3d844)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:05.269335 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f96ae7-a531-4a63-b748-e098503d8f0b None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:05.286941 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 213/419] 10.222.0.25 () {58 vars in 1442 bytes} [Mon May 23 12:19:05 2022] PUT /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037/groups/19f868c18e87475ab117486b3738a6ba/roles/d9ac3d950cc243aaa45c802dd5f3d844 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:19:05.288374 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f96ae7-a531-4a63-b748-e098503d8f0b None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:05.406913 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:05.408512 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2e231-d43b-49a2-8062-4dbe6b9f1a98 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:05.418002 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f96ae7-a531-4a63-b748-e098503d8f0b None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:05.457892 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4597c-c900-4911-968f-f6b635f32397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:05.458863 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4597c-c900-4911-968f-f6b635f32397 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:05.459219 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4597c-c900-4911-968f-f6b635f32397 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:05.459743 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4597c-c900-4911-968f-f6b635f32397 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:05.473827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4597c-c900-4911-968f-f6b635f32397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:05.482920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-74c4597c-c900-4911-968f-f6b635f32397 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:19:05.482920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:05.482920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:05.482920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:05.482920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:05.482920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:05.482920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:05.482920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:05.482920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:05.482920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:05.482920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:05.482920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:05.482920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:05.482920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:05.482920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:05.482920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:05.484165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:05.484165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:05.484165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:05.484165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:05.484165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:05.484165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:05.484165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:05.484165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:05.484165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:05.484165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:05.484165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:05.484165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:05.484165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:05.484165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:05.484165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:05.484165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:05.485034 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:05.485034 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:05.485034 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:05.485034 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:05.485034 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:05.485034 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:05.485034 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:05.485034 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:05.485034 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:05.485034 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:05.485034 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:19:05.485034 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:05.485034 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 214/420] 10.222.0.25 () {56 vars in 1114 bytes} [Mon May 23 12:19:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:05.491030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4597c-c900-4911-968f-f6b635f32397 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:05.509978 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57661d72-54b1-4d86-9ac7-ba4217c4aa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:05.511204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57661d72-54b1-4d86-9ac7-ba4217c4aa57 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:05.511670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57661d72-54b1-4d86-9ac7-ba4217c4aa57 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:05.512126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57661d72-54b1-4d86-9ac7-ba4217c4aa57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:05.524481 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57661d72-54b1-4d86-9ac7-ba4217c4aa57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:05.533244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-57661d72-54b1-4d86-9ac7-ba4217c4aa57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:19:05.533244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:05.533244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:05.533244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:05.533244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:05.533244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:05.533244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:05.533244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:05.533244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:05.533244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:05.533244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:05.533244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:05.533244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:05.533244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:05.533244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:05.533244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:05.534148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:05.534148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:05.534148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:05.534148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:05.534148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:05.534148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:05.534148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:05.534148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:05.534148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:05.534148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:05.534148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:05.534148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:05.534148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:05.534148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:05.534148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:05.534148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:05.534972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:05.534972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:05.534972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:05.534972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:05.534972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:05.534972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:05.534972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:05.534972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:05.534972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:05.534972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:05.534972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:19:05.534972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:05.537370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 207/421] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:19:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:05.543378 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57661d72-54b1-4d86-9ac7-ba4217c4aa57 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:05.605783 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4597c-c900-4911-968f-f6b635f32397 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:05.646185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928fab5-b31a-4417-9d0a-2c31bf645619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:05.646997 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:05.648562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928fab5-b31a-4417-9d0a-2c31bf645619 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:05.649104 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928fab5-b31a-4417-9d0a-2c31bf645619 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:05.649577 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928fab5-b31a-4417-9d0a-2c31bf645619 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:05.650524 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928fab5-b31a-4417-9d0a-2c31bf645619 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:05.651029 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928fab5-b31a-4417-9d0a-2c31bf645619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:05.652655 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928fab5-b31a-4417-9d0a-2c31bf645619 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:05.661723 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 215/422] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:05.670321 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928fab5-b31a-4417-9d0a-2c31bf645619 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:05.684661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57661d72-54b1-4d86-9ac7-ba4217c4aa57 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:05.693006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:05.724897 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f0ca0-be90-4899-9b72-adba448457fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:05.725986 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f0ca0-be90-4899-9b72-adba448457fd None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:05.727048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f0ca0-be90-4899-9b72-adba448457fd None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:05.727521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f0ca0-be90-4899-9b72-adba448457fd None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:05.728474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f0ca0-be90-4899-9b72-adba448457fd None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:05.729051 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f0ca0-be90-4899-9b72-adba448457fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:05.730758 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f0ca0-be90-4899-9b72-adba448457fd None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:05.747411 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 208/423] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:19:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:05.754630 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f0ca0-be90-4899-9b72-adba448457fd None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:05.798522 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928fab5-b31a-4417-9d0a-2c31bf645619 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:05.833582 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb8b6b-3f6e-46c3-a5c7-b6e6255f135c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:05.834244 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb8b6b-3f6e-46c3-a5c7-b6e6255f135c None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:05.834655 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb8b6b-3f6e-46c3-a5c7-b6e6255f135c None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:05.834953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb8b6b-3f6e-46c3-a5c7-b6e6255f135c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:05.908046 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb8b6b-3f6e-46c3-a5c7-b6e6255f135c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:05.909722 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb8b6b-3f6e-46c3-a5c7-b6e6255f135c None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:05.926942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:06.018318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 216/424] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:19:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 12:19:06.023691 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb8b6b-3f6e-46c3-a5c7-b6e6255f135c None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:06.124450 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f0ca0-be90-4899-9b72-adba448457fd None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:06.136847 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb8b6b-3f6e-46c3-a5c7-b6e6255f135c None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:06.154971 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:06.176548 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd03488-a31e-4578-a225-d307f8cb3bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:06.177549 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd03488-a31e-4578-a225-d307f8cb3bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:06.177941 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd03488-a31e-4578-a225-d307f8cb3bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:06.178322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd03488-a31e-4578-a225-d307f8cb3bf9 None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:06.180259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd03488-a31e-4578-a225-d307f8cb3bf9 None admin] RBAC: Authorizing `identity:get_project(project_id=3fd6ed2a258c474293105ba1798cee00)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:06.185530 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd03488-a31e-4578-a225-d307f8cb3bf9 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:06.187973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 217/425] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:19:06 2022] GET /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:06.192880 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd03488-a31e-4578-a225-d307f8cb3bf9 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:06.221457 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ce0d3-40ca-4166-ae84-aa4d6d59f01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:06.222126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ce0d3-40ca-4166-ae84-aa4d6d59f01b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:06.222415 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ce0d3-40ca-4166-ae84-aa4d6d59f01b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:06.222722 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ce0d3-40ca-4166-ae84-aa4d6d59f01b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:06.263122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:06.361937 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd03488-a31e-4578-a225-d307f8cb3bf9 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:06.387690 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ce0d3-40ca-4166-ae84-aa4d6d59f01b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:06.389474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ce0d3-40ca-4166-ae84-aa4d6d59f01b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:06.400744 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741965c6-a786-4425-98c4-d540ca21819b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:06.401606 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741965c6-a786-4425-98c4-d540ca21819b None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:06.401896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741965c6-a786-4425-98c4-d540ca21819b None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:06.402177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741965c6-a786-4425-98c4-d540ca21819b None admin] PATH_INFO: `/v3/groups/19f868c18e87475ab117486b3738a6ba` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:06.403405 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741965c6-a786-4425-98c4-d540ca21819b None admin] RBAC: Authorizing `identity:get_group(group_id=19f868c18e87475ab117486b3738a6ba)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:06.404941 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741965c6-a786-4425-98c4-d540ca21819b None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:06.414523 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 218/426] 10.222.0.25 () {56 vars in 1180 bytes} [Mon May 23 12:19:06 2022] GET /identity/v3/groups/19f868c18e87475ab117486b3738a6ba => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:06.414523 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741965c6-a786-4425-98c4-d540ca21819b None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:06.475907 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:06.541013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741965c6-a786-4425-98c4-d540ca21819b None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:06.601913 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 209/427] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:19:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 848 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:19:06.604672 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd98efe-cf58-4ab1-865d-419cf729bc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:06.605488 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd98efe-cf58-4ab1-865d-419cf729bc31 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:06.605939 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd98efe-cf58-4ab1-865d-419cf729bc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:06.606354 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd98efe-cf58-4ab1-865d-419cf729bc31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:06.607346 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd98efe-cf58-4ab1-865d-419cf729bc31 None admin] RBAC: Adding query filter params (group.id=19f868c18e87475ab117486b3738a6ba, role.id=d9ac3d950cc243aaa45c802dd5f3d844, scope.project.id=3fd6ed2a258c474293105ba1798cee00) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:06.608572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ce0d3-40ca-4166-ae84-aa4d6d59f01b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:06.609030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd98efe-cf58-4ab1-865d-419cf729bc31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:06.610647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd98efe-cf58-4ab1-865d-419cf729bc31 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:06.623637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 219/428] 10.222.0.25 () {56 vars in 1376 bytes} [Mon May 23 12:19:06 2022] GET /identity/v3/role_assignments?group.id=19f868c18e87475ab117486b3738a6ba&scope.project.id=3fd6ed2a258c474293105ba1798cee00&role.id=d9ac3d950cc243aaa45c802dd5f3d844 => generated 611 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:06.683035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:06.778945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ce0d3-40ca-4166-ae84-aa4d6d59f01b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:06.825153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d028cca-5933-4e83-8983-72c507b385f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:06.826032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d028cca-5933-4e83-8983-72c507b385f6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:06.826315 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d028cca-5933-4e83-8983-72c507b385f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:06.826606 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d028cca-5933-4e83-8983-72c507b385f6 None admin] PATH_INFO: `/v3/projects/3fd6ed2a258c474293105ba1798cee00` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:06.827998 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d028cca-5933-4e83-8983-72c507b385f6 None admin] RBAC: Authorizing `identity:get_project(project_id=3fd6ed2a258c474293105ba1798cee00)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:06.829498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d028cca-5933-4e83-8983-72c507b385f6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:06.831243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 210/429] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:19:06 2022] GET /identity/v3/projects/3fd6ed2a258c474293105ba1798cee00 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:06.837110 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd98efe-cf58-4ab1-865d-419cf729bc31 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:06.961932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd98efe-cf58-4ab1-865d-419cf729bc31 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:06.970738 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073ab08-fdcb-4bb1-9f46-3ea6decddbc0 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:06.971031 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073ab08-fdcb-4bb1-9f46-3ea6decddbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:06.971306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073ab08-fdcb-4bb1-9f46-3ea6decddbc0 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:06.972866 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 211/430] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:06.979341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f50dce-5bda-496d-bf41-7588eda43628 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:06.980021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f50dce-5bda-496d-bf41-7588eda43628 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:06.980495 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f50dce-5bda-496d-bf41-7588eda43628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:06.983707 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:07.004490 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c0f50dce-5bda-496d-bf41-7588eda43628 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:07.006047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c0f50dce-5bda-496d-bf41-7588eda43628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:07.010315 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65507185-3acb-4408-b473-f2a27e9c338b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:07.011484 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65507185-3acb-4408-b473-f2a27e9c338b None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:07.011484 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65507185-3acb-4408-b473-f2a27e9c338b None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:07.011776 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65507185-3acb-4408-b473-f2a27e9c338b None admin] PATH_INFO: `/v3/groups/19f868c18e87475ab117486b3738a6ba` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:07.012937 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65507185-3acb-4408-b473-f2a27e9c338b None admin] RBAC: Authorizing `identity:get_group(group_id=19f868c18e87475ab117486b3738a6ba)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:07.014390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65507185-3acb-4408-b473-f2a27e9c338b None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:07.016386 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 220/431] 10.222.0.25 () {56 vars in 1180 bytes} [Mon May 23 12:19:06 2022] GET /identity/v3/groups/19f868c18e87475ab117486b3738a6ba => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:07.023907 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65507185-3acb-4408-b473-f2a27e9c338b None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:07.118573 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 212/432] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:19:07.142429 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f50dce-5bda-496d-bf41-7588eda43628 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:07.151396 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65507185-3acb-4408-b473-f2a27e9c338b None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:07.191134 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:07.199891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32117203-e6cb-4b8a-aaa8-d2cc22b918f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:07.201086 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32117203-e6cb-4b8a-aaa8-d2cc22b918f6 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:07.201951 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32117203-e6cb-4b8a-aaa8-d2cc22b918f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:07.202425 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32117203-e6cb-4b8a-aaa8-d2cc22b918f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:07.203478 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32117203-e6cb-4b8a-aaa8-d2cc22b918f6 None admin] RBAC: Adding query filter params (group.id=19f868c18e87475ab117486b3738a6ba, role.id=3dac847973464a2cb123dc2c9083baf3, scope.project.id=3fd6ed2a258c474293105ba1798cee00) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:07.204026 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32117203-e6cb-4b8a-aaa8-d2cc22b918f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:07.206603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32117203-e6cb-4b8a-aaa8-d2cc22b918f6 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:07.216443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 221/433] 10.222.0.25 () {56 vars in 1376 bytes} [Mon May 23 12:19:07 2022] GET /identity/v3/role_assignments?group.id=19f868c18e87475ab117486b3738a6ba&scope.project.id=3fd6ed2a258c474293105ba1798cee00&role.id=3dac847973464a2cb123dc2c9083baf3 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:07.270782 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f50dce-5bda-496d-bf41-7588eda43628 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:07.311861 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921ed48-b4b8-4921-875f-6e643cbb4b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:07.312675 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921ed48-b4b8-4921-875f-6e643cbb4b72 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:07.313026 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921ed48-b4b8-4921-875f-6e643cbb4b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:07.313305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921ed48-b4b8-4921-875f-6e643cbb4b72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:07.326329 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921ed48-b4b8-4921-875f-6e643cbb4b72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:07.334392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-1921ed48-b4b8-4921-875f-6e643cbb4b72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 12:19:07.334392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:07.334392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:07.334392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:07.334392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:07.334392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:07.334392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:07.334392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:07.334392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:07.334392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:07.334392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:07.334392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:07.334392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:07.334392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:07.334392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:07.334392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:07.335346 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:07.335346 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:07.335346 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:07.335346 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:07.335346 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:07.335346 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:07.335346 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:07.335346 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:07.335346 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:07.335346 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:07.335346 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:07.335346 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:07.335346 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:07.335346 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:07.335346 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:07.335346 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:07.336177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:07.336177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:07.336177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:07.336177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:07.336177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:07.336177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:07.336177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:07.336177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:07.336177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:07.336177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:07.336177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 12:19:07.336177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:07.336177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 213/434] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:19:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:07.343372 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32117203-e6cb-4b8a-aaa8-d2cc22b918f6 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:07.396762 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:07.457107 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32117203-e6cb-4b8a-aaa8-d2cc22b918f6 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:07.492903 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc175f-3d9d-49fb-92b3-79f1eccdde1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:07.493503 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc175f-3d9d-49fb-92b3-79f1eccdde1c None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:07.493790 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc175f-3d9d-49fb-92b3-79f1eccdde1c None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:07.494065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc175f-3d9d-49fb-92b3-79f1eccdde1c None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:07.494881 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc175f-3d9d-49fb-92b3-79f1eccdde1c None admin] RBAC: Adding query filter params (name=member) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:07.495187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc175f-3d9d-49fb-92b3-79f1eccdde1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:07.496573 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc175f-3d9d-49fb-92b3-79f1eccdde1c None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:07.505580 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 222/435] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:19:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:07.511105 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921ed48-b4b8-4921-875f-6e643cbb4b72 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:07.611998 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af186a-112a-46a8-8e9c-ce20ea44d479 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:07.612421 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af186a-112a-46a8-8e9c-ce20ea44d479 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:07.612846 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af186a-112a-46a8-8e9c-ce20ea44d479 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:07.616063 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 223/436] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:19:07.620281 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b533f-a08f-4976-9096-68a00b255238 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:07.620581 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b533f-a08f-4976-9096-68a00b255238 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:07.620871 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b533f-a08f-4976-9096-68a00b255238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:07.621248 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:07.624108 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921ed48-b4b8-4921-875f-6e643cbb4b72 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:07.640630 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-3c6b533f-a08f-4976-9096-68a00b255238 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:07.642058 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-3c6b533f-a08f-4976-9096-68a00b255238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:07.662830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40be47-5bdb-4c60-8b3b-2d2cf39009ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:07.663599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40be47-5bdb-4c60-8b3b-2d2cf39009ed None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:07.663846 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40be47-5bdb-4c60-8b3b-2d2cf39009ed None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:07.664133 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40be47-5bdb-4c60-8b3b-2d2cf39009ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:07.738107 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 224/437] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:19:07.749085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40be47-5bdb-4c60-8b3b-2d2cf39009ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:07.750482 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40be47-5bdb-4c60-8b3b-2d2cf39009ed None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:07.761906 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b533f-a08f-4976-9096-68a00b255238 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:07.807362 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:07.869607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:07.875366 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 214/438] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:19:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:19:07.877859 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad7897-3d3b-41c7-9024-257a75d5b046 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:07.878300 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad7897-3d3b-41c7-9024-257a75d5b046 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:07.878914 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad7897-3d3b-41c7-9024-257a75d5b046 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:07.880354 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 215/439] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:07.881122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad7897-3d3b-41c7-9024-257a75d5b046 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:07.895405 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b533f-a08f-4976-9096-68a00b255238 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:07.932958 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d809ceb-3fda-4fec-81aa-c2408911f1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:07.933747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d809ceb-3fda-4fec-81aa-c2408911f1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:07.934034 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d809ceb-3fda-4fec-81aa-c2408911f1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:07.934307 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d809ceb-3fda-4fec-81aa-c2408911f1f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:07.944411 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d809ceb-3fda-4fec-81aa-c2408911f1f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:07.951973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-8d809ceb-3fda-4fec-81aa-c2408911f1f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:19:07.951973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:07.951973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:07.951973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:07.951973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:07.951973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:07.951973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:07.951973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:07.951973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:07.951973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:07.951973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:07.951973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:07.951973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:07.951973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:07.951973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:07.951973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:07.952834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:07.952834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:07.952834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:07.952834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:07.952834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:07.952834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:07.952834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:07.952834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:07.952834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:07.952834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:07.952834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:07.952834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:07.952834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:07.952834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:07.952834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:07.952834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:07.953641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:07.953641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:07.953641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:07.953641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:07.953641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:07.953641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:07.953641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:07.953641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:07.953641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:07.953641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:07.953641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:19:07.953641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:07.953641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 225/440] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:19:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:07.955031 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f0619-25fd-41af-a6e6-b223d78ef223 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:07.955031 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f0619-25fd-41af-a6e6-b223d78ef223 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:07.955031 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f0619-25fd-41af-a6e6-b223d78ef223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:07.971736 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-b18f0619-25fd-41af-a6e6-b223d78ef223 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:07.972920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-b18f0619-25fd-41af-a6e6-b223d78ef223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:07.985638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad7897-3d3b-41c7-9024-257a75d5b046 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:08.019479 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58466d50-e71e-4563-b136-06b6924e4fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:08.020265 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58466d50-e71e-4563-b136-06b6924e4fbd None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:08.020553 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58466d50-e71e-4563-b136-06b6924e4fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:08.020830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58466d50-e71e-4563-b136-06b6924e4fbd None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:08.022021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58466d50-e71e-4563-b136-06b6924e4fbd None admin] RBAC: Authorizing `identity:get_project(project_id=087acb6a0d3945e7bc219b099d7a6037)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:08.023679 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58466d50-e71e-4563-b136-06b6924e4fbd None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:08.025611 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 216/441] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:19:07 2022] GET /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:08.026200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58466d50-e71e-4563-b136-06b6924e4fbd None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:08.043980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 226/442] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:08.045014 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f0619-25fd-41af-a6e6-b223d78ef223 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:08.073935 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:08.098791 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:08.133100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58466d50-e71e-4563-b136-06b6924e4fbd None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:08.147570 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f0619-25fd-41af-a6e6-b223d78ef223 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:08.166111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfb7f7-5b9c-4281-b0ab-d96277805c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:08.166887 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfb7f7-5b9c-4281-b0ab-d96277805c14 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:08.167242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfb7f7-5b9c-4281-b0ab-d96277805c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:08.167526 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfb7f7-5b9c-4281-b0ab-d96277805c14 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:08.168268 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dfb7f7-5b9c-4281-b0ab-d96277805c14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:08.168577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dfb7f7-5b9c-4281-b0ab-d96277805c14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:08.169956 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dfb7f7-5b9c-4281-b0ab-d96277805c14 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:08.177699 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 217/443] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:19:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:08.178470 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfb7f7-5b9c-4281-b0ab-d96277805c14 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:08.181442 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef033a-ba55-40c2-9ac8-5be248efa62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:08.183678 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef033a-ba55-40c2-9ac8-5be248efa62c None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:08.183962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef033a-ba55-40c2-9ac8-5be248efa62c None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:08.184238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef033a-ba55-40c2-9ac8-5be248efa62c None admin] PATH_INFO: `/v3/groups/19f868c18e87475ab117486b3738a6ba` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:08.185475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef033a-ba55-40c2-9ac8-5be248efa62c None admin] RBAC: Authorizing `identity:get_group(group_id=19f868c18e87475ab117486b3738a6ba)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:08.186948 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef033a-ba55-40c2-9ac8-5be248efa62c None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:08.188554 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 227/444] 10.222.0.25 () {56 vars in 1180 bytes} [Mon May 23 12:19:08 2022] GET /identity/v3/groups/19f868c18e87475ab117486b3738a6ba => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:08.189300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef033a-ba55-40c2-9ac8-5be248efa62c None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:08.279423 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfb7f7-5b9c-4281-b0ab-d96277805c14 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:08.282850 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:08.290406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef033a-ba55-40c2-9ac8-5be248efa62c None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:08.308081 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:08.314346 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f053b-c018-42f0-8c19-95dd3091ea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:08.315181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f053b-c018-42f0-8c19-95dd3091ea58 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:08.315474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f053b-c018-42f0-8c19-95dd3091ea58 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:08.315748 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f053b-c018-42f0-8c19-95dd3091ea58 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:08.323412 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8829a-9c4d-4e91-b9ce-582608c7a927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:08.324044 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8829a-9c4d-4e91-b9ce-582608c7a927 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:08.324330 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8829a-9c4d-4e91-b9ce-582608c7a927 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:08.324609 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8829a-9c4d-4e91-b9ce-582608c7a927 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:08.325879 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f053b-c018-42f0-8c19-95dd3091ea58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:08.336112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-694f053b-c018-42f0-8c19-95dd3091ea58 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:19:08.336112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:08.336112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:08.336112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:08.336112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:08.336112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:08.336112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:08.336112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:08.336112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:08.336112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:08.336112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:08.336112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:08.336112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:08.336112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:08.336112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:08.336112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:08.337021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:08.337021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:08.337021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:08.337021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:08.337021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:08.337021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:08.337021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:08.337021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:08.337021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:08.337021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:08.337021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:08.337021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:08.337021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:08.337021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:08.337021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:08.337021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:08.337891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:08.337891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:08.337891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:08.337891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:08.337891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:08.337891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:08.337891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:08.337891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:08.337891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:08.337891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:08.337891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:19:08.337891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:08.337891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 218/445] 10.222.0.25 () {56 vars in 1114 bytes} [Mon May 23 12:19:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:08.338880 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f053b-c018-42f0-8c19-95dd3091ea58 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:08.391373 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8829a-9c4d-4e91-b9ce-582608c7a927 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:08.392838 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8829a-9c4d-4e91-b9ce-582608c7a927 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:08.436923 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f053b-c018-42f0-8c19-95dd3091ea58 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:08.469621 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f4044-d8c2-4c6a-9095-0bcd4d605e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:08.470258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f4044-d8c2-4c6a-9095-0bcd4d605e20 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:08.470582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f4044-d8c2-4c6a-9095-0bcd4d605e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:08.470862 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f4044-d8c2-4c6a-9095-0bcd4d605e20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:08.471697 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f4044-d8c2-4c6a-9095-0bcd4d605e20 None admin] RBAC: Adding query filter params (group.id=19f868c18e87475ab117486b3738a6ba, role.id=3dac847973464a2cb123dc2c9083baf3, scope.project.id=087acb6a0d3945e7bc219b099d7a6037) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:08.472009 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f4044-d8c2-4c6a-9095-0bcd4d605e20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:08.473461 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f4044-d8c2-4c6a-9095-0bcd4d605e20 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:08.479808 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 219/446] 10.222.0.25 () {56 vars in 1376 bytes} [Mon May 23 12:19:08 2022] GET /identity/v3/role_assignments?group.id=19f868c18e87475ab117486b3738a6ba&scope.project.id=087acb6a0d3945e7bc219b099d7a6037&role.id=3dac847973464a2cb123dc2c9083baf3 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:08.480585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f4044-d8c2-4c6a-9095-0bcd4d605e20 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:08.490596 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 228/447] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:19:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:19:08.490991 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:08.496959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8829a-9c4d-4e91-b9ce-582608c7a927 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:08.546932 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:08.599123 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f4044-d8c2-4c6a-9095-0bcd4d605e20 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:08.605580 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8829a-9c4d-4e91-b9ce-582608c7a927 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:08.638145 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510b5c0-951d-406f-832c-87e17d9b860e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:08.639425 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510b5c0-951d-406f-832c-87e17d9b860e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:08.639990 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510b5c0-951d-406f-832c-87e17d9b860e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:08.640447 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510b5c0-951d-406f-832c-87e17d9b860e None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:08.641527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510b5c0-951d-406f-832c-87e17d9b860e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:08.641649 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecce99-3db2-4922-8b70-2430edf5b54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:08.642156 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510b5c0-951d-406f-832c-87e17d9b860e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:08.642475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecce99-3db2-4922-8b70-2430edf5b54c None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:08.642786 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecce99-3db2-4922-8b70-2430edf5b54c None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:08.643062 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecce99-3db2-4922-8b70-2430edf5b54c None admin] PATH_INFO: `/v3/projects/14be2fbaccef4510a5810ab627c88a01` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:08.644282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ecce99-3db2-4922-8b70-2430edf5b54c None admin] RBAC: Authorizing `identity:get_project(project_id=14be2fbaccef4510a5810ab627c88a01)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:08.644712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510b5c0-951d-406f-832c-87e17d9b860e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:08.645741 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ecce99-3db2-4922-8b70-2430edf5b54c None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:08.647501 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 229/448] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:19:08 2022] GET /identity/v3/projects/14be2fbaccef4510a5810ab627c88a01 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:08.653292 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecce99-3db2-4922-8b70-2430edf5b54c None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:08.659669 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 220/449] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:08.660832 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510b5c0-951d-406f-832c-87e17d9b860e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:08.729218 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:08.773499 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecce99-3db2-4922-8b70-2430edf5b54c None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:08.786734 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510b5c0-951d-406f-832c-87e17d9b860e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:08.804417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:08.814385 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8d689-6ec4-4b30-984d-ecf296a88076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:08.815278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8d689-6ec4-4b30-984d-ecf296a88076 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:08.815553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8d689-6ec4-4b30-984d-ecf296a88076 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:08.815834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8d689-6ec4-4b30-984d-ecf296a88076 None admin] PATH_INFO: `/v3/groups/68b9be7b901a45489d6103684816b481` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:08.817096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8d689-6ec4-4b30-984d-ecf296a88076 None admin] RBAC: Authorizing `identity:get_group(group_id=68b9be7b901a45489d6103684816b481)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:08.818588 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8d689-6ec4-4b30-984d-ecf296a88076 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:08.820764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 230/450] 10.222.0.25 () {56 vars in 1180 bytes} [Mon May 23 12:19:08 2022] GET /identity/v3/groups/68b9be7b901a45489d6103684816b481 => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:08.826564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8d689-6ec4-4b30-984d-ecf296a88076 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:08.828019 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b621a-2aad-4efb-8039-bfef6bcdb9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:08.828634 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b621a-2aad-4efb-8039-bfef6bcdb9b8 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:08.828924 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b621a-2aad-4efb-8039-bfef6bcdb9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:08.829211 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b621a-2aad-4efb-8039-bfef6bcdb9b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:08.913352 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b621a-2aad-4efb-8039-bfef6bcdb9b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:08.914960 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b621a-2aad-4efb-8039-bfef6bcdb9b8 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:08.933630 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8d689-6ec4-4b30-984d-ecf296a88076 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:08.963122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:08.969375 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b8965-b4ee-42bb-bcff-8a2dbd51156e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:08.970043 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b8965-b4ee-42bb-bcff-8a2dbd51156e None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:08.970324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b8965-b4ee-42bb-bcff-8a2dbd51156e None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:08.970628 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b8965-b4ee-42bb-bcff-8a2dbd51156e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:08.971444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b8965-b4ee-42bb-bcff-8a2dbd51156e None admin] RBAC: Adding query filter params (group.id=68b9be7b901a45489d6103684816b481, role.id=3ae7c5e54e084ac4a1f94da93a667583, scope.project.id=14be2fbaccef4510a5810ab627c88a01) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:08.971756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b8965-b4ee-42bb-bcff-8a2dbd51156e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:08.973176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b8965-b4ee-42bb-bcff-8a2dbd51156e None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:08.978897 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 231/451] 10.222.0.25 () {56 vars in 1376 bytes} [Mon May 23 12:19:08 2022] GET /identity/v3/role_assignments?group.id=68b9be7b901a45489d6103684816b481&scope.project.id=14be2fbaccef4510a5810ab627c88a01&role.id=3ae7c5e54e084ac4a1f94da93a667583 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:09.019091 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 221/452] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:19:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:19:09.024998 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b8965-b4ee-42bb-bcff-8a2dbd51156e None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:09.135288 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b8965-b4ee-42bb-bcff-8a2dbd51156e None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:09.169187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b36ec8-5eee-4016-a9d3-e01f28a8803f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:09.172414 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b36ec8-5eee-4016-a9d3-e01f28a8803f None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:09.172414 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b36ec8-5eee-4016-a9d3-e01f28a8803f None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:09.172414 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b36ec8-5eee-4016-a9d3-e01f28a8803f None admin] PATH_INFO: `/v3/projects/087acb6a0d3945e7bc219b099d7a6037` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:09.172414 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b36ec8-5eee-4016-a9d3-e01f28a8803f None admin] RBAC: Authorizing `identity:get_project(project_id=087acb6a0d3945e7bc219b099d7a6037)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:09.173270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b36ec8-5eee-4016-a9d3-e01f28a8803f None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:09.175018 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 232/453] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:19:09 2022] GET /identity/v3/projects/087acb6a0d3945e7bc219b099d7a6037 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:09.180969 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b621a-2aad-4efb-8039-bfef6bcdb9b8 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:09.199260 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:09.281386 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b621a-2aad-4efb-8039-bfef6bcdb9b8 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:09.314824 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156e01b-e702-4378-81f4-e1ce62d209e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:09.315672 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156e01b-e702-4378-81f4-e1ce62d209e7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:09.315959 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156e01b-e702-4378-81f4-e1ce62d209e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:09.316239 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156e01b-e702-4378-81f4-e1ce62d209e7 None admin] PATH_INFO: `/v3/groups/19f868c18e87475ab117486b3738a6ba` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:09.317396 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156e01b-e702-4378-81f4-e1ce62d209e7 None admin] RBAC: Authorizing `identity:get_group(group_id=19f868c18e87475ab117486b3738a6ba)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:09.318892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156e01b-e702-4378-81f4-e1ce62d209e7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:09.321095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 222/454] 10.222.0.25 () {56 vars in 1180 bytes} [Mon May 23 12:19:09 2022] GET /identity/v3/groups/19f868c18e87475ab117486b3738a6ba => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:09.326880 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b36ec8-5eee-4016-a9d3-e01f28a8803f None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:09.385989 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:09.423304 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b36ec8-5eee-4016-a9d3-e01f28a8803f None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:09.455330 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3fa06-8636-4398-9c3e-ad4cc3ee2720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:09.455961 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3fa06-8636-4398-9c3e-ad4cc3ee2720 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:09.456244 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3fa06-8636-4398-9c3e-ad4cc3ee2720 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:09.456518 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3fa06-8636-4398-9c3e-ad4cc3ee2720 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:09.457327 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3fa06-8636-4398-9c3e-ad4cc3ee2720 None admin] RBAC: Adding query filter params (group.id=19f868c18e87475ab117486b3738a6ba, role.id=d9ac3d950cc243aaa45c802dd5f3d844, scope.project.id=087acb6a0d3945e7bc219b099d7a6037) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:09.457640 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3fa06-8636-4398-9c3e-ad4cc3ee2720 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:09.459095 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3fa06-8636-4398-9c3e-ad4cc3ee2720 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:09.464788 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 233/455] 10.222.0.25 () {56 vars in 1376 bytes} [Mon May 23 12:19:09 2022] GET /identity/v3/role_assignments?group.id=19f868c18e87475ab117486b3738a6ba&scope.project.id=087acb6a0d3945e7bc219b099d7a6037&role.id=d9ac3d950cc243aaa45c802dd5f3d844 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:12.358547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87116e23-5b12-46ae-9871-3d72e625abb1 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:12.359118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87116e23-5b12-46ae-9871-3d72e625abb1 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:12.359118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87116e23-5b12-46ae-9871-3d72e625abb1 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:12.360732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 223/456] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:12.366687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd33de-1648-4e7a-b5b9-d4b93e0a7888 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:12.367668 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd33de-1648-4e7a-b5b9-d4b93e0a7888 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:12.368162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd33de-1648-4e7a-b5b9-d4b93e0a7888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:12.395495 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-a9fd33de-1648-4e7a-b5b9-d4b93e0a7888 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:12.397054 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-a9fd33de-1648-4e7a-b5b9-d4b93e0a7888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:12.454072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1420b-e661-4796-9d28-97b2e4e9261a None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:12.454379 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1420b-e661-4796-9d28-97b2e4e9261a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:12.454604 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1420b-e661-4796-9d28-97b2e4e9261a None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:12.456182 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 224/457] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:12.472935 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abf022-8979-4406-abeb-65dce99508cf None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:12.473298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abf022-8979-4406-abeb-65dce99508cf None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:12.473478 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abf022-8979-4406-abeb-65dce99508cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:12.477773 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 234/458] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:19:12.503433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd33de-1648-4e7a-b5b9-d4b93e0a7888 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:12.519517 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-27abf022-8979-4406-abeb-65dce99508cf None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:12.520725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-27abf022-8979-4406-abeb-65dce99508cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:12.565439 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:12.614005 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd33de-1648-4e7a-b5b9-d4b93e0a7888 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:12.654792 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 225/459] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:19:12.654996 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec741e-82a9-4a9a-b52d-ddd91632624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:12.654996 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec741e-82a9-4a9a-b52d-ddd91632624b None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:12.654996 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec741e-82a9-4a9a-b52d-ddd91632624b None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:12.654996 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec741e-82a9-4a9a-b52d-ddd91632624b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:12.676281 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec741e-82a9-4a9a-b52d-ddd91632624b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:12.677849 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec741e-82a9-4a9a-b52d-ddd91632624b None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:12.679088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abf022-8979-4406-abeb-65dce99508cf None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:12.708543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-b9ec741e-82a9-4a9a-b52d-ddd91632624b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:12.708543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:12.708543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:12.708543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:12.708543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:12.708543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:12.708543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:12.708543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:12.708543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:12.708543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:12.708543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:12.708543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:12.708543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:12.708543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:12.708543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:12.709470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:12.709470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:12.709470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:12.709470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:12.709470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:12.709470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:12.709470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:12.709470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:12.709470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:12.709470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:12.709470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:12.709470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:12.709470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:12.709470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:12.709470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:12.709470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:12.709470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:12.710454 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:12.710454 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:12.710454 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:12.710454 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:12.714834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:12.720335 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 235/460] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:12.721217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec741e-82a9-4a9a-b52d-ddd91632624b None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:12.842426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abf022-8979-4406-abeb-65dce99508cf None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:12.857200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec741e-82a9-4a9a-b52d-ddd91632624b None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:12.868072 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:12.891161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d598740-8827-42cb-b924-4815849ae22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:12.892235 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d598740-8827-42cb-b924-4815849ae22a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:12.892525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d598740-8827-42cb-b924-4815849ae22a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:12.892809 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d598740-8827-42cb-b924-4815849ae22a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:12.895768 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e00c3-ea96-40f9-a000-ab0bf669ea0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:12.896596 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e00c3-ea96-40f9-a000-ab0bf669ea0c None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:12.896979 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e00c3-ea96-40f9-a000-ab0bf669ea0c None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:12.897355 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e00c3-ea96-40f9-a000-ab0bf669ea0c None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:12.898782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e00c3-ea96-40f9-a000-ab0bf669ea0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:12.899185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e00c3-ea96-40f9-a000-ab0bf669ea0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:12.900682 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e00c3-ea96-40f9-a000-ab0bf669ea0c None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:12.905575 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d598740-8827-42cb-b924-4815849ae22a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:12.907103 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d598740-8827-42cb-b924-4815849ae22a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:12.915042 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 236/461] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:12.916523 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0871c-a0c4-4557-94c8-df41a3a4c554 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:12.916912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0871c-a0c4-4557-94c8-df41a3a4c554 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:12.917357 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0871c-a0c4-4557-94c8-df41a3a4c554 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:12.919008 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 237/462] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:12.921147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0871c-a0c4-4557-94c8-df41a3a4c554 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:12.938965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-3d598740-8827-42cb-b924-4815849ae22a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:12.938965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:12.938965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:12.938965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:12.938965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:12.938965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:12.938965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:12.938965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:12.938965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:12.938965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:12.938965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:12.938965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:12.938965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:12.938965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:12.938965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:12.940726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:12.940726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:12.940726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:12.940726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:12.940726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:12.940726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:12.940726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:12.940726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:12.940726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:12.940726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:12.940726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:12.940726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:12.940726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:12.940726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:12.940726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:12.940726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:12.940726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:12.942647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:12.942647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:12.942647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:12.942647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:12.942647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 226/463] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:12.943335 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de241c4-eda2-42ca-a760-1d827a26591f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:12.946588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de241c4-eda2-42ca-a760-1d827a26591f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:12.946588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de241c4-eda2-42ca-a760-1d827a26591f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:12.964722 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0de241c4-eda2-42ca-a760-1d827a26591f None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:12.966051 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0de241c4-eda2-42ca-a760-1d827a26591f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:13.032649 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:13.047935 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 227/464] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:13.047935 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de241c4-eda2-42ca-a760-1d827a26591f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:13.055507 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0871c-a0c4-4557-94c8-df41a3a4c554 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:13.091415 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bfc6f-54da-4916-b9c1-7379b8b94c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:13.092088 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bfc6f-54da-4916-b9c1-7379b8b94c09 None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:13.092373 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bfc6f-54da-4916-b9c1-7379b8b94c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:13.092656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bfc6f-54da-4916-b9c1-7379b8b94c09 None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:13.093354 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bfc6f-54da-4916-b9c1-7379b8b94c09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:13.094831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bfc6f-54da-4916-b9c1-7379b8b94c09 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:13.126528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 238/465] 10.222.0.25 () {60 vars in 1132 bytes} [Mon May 23 12:19:12 2022] POST /identity/v3/users => generated 248 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:19:13.126528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a70fc-04e5-45c0-8ac0-bd06a643542f None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:13.126528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a70fc-04e5-45c0-8ac0-bd06a643542f None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:13.126528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a70fc-04e5-45c0-8ac0-bd06a643542f None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:13.126528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 239/466] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:13.126528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a70fc-04e5-45c0-8ac0-bd06a643542f None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:13.174473 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:13.185529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de241c4-eda2-42ca-a760-1d827a26591f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:13.234946 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce83a06-cb2b-4c66-9110-86cb4ac93b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:13.235892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce83a06-cb2b-4c66-9110-86cb4ac93b2b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:13.236339 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce83a06-cb2b-4c66-9110-86cb4ac93b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:13.236800 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce83a06-cb2b-4c66-9110-86cb4ac93b2b None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:13.238467 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce83a06-cb2b-4c66-9110-86cb4ac93b2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:13.238988 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce83a06-cb2b-4c66-9110-86cb4ac93b2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:13.242159 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce83a06-cb2b-4c66-9110-86cb4ac93b2b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:13.268018 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 228/467] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:13.270687 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560c59c-10d6-42fc-8212-4ca51cddd8d8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:13.271178 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560c59c-10d6-42fc-8212-4ca51cddd8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:13.271602 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560c59c-10d6-42fc-8212-4ca51cddd8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:13.275565 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a70fc-04e5-45c0-8ac0-bd06a643542f None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:13.294359 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4560c59c-10d6-42fc-8212-4ca51cddd8d8 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:13.296580 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4560c59c-10d6-42fc-8212-4ca51cddd8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:13.314330 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ddf73-dcd7-480c-9758-2a858554f937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:13.315220 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ddf73-dcd7-480c-9758-2a858554f937 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:13.315505 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ddf73-dcd7-480c-9758-2a858554f937 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:13.315778 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ddf73-dcd7-480c-9758-2a858554f937 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:13.332264 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ddf73-dcd7-480c-9758-2a858554f937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:13.333128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ddf73-dcd7-480c-9758-2a858554f937 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:13.353868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-572ddf73-dcd7-480c-9758-2a858554f937 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:13.353868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:13.353868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:13.353868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:13.353868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:13.353868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:13.353868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:13.353868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:13.353868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:13.353868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:13.353868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:13.353868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:13.353868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:13.353868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:13.353868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:13.354841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:13.354841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:13.354841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:13.354841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:13.354841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:13.354841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:13.354841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:13.354841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:13.354841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:13.354841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:13.354841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:13.354841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:13.354841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:13.354841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:13.354841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:13.354841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:13.354841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:13.355681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:13.355681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:13.355681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:13.355681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:13.356413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 240/468] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:13.356829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ddf73-dcd7-480c-9758-2a858554f937 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:13.368258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:13.392982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 229/469] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:13.395182 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560c59c-10d6-42fc-8212-4ca51cddd8d8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:13.459903 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:13.485588 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ddf73-dcd7-480c-9758-2a858554f937 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:13.521883 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75066d-47a5-4118-b4ea-2c747d547f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:13.523209 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75066d-47a5-4118-b4ea-2c747d547f8c None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:13.523495 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75066d-47a5-4118-b4ea-2c747d547f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:13.523770 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75066d-47a5-4118-b4ea-2c747d547f8c None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:13.524469 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75066d-47a5-4118-b4ea-2c747d547f8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:13.525722 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560c59c-10d6-42fc-8212-4ca51cddd8d8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:13.525904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75066d-47a5-4118-b4ea-2c747d547f8c None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:13.549788 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 241/470] 10.222.0.25 () {60 vars in 1132 bytes} [Mon May 23 12:19:13 2022] POST /identity/v3/users => generated 246 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:19:13.551317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75066d-47a5-4118-b4ea-2c747d547f8c None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:13.595968 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3544530-b142-4937-a718-b63ee9c91081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:13.596652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3544530-b142-4937-a718-b63ee9c91081 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:13.596939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3544530-b142-4937-a718-b63ee9c91081 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:13.597221 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3544530-b142-4937-a718-b63ee9c91081 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:13.598131 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3544530-b142-4937-a718-b63ee9c91081 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:13.598586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3544530-b142-4937-a718-b63ee9c91081 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:13.600027 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3544530-b142-4937-a718-b63ee9c91081 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:13.614023 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 230/471] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:13.615531 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdffd2-e657-4f08-b4d6-dabb68a787f6 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:13.615824 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdffd2-e657-4f08-b4d6-dabb68a787f6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:13.616106 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdffd2-e657-4f08-b4d6-dabb68a787f6 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:13.622453 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 231/472] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:13.623434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdffd2-e657-4f08-b4d6-dabb68a787f6 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:13.682158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:13.689638 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75066d-47a5-4118-b4ea-2c747d547f8c None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:13.730631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:13.738110 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e3ac9-e7d9-48c0-8af7-2e7340a3d178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:13.738873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e3ac9-e7d9-48c0-8af7-2e7340a3d178 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:13.739158 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e3ac9-e7d9-48c0-8af7-2e7340a3d178 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:13.739439 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e3ac9-e7d9-48c0-8af7-2e7340a3d178 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:13.748890 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdffd2-e657-4f08-b4d6-dabb68a787f6 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:13.754988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e3ac9-e7d9-48c0-8af7-2e7340a3d178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:13.756543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e3ac9-e7d9-48c0-8af7-2e7340a3d178 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:13.776718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-d66e3ac9-e7d9-48c0-8af7-2e7340a3d178 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:13.776718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:13.776718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:13.776718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:13.776718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:13.776718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:13.776718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:13.776718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:13.776718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:13.776718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:13.776718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:13.776718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:13.776718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:13.776718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:13.776718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:13.777610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:13.777610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:13.777610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:13.777610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:13.777610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:13.777610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:13.777610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:13.777610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:13.777610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:13.777610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:13.777610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:13.777610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:13.777610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:13.777610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:13.777610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:13.777610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:13.777610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:13.778470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:13.778470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:13.778470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:13.778470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:13.778470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 242/473] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:13.779208 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895cea1-e897-4826-b23f-3190eea44a6f None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:13.779500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895cea1-e897-4826-b23f-3190eea44a6f None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:13.779774 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895cea1-e897-4826-b23f-3190eea44a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:13.794267 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545f791-b585-4f1e-9846-a792f07340c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:13.795326 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545f791-b585-4f1e-9846-a792f07340c9 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:13.795776 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545f791-b585-4f1e-9846-a792f07340c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:13.796261 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545f791-b585-4f1e-9846-a792f07340c9 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:13.797117 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545f791-b585-4f1e-9846-a792f07340c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:13.798589 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-d895cea1-e897-4826-b23f-3190eea44a6f None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:13.799116 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545f791-b585-4f1e-9846-a792f07340c9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:13.799988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-d895cea1-e897-4826-b23f-3190eea44a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:13.825521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 232/474] 10.222.0.25 () {60 vars in 1132 bytes} [Mon May 23 12:19:13 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:19:13.826826 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545f791-b585-4f1e-9846-a792f07340c9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:13.889460 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 243/475] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:13.912673 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895cea1-e897-4826-b23f-3190eea44a6f None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:13.969008 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545f791-b585-4f1e-9846-a792f07340c9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:13.971247 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:14.023041 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb60d41-8371-4de9-bd96-05981157a1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:14.024410 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb60d41-8371-4de9-bd96-05981157a1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:14.024827 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb60d41-8371-4de9-bd96-05981157a1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:14.025170 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb60d41-8371-4de9-bd96-05981157a1d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:14.025992 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb60d41-8371-4de9-bd96-05981157a1d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:14.026727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb60d41-8371-4de9-bd96-05981157a1d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:14.028599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb60d41-8371-4de9-bd96-05981157a1d1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:14.050031 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 233/476] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:14.051217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb60d41-8371-4de9-bd96-05981157a1d1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:14.076754 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895cea1-e897-4826-b23f-3190eea44a6f None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:14.095356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:14.122274 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba1f8f-56d5-4cc6-ab19-6519fa775624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:14.123473 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba1f8f-56d5-4cc6-ab19-6519fa775624 None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:14.124038 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba1f8f-56d5-4cc6-ab19-6519fa775624 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:14.124526 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba1f8f-56d5-4cc6-ab19-6519fa775624 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:14.125490 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba1f8f-56d5-4cc6-ab19-6519fa775624 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:14.127401 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba1f8f-56d5-4cc6-ab19-6519fa775624 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:14.136013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.sql.core [None req-80ba1f8f-56d5-4cc6-ab19-6519fa775624 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 12:19:14.136013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 23 12:19:14.136013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [parameters: {'id': '39f581f787394eb7a5aad4022243c82a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 23 12:19:14.136013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80199) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 12:19:14.155177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-80ba1f8f-56d5-4cc6-ab19-6519fa775624 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 23 12:19:14.155177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:14.155177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 12:19:14.155177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 12:19:14.155177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 12:19:14.155177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 12:19:14.155177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 12:19:14.155177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application result = self._query(query) May 23 12:19:14.155177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 12:19:14.155177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application conn.query(q) May 23 12:19:14.155177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 12:19:14.155177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 12:19:14.155177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 12:19:14.155177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application result.read() May 23 12:19:14.155177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 12:19:14.156122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 12:19:14.156122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 12:19:14.156122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 12:19:14.156122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 12:19:14.156122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 12:19:14.156122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 12:19:14.156122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 12:19:14.156122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 12:19:14.156122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:14.156122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 12:19:14.156122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:14.156122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:14.156122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 12:19:14.156122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 12:19:14.156122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 23 12:19:14.156122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return ref.to_dict() May 23 12:19:14.156122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 12:19:14.156122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application next(self.gen) May 23 12:19:14.157172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 12:19:14.157172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application yield resource May 23 12:19:14.157172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 12:19:14.157172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application next(self.gen) May 23 12:19:14.157172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 12:19:14.157172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self.session.rollback() May 23 12:19:14.157172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 12:19:14.157172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self.force_reraise() May 23 12:19:14.157172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 12:19:14.157172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise self.value May 23 12:19:14.157172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 12:19:14.157172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 12:19:14.157172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 12:19:14.157172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application session.commit() May 23 12:19:14.157172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 12:19:14.157172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 12:19:14.157172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 12:19:14.158033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._prepare_impl() May 23 12:19:14.158033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 12:19:14.158033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self.session.flush() May 23 12:19:14.158033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 12:19:14.158033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._flush(objects) May 23 12:19:14.158033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 12:19:14.158033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 12:19:14.158033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 12:19:14.158033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application compat.raise_( May 23 12:19:14.158033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 12:19:14.158033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception May 23 12:19:14.158033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 12:19:14.158033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application flush_context.execute() May 23 12:19:14.158033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 12:19:14.158033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rec.execute(self) May 23 12:19:14.158033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 12:19:14.158033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 12:19:14.159003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 12:19:14.159003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 12:19:14.159003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 23 12:19:14.159003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application c = connection._execute_20( May 23 12:19:14.159003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 12:19:14.159003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 12:19:14.159003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 12:19:14.159003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 12:19:14.159003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 12:19:14.159003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 12:19:14.159003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 12:19:14.159003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 12:19:14.159003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 12:19:14.159003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 12:19:14.159003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 12:19:14.159003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception May 23 12:19:14.161183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 12:19:14.161183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 12:19:14.161183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 12:19:14.161183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 12:19:14.161183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 12:19:14.161183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application result = self._query(query) May 23 12:19:14.161183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 12:19:14.161183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application conn.query(q) May 23 12:19:14.161183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 12:19:14.161183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 12:19:14.161183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 12:19:14.161183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application result.read() May 23 12:19:14.161183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 12:19:14.161183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 12:19:14.161183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 12:19:14.161183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 12:19:14.163690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 12:19:14.163690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 12:19:14.163690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 12:19:14.163690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 12:19:14.163690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 12:19:14.163690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 23 12:19:14.163690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [parameters: {'id': '39f581f787394eb7a5aad4022243c82a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 23 12:19:14.163690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 12:19:14.163690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:14.163690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:19:14.163690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:14.163690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:14.163690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:14.163690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:14.163690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:14.163690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:14.165922 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:14.165922 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:14.165922 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:14.165922 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:14.165922 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:14.165922 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:14.165922 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 23 12:19:14.165922 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 23 12:19:14.165922 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:14.165922 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:14.165922 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 23 12:19:14.165922 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 23 12:19:14.165922 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 12:19:14.165922 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 12:19:14.165922 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 23 12:19:14.165922 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:14.169895 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb60d41-8371-4de9-bd96-05981157a1d1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:14.170157 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 244/477] 10.222.0.25 () {60 vars in 1131 bytes} [Mon May 23 12:19:13 2022] POST /identity/v3/roles => generated 144 bytes in 258 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:14.176406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba1f8f-56d5-4cc6-ab19-6519fa775624 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:14.209573 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a1d83-e31e-48c3-baa5-5942c72e1772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:14.210392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a1d83-e31e-48c3-baa5-5942c72e1772 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:14.210703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a1d83-e31e-48c3-baa5-5942c72e1772 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:14.211007 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a1d83-e31e-48c3-baa5-5942c72e1772 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:14.211694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a1d83-e31e-48c3-baa5-5942c72e1772 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:14.213168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a1d83-e31e-48c3-baa5-5942c72e1772 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:14.251681 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 234/478] 10.222.0.25 () {60 vars in 1132 bytes} [Mon May 23 12:19:14 2022] POST /identity/v3/users => generated 249 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:19:14.307553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba1f8f-56d5-4cc6-ab19-6519fa775624 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:14.361418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030bc08-0f75-4cb4-9482-8d3554994b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:14.362681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030bc08-0f75-4cb4-9482-8d3554994b6d None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:14.363370 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030bc08-0f75-4cb4-9482-8d3554994b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:14.364011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030bc08-0f75-4cb4-9482-8d3554994b6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:14.377957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030bc08-0f75-4cb4-9482-8d3554994b6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:14.386914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-d030bc08-0f75-4cb4-9482-8d3554994b6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:19:14.386914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:14.386914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:14.386914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:14.386914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:14.386914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:14.386914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:14.386914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:14.386914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:14.386914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:14.386914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:14.386914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:14.386914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:14.386914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:14.386914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:14.386914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:14.387905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:14.387905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:14.387905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:14.387905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:14.387905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:14.387905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:14.387905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:14.387905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:14.387905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:14.387905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:14.387905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:14.387905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:14.387905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:14.387905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:14.387905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:14.387905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:14.388698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:14.388698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:14.388698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:14.388698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:14.388698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:14.388698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:14.388698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:14.388698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:14.388698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:14.388698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:14.388698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 12:19:14.388698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:14.391256 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 245/479] 10.222.0.25 () {56 vars in 1114 bytes} [Mon May 23 12:19:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:14.397340 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a1d83-e31e-48c3-baa5-5942c72e1772 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:14.420874 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:14.515526 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a1d83-e31e-48c3-baa5-5942c72e1772 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:14.553192 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a372c-903c-4f9d-ad2a-a99614ee8319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:14.554809 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a372c-903c-4f9d-ad2a-a99614ee8319 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:14.555333 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a372c-903c-4f9d-ad2a-a99614ee8319 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:14.555931 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a372c-903c-4f9d-ad2a-a99614ee8319 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:14.556902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a372c-903c-4f9d-ad2a-a99614ee8319 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:14.557413 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a372c-903c-4f9d-ad2a-a99614ee8319 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:14.559105 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a372c-903c-4f9d-ad2a-a99614ee8319 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:14.568289 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 235/480] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:15.991873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf726c-00c9-43f7-93de-228114a756d4 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:15.992399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf726c-00c9-43f7-93de-228114a756d4 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:15.992739 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf726c-00c9-43f7-93de-228114a756d4 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:15.995217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 246/481] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:16.001996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c11c1b-67b9-47b0-bcd7-ebbee989005e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:16.002430 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c11c1b-67b9-47b0-bcd7-ebbee989005e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:16.002649 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c11c1b-67b9-47b0-bcd7-ebbee989005e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:16.028267 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f6c11c1b-67b9-47b0-bcd7-ebbee989005e None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:16.029546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f6c11c1b-67b9-47b0-bcd7-ebbee989005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:16.121411 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 236/482] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:16.157324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf726c-00c9-43f7-93de-228114a756d4 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:16.222998 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:16.246652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8b488-a29b-4d04-9760-c66e9afdc84f None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:16.247287 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8b488-a29b-4d04-9760-c66e9afdc84f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:16.247781 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8b488-a29b-4d04-9760-c66e9afdc84f None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:16.249789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 237/483] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:16.255822 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23c85a-c1dc-471f-87f9-16de09e9cbf7 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:16.256417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23c85a-c1dc-471f-87f9-16de09e9cbf7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:16.257048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23c85a-c1dc-471f-87f9-16de09e9cbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:16.274830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6a23c85a-c1dc-471f-87f9-16de09e9cbf7 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:16.276318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6a23c85a-c1dc-471f-87f9-16de09e9cbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:16.280327 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:16.344909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf726c-00c9-43f7-93de-228114a756d4 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:16.391778 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 238/484] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:16.422040 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e518f92-6ba6-40ce-a769-2287223ec83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:16.422892 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e518f92-6ba6-40ce-a769-2287223ec83c None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:16.423178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e518f92-6ba6-40ce-a769-2287223ec83c None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:16.423454 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e518f92-6ba6-40ce-a769-2287223ec83c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:16.437616 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e518f92-6ba6-40ce-a769-2287223ec83c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:16.439369 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23c85a-c1dc-471f-87f9-16de09e9cbf7 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:16.464578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-1e518f92-6ba6-40ce-a769-2287223ec83c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:16.464578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:16.464578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:16.464578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:16.464578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:16.464578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:16.464578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:16.464578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:16.464578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:16.464578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:16.464578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:16.464578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:16.464578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:16.464578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:16.464578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:16.464578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:16.465531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:16.465531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:16.465531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:16.465531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:16.465531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:16.465531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:16.465531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:16.465531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:16.465531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:16.465531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:16.465531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:16.465531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:16.465531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:16.465531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:16.465531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:16.465531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:16.466337 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:16.466337 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:16.466337 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:16.466337 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:16.466337 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:16.466337 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:16.466337 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:16.466337 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:16.466337 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:16.466337 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:16.466337 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:16.466337 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:16.468820 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 247/485] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:19:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:16.472852 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e518f92-6ba6-40ce-a769-2287223ec83c None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:16.623909 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23c85a-c1dc-471f-87f9-16de09e9cbf7 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:16.660666 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69c441-2f3d-4b52-a0e1-05f3b5d34d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:16.661472 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69c441-2f3d-4b52-a0e1-05f3b5d34d07 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:16.661753 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69c441-2f3d-4b52-a0e1-05f3b5d34d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:16.662029 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69c441-2f3d-4b52-a0e1-05f3b5d34d07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:16.667633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e518f92-6ba6-40ce-a769-2287223ec83c None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:16.670793 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:16.686318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:16.691234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69c441-2f3d-4b52-a0e1-05f3b5d34d07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:16.703530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-6f69c441-2f3d-4b52-a0e1-05f3b5d34d07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:16.703530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:16.703530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:16.703530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:16.703530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:16.703530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:16.703530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:16.703530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:16.703530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:16.703530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:16.703530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:16.703530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:16.703530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:16.703530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:16.703530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:16.703530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:16.704500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:16.704500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:16.704500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:16.704500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:16.704500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:16.704500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:16.704500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:16.704500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:16.704500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:16.704500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:16.704500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:16.704500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:16.704500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:16.704500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:16.704500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:16.704500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:16.705282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:16.705282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:16.705282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:16.705282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:16.705282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:16.705282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:16.705282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:16.705282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:16.705282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:16.705282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:16.705282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:16.705282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:16.706719 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 239/486] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:19:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:16.708834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a42ff-c800-4659-b4cd-cb87f0d00ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:16.709502 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a42ff-c800-4659-b4cd-cb87f0d00ccc None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:16.711374 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69c441-2f3d-4b52-a0e1-05f3b5d34d07 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:16.711893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a42ff-c800-4659-b4cd-cb87f0d00ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:16.712493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a42ff-c800-4659-b4cd-cb87f0d00ccc None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:16.712971 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a42ff-c800-4659-b4cd-cb87f0d00ccc None admin] RBAC: Adding query filter params (name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:16.713279 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a42ff-c800-4659-b4cd-cb87f0d00ccc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:16.714713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a42ff-c800-4659-b4cd-cb87f0d00ccc None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:16.735072 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 248/487] 10.222.0.25 () {56 vars in 1103 bytes} [Mon May 23 12:19:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:16.742646 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a42ff-c800-4659-b4cd-cb87f0d00ccc None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:16.876051 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69c441-2f3d-4b52-a0e1-05f3b5d34d07 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:16.933446 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3130df4-40aa-4fab-abc7-bd13e6ec7e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:16.934116 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3130df4-40aa-4fab-abc7-bd13e6ec7e28 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:16.934393 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3130df4-40aa-4fab-abc7-bd13e6ec7e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:16.934705 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3130df4-40aa-4fab-abc7-bd13e6ec7e28 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:16.935452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3130df4-40aa-4fab-abc7-bd13e6ec7e28 None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:16.935761 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3130df4-40aa-4fab-abc7-bd13e6ec7e28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:16.937263 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3130df4-40aa-4fab-abc7-bd13e6ec7e28 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:16.946417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 240/488] 10.222.0.25 () {56 vars in 1103 bytes} [Mon May 23 12:19:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:16.955789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3130df4-40aa-4fab-abc7-bd13e6ec7e28 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:16.957852 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a42ff-c800-4659-b4cd-cb87f0d00ccc None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:17.028220 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb2f59-a126-4821-8df4-7595b850b647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:17.030289 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb2f59-a126-4821-8df4-7595b850b647 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:17.030786 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb2f59-a126-4821-8df4-7595b850b647 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:17.031214 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb2f59-a126-4821-8df4-7595b850b647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:17.046817 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb2f59-a126-4821-8df4-7595b850b647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:17.048697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb2f59-a126-4821-8df4-7595b850b647 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:17.063843 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:17.073278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-b0bb2f59-a126-4821-8df4-7595b850b647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:17.073278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:17.073278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:17.073278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:17.073278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:17.073278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:17.073278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:17.073278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:17.073278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:17.073278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:17.073278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:17.073278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:17.073278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:17.073278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:17.073278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:17.074348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:17.074348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:17.074348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:17.074348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:17.074348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:17.074348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:17.074348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:17.074348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:17.074348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:17.074348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:17.074348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:17.074348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:17.074348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:17.074348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:17.074348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:17.074348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:17.074348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:17.075326 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:17.075326 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:17.075326 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:17.075326 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:17.077312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 249/489] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:17.078408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1692e22-68db-4efc-95fc-8227505aaf01 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:17.082783 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1692e22-68db-4efc-95fc-8227505aaf01 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:17.083330 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1692e22-68db-4efc-95fc-8227505aaf01 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:17.089235 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 250/490] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:17.090962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1692e22-68db-4efc-95fc-8227505aaf01 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:17.111576 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:17.128898 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3130df4-40aa-4fab-abc7-bd13e6ec7e28 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:17.172360 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac713a3-7ebd-4cff-8d2f-c0be17d43e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:17.173187 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac713a3-7ebd-4cff-8d2f-c0be17d43e08 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:17.173474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac713a3-7ebd-4cff-8d2f-c0be17d43e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:17.173753 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac713a3-7ebd-4cff-8d2f-c0be17d43e08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:17.185004 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac713a3-7ebd-4cff-8d2f-c0be17d43e08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:17.186530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac713a3-7ebd-4cff-8d2f-c0be17d43e08 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:17.209100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-4ac713a3-7ebd-4cff-8d2f-c0be17d43e08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:17.209100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:17.209100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:17.209100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:17.209100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:17.209100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:17.209100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:17.209100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:17.209100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:17.209100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:17.209100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:17.209100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:17.209100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:17.209100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:17.209100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:17.210623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:17.210623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:17.210623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:17.210623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:17.210623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:17.210623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:17.210623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:17.210623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:17.210623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:17.210623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:17.210623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:17.210623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:17.210623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:17.210623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:17.210623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:17.210623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:17.210623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:17.211572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:17.211572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:17.211572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:17.211572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:17.211572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 241/491] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:17.212528 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539cb1e-4587-4427-a8e8-e0ebded37667 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:17.212844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539cb1e-4587-4427-a8e8-e0ebded37667 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:17.213094 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539cb1e-4587-4427-a8e8-e0ebded37667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:17.219503 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1692e22-68db-4efc-95fc-8227505aaf01 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:17.231147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-5539cb1e-4587-4427-a8e8-e0ebded37667 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:17.232349 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5539cb1e-4587-4427-a8e8-e0ebded37667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:17.258534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba78563-ba18-486f-a6e9-83aef97eee36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:17.259389 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba78563-ba18-486f-a6e9-83aef97eee36 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:17.259678 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba78563-ba18-486f-a6e9-83aef97eee36 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:17.259975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba78563-ba18-486f-a6e9-83aef97eee36 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:17.260700 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba78563-ba18-486f-a6e9-83aef97eee36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:17.261031 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba78563-ba18-486f-a6e9-83aef97eee36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:17.262721 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba78563-ba18-486f-a6e9-83aef97eee36 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:17.276715 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 251/492] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:17.278026 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5295b9-2da1-4b1c-99b7-b653a6dea7dd None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:17.278317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5295b9-2da1-4b1c-99b7-b653a6dea7dd None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:17.282545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5295b9-2da1-4b1c-99b7-b653a6dea7dd None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:17.282545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 252/493] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:17.282545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5295b9-2da1-4b1c-99b7-b653a6dea7dd None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:17.318549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 242/494] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:17.318549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539cb1e-4587-4427-a8e8-e0ebded37667 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:17.365772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:17.370685 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:17.400008 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5295b9-2da1-4b1c-99b7-b653a6dea7dd None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:17.433604 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539cb1e-4587-4427-a8e8-e0ebded37667 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:17.439635 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778178a2-b23a-4129-b391-95e828c428dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:17.440309 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778178a2-b23a-4129-b391-95e828c428dc None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:17.440605 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778178a2-b23a-4129-b391-95e828c428dc None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:17.440873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778178a2-b23a-4129-b391-95e828c428dc None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:17.441600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778178a2-b23a-4129-b391-95e828c428dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:17.441910 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778178a2-b23a-4129-b391-95e828c428dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:17.443325 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778178a2-b23a-4129-b391-95e828c428dc None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:17.456012 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 253/495] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:17.457098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a3cb9-6ec4-4548-9e4b-5eec6c4bf4c5 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:17.457395 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a3cb9-6ec4-4548-9e4b-5eec6c4bf4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:17.457681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a3cb9-6ec4-4548-9e4b-5eec6c4bf4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:17.474780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494447c-6b3b-45da-98a4-ab635c5c0d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:17.474979 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-5a6a3cb9-6ec4-4548-9e4b-5eec6c4bf4c5 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:17.475554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494447c-6b3b-45da-98a4-ab635c5c0d09 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:17.475835 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494447c-6b3b-45da-98a4-ab635c5c0d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:17.476106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-5a6a3cb9-6ec4-4548-9e4b-5eec6c4bf4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:17.476217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494447c-6b3b-45da-98a4-ab635c5c0d09 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:17.483913 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494447c-6b3b-45da-98a4-ab635c5c0d09 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:17.485752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494447c-6b3b-45da-98a4-ab635c5c0d09 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:17.502073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-8494447c-6b3b-45da-98a4-ab635c5c0d09 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 12:19:17.502073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:17.502073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:17.502073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:17.502073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:17.502073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:17.502073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:17.502073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:17.502073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:17.502073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:17.502073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:17.502073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:17.502073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:17.502073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:17.502073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:17.502073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:17.503085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:17.503085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:17.503085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:17.503085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:17.503085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:17.503085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:17.503085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:17.503085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:17.503085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:17.503085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:17.503085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:17.503085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:17.503085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:17.503085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:17.503085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:17.503085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:17.503085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:17.503085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:17.504035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:17.504035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:17.504035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:17.504035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:17.504035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:17.504035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:17.504035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:17.504035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:17.504035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 12:19:17.504035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:17.504035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 243/496] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:19:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:17.504603 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494447c-6b3b-45da-98a4-ab635c5c0d09 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:17.549062 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 254/497] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:17.549899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a3cb9-6ec4-4548-9e4b-5eec6c4bf4c5 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:17.604996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494447c-6b3b-45da-98a4-ab635c5c0d09 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:17.607276 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:17.611649 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:17.642792 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e85b8-ce61-4ea5-8f1e-66a20579df22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:17.643591 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e85b8-ce61-4ea5-8f1e-66a20579df22 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:17.643876 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e85b8-ce61-4ea5-8f1e-66a20579df22 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:17.644520 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e85b8-ce61-4ea5-8f1e-66a20579df22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:17.653964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a3cb9-6ec4-4548-9e4b-5eec6c4bf4c5 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:17.654648 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e85b8-ce61-4ea5-8f1e-66a20579df22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:17.662199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-ea2e85b8-ce61-4ea5-8f1e-66a20579df22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:17.662199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:17.662199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:17.662199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:17.662199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:17.662199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:17.662199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:17.662199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:17.662199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:17.662199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:17.662199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:17.662199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:17.662199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:17.662199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:17.662199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:17.662199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:17.663757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:17.663757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:17.663757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:17.663757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:17.663757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:17.663757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:17.663757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:17.663757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:17.663757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:17.663757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:17.663757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:17.663757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:17.663757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:17.663757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:17.663757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:17.663757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:17.664548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:17.664548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:17.664548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:17.664548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:17.664548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:17.664548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:17.664548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:17.664548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:17.664548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:17.664548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:17.664548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:17.664548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:17.664548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 244/498] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:19:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:17.665518 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c7447-1777-4d5e-8b31-5ca2a9468650 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:17.665793 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c7447-1777-4d5e-8b31-5ca2a9468650 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:17.666015 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c7447-1777-4d5e-8b31-5ca2a9468650 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:17.667380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 245/499] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:17.667916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c7447-1777-4d5e-8b31-5ca2a9468650 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:17.692832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621a537-80d9-4c4e-9f30-520b8bac962c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:17.693984 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621a537-80d9-4c4e-9f30-520b8bac962c None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:17.693984 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621a537-80d9-4c4e-9f30-520b8bac962c None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:17.694171 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621a537-80d9-4c4e-9f30-520b8bac962c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:17.701331 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621a537-80d9-4c4e-9f30-520b8bac962c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:17.702788 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621a537-80d9-4c4e-9f30-520b8bac962c None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:17.718047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-8621a537-80d9-4c4e-9f30-520b8bac962c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 12:19:17.718047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:17.718047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:17.718047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:17.718047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:17.718047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:17.718047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:17.718047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:17.718047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:17.718047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:17.718047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:17.718047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:17.718047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:17.718047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:17.718047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:17.718047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:17.719153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:17.719153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:17.719153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:17.719153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:17.719153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:17.719153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:17.719153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:17.719153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:17.719153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:17.719153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:17.719153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:17.719153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:17.719153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:17.719153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:17.719153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:17.719153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:17.719153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:17.719153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:17.720238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:17.720238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:17.720238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:17.720238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:17.720238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:17.720238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:17.720238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:17.720238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:17.720238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 12:19:17.720238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:17.720238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 255/500] 10.222.0.25 () {56 vars in 1093 bytes} [Mon May 23 12:19:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:17.720238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621a537-80d9-4c4e-9f30-520b8bac962c None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:17.776903 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c7447-1777-4d5e-8b31-5ca2a9468650 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:17.816375 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f58833-ba5d-4fba-a23c-b6c9ddf64a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:17.817074 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f58833-ba5d-4fba-a23c-b6c9ddf64a7e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:17.817359 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f58833-ba5d-4fba-a23c-b6c9ddf64a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:17.817634 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f58833-ba5d-4fba-a23c-b6c9ddf64a7e None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:17.818472 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f58833-ba5d-4fba-a23c-b6c9ddf64a7e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:17.818776 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621a537-80d9-4c4e-9f30-520b8bac962c None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:17.818912 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f58833-ba5d-4fba-a23c-b6c9ddf64a7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:17.820792 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f58833-ba5d-4fba-a23c-b6c9ddf64a7e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:17.847844 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:17.857459 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 246/501] 10.222.0.25 () {56 vars in 1137 bytes} [Mon May 23 12:19:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:17.858588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f58833-ba5d-4fba-a23c-b6c9ddf64a7e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:17.860570 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0612e-4807-42b2-a26e-020088ae7a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:17.861625 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0612e-4807-42b2-a26e-020088ae7a65 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:17.862831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0612e-4807-42b2-a26e-020088ae7a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:17.862831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0612e-4807-42b2-a26e-020088ae7a65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:17.872862 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0612e-4807-42b2-a26e-020088ae7a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:17.880423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-31a0612e-4807-42b2-a26e-020088ae7a65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:17.880423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:17.880423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:17.880423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:17.880423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:17.880423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:17.880423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:17.880423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:17.880423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:17.880423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:17.880423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:17.880423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:17.880423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:17.880423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:17.880423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:17.880423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:17.881450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:17.881450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:17.881450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:17.881450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:17.881450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:17.881450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:17.881450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:17.881450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:17.881450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:17.881450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:17.881450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:17.881450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:17.881450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:17.881450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:17.881450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:17.881450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:17.882953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:17.882953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:17.882953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:17.882953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:17.882953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:17.882953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:17.882953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:17.882953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:17.882953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:17.882953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:17.882953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:17.882953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:17.882953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 256/502] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:19:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:17.883759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f88563-beff-4a80-bc88-3b99d647399c None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:17.883986 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f88563-beff-4a80-bc88-3b99d647399c None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:17.884263 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f88563-beff-4a80-bc88-3b99d647399c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:17.885133 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:17.901365 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-87f88563-beff-4a80-bc88-3b99d647399c None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:17.902576 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-87f88563-beff-4a80-bc88-3b99d647399c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:17.962142 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f58833-ba5d-4fba-a23c-b6c9ddf64a7e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:17.968751 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 257/503] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:17.969493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f88563-beff-4a80-bc88-3b99d647399c None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:17.998495 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b71de7-8cb3-40c5-b691-3f9f6de6f337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:17.999096 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b71de7-8cb3-40c5-b691-3f9f6de6f337 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:17.999396 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b71de7-8cb3-40c5-b691-3f9f6de6f337 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:17.999670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b71de7-8cb3-40c5-b691-3f9f6de6f337 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:18.000425 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b71de7-8cb3-40c5-b691-3f9f6de6f337 None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:18.000735 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b71de7-8cb3-40c5-b691-3f9f6de6f337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:18.002141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b71de7-8cb3-40c5-b691-3f9f6de6f337 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:18.010951 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 247/504] 10.222.0.25 () {56 vars in 1103 bytes} [Mon May 23 12:19:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:18.011731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b71de7-8cb3-40c5-b691-3f9f6de6f337 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:18.081438 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f88563-beff-4a80-bc88-3b99d647399c None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:18.094258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:18.095524 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:18.111866 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b71de7-8cb3-40c5-b691-3f9f6de6f337 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:18.116918 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d076a7-1765-415a-ab68-a27ed49d54bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:18.117590 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d076a7-1765-415a-ab68-a27ed49d54bd None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:18.117870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d076a7-1765-415a-ab68-a27ed49d54bd None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:18.118150 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d076a7-1765-415a-ab68-a27ed49d54bd None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:18.119009 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d076a7-1765-415a-ab68-a27ed49d54bd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:18.119320 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d076a7-1765-415a-ab68-a27ed49d54bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:18.120788 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d076a7-1765-415a-ab68-a27ed49d54bd None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:18.157204 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 258/505] 10.222.0.25 () {56 vars in 1133 bytes} [Mon May 23 12:19:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:18.158066 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d076a7-1765-415a-ab68-a27ed49d54bd None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:18.159101 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda2050-2d17-422c-b6ad-078a2ea0511a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:18.159771 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda2050-2d17-422c-b6ad-078a2ea0511a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:18.160061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda2050-2d17-422c-b6ad-078a2ea0511a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:18.160355 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda2050-2d17-422c-b6ad-078a2ea0511a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:18.238881 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda2050-2d17-422c-b6ad-078a2ea0511a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:18.240279 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda2050-2d17-422c-b6ad-078a2ea0511a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:18.261606 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d076a7-1765-415a-ab68-a27ed49d54bd None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:18.295552 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f9fb7-7609-4fb1-bf8a-eb9bf11ec1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:18.296207 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f9fb7-7609-4fb1-bf8a-eb9bf11ec1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:18.296488 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f9fb7-7609-4fb1-bf8a-eb9bf11ec1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:18.296774 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f9fb7-7609-4fb1-bf8a-eb9bf11ec1b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:18.297504 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f9fb7-7609-4fb1-bf8a-eb9bf11ec1b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:18.297808 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f9fb7-7609-4fb1-bf8a-eb9bf11ec1b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:18.299207 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f9fb7-7609-4fb1-bf8a-eb9bf11ec1b7 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:18.307480 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 259/506] 10.222.0.25 () {56 vars in 1103 bytes} [Mon May 23 12:19:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:18.308262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f9fb7-7609-4fb1-bf8a-eb9bf11ec1b7 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:18.326414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:18.339346 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:18.343227 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 248/507] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:19:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:19:18.344041 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda2050-2d17-422c-b6ad-078a2ea0511a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:18.413440 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f9fb7-7609-4fb1-bf8a-eb9bf11ec1b7 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:18.444043 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda2050-2d17-422c-b6ad-078a2ea0511a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:18.446285 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa8d34-9383-4995-8fd7-19a336f51092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:18.447162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa8d34-9383-4995-8fd7-19a336f51092 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:18.447443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa8d34-9383-4995-8fd7-19a336f51092 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:18.447718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa8d34-9383-4995-8fd7-19a336f51092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:18.459233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa8d34-9383-4995-8fd7-19a336f51092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:18.460920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa8d34-9383-4995-8fd7-19a336f51092 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:18.483402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-4aaa8d34-9383-4995-8fd7-19a336f51092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:18.483402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:18.483402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:18.483402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:18.483402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:18.483402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:18.483402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:18.483402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:18.483402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:18.483402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:18.483402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:18.483402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:18.483402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:18.483402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:18.483402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:18.484491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:18.484491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:18.484491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:18.484491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:18.484491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:18.484491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:18.484491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:18.484491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:18.484491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:18.484491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:18.484491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:18.484491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:18.484491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:18.484491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:18.484491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:18.484491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:18.484491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:18.485484 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:18.485484 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:18.485484 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:18.485484 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:18.485484 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 260/508] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:18.485484 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa8d34-9383-4995-8fd7-19a336f51092 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:18.492764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26381b-52ae-430e-9280-1b269336d796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:18.493491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26381b-52ae-430e-9280-1b269336d796 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:18.493771 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26381b-52ae-430e-9280-1b269336d796 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:18.494041 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26381b-52ae-430e-9280-1b269336d796 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:18.504025 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26381b-52ae-430e-9280-1b269336d796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:18.505494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26381b-52ae-430e-9280-1b269336d796 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:18.523752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-cd26381b-52ae-430e-9280-1b269336d796 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:18.523752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:18.523752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:18.523752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:18.523752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:18.523752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:18.523752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:18.523752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:18.523752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:18.523752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:18.523752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:18.523752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:18.523752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:18.523752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:18.523752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:18.524710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:18.524710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:18.524710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:18.524710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:18.524710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:18.524710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:18.524710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:18.524710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:18.524710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:18.524710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:18.524710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:18.524710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:18.524710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:18.524710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:18.524710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:18.524710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:18.524710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:18.525552 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:18.525552 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:18.525552 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:18.525552 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:18.526842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 249/509] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:18.527489 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26381b-52ae-430e-9280-1b269336d796 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:18.561712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:18.573963 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:18.593284 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa8d34-9383-4995-8fd7-19a336f51092 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:18.629761 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26381b-52ae-430e-9280-1b269336d796 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:18.632524 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a464ca-268f-4f3f-98cc-4b7a370e1ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:18.633175 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a464ca-268f-4f3f-98cc-4b7a370e1ffa None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:18.633462 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a464ca-268f-4f3f-98cc-4b7a370e1ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:18.633747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a464ca-268f-4f3f-98cc-4b7a370e1ffa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:18.666131 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0487395-9d5e-4a39-8211-1a08bdb1b429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:18.666955 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0487395-9d5e-4a39-8211-1a08bdb1b429 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:18.667244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0487395-9d5e-4a39-8211-1a08bdb1b429 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:18.667512 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0487395-9d5e-4a39-8211-1a08bdb1b429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:18.677563 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0487395-9d5e-4a39-8211-1a08bdb1b429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:18.679629 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0487395-9d5e-4a39-8211-1a08bdb1b429 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:18.697125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-a0487395-9d5e-4a39-8211-1a08bdb1b429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:18.697125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:18.697125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:18.697125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:18.697125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:18.697125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:18.697125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:18.697125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:18.697125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:18.697125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:18.697125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:18.697125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:18.697125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:18.697125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:18.697125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:18.698032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:18.698032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:18.698032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:18.698032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:18.698032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:18.698032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:18.698032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:18.698032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:18.698032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:18.698032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:18.698032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:18.698032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:18.698032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:18.698032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:18.698032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:18.698032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:18.698032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:18.699085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:18.699085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:18.699085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:18.699085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:18.699085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 250/510] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:18.699648 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0487395-9d5e-4a39-8211-1a08bdb1b429 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:18.726083 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a464ca-268f-4f3f-98cc-4b7a370e1ffa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:18.727678 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a464ca-268f-4f3f-98cc-4b7a370e1ffa None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:18.790341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:18.803584 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0487395-9d5e-4a39-8211-1a08bdb1b429 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:18.824590 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:18.842558 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 261/511] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:19:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:19:18.843525 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a464ca-268f-4f3f-98cc-4b7a370e1ffa None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:18.844897 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27540925-a6da-4f74-b283-e3d21d447d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:18.845776 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27540925-a6da-4f74-b283-e3d21d447d00 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:18.846069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27540925-a6da-4f74-b283-e3d21d447d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:18.846383 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27540925-a6da-4f74-b283-e3d21d447d00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:18.859622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27540925-a6da-4f74-b283-e3d21d447d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:18.861371 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27540925-a6da-4f74-b283-e3d21d447d00 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:18.879331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-27540925-a6da-4f74-b283-e3d21d447d00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:18.879331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:18.879331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:18.879331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:18.879331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:18.879331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:18.879331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:18.879331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:18.879331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:18.879331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:18.879331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:18.879331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:18.879331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:18.879331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:18.879331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:18.880258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:18.880258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:18.880258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:18.880258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:18.880258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:18.880258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:18.880258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:18.880258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:18.880258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:18.880258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:18.880258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:18.880258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:18.880258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:18.880258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:18.880258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:18.880258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:18.880258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:18.881132 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:18.881132 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:18.881132 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:18.881132 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:18.881132 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 251/512] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:18.881388 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27540925-a6da-4f74-b283-e3d21d447d00 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:18.959657 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a464ca-268f-4f3f-98cc-4b7a370e1ffa None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:18.980889 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27540925-a6da-4f74-b283-e3d21d447d00 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:18.997483 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3623dc-fd8a-434e-b598-2eaaca4269f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:18.998154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3623dc-fd8a-434e-b598-2eaaca4269f7 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:18.998443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3623dc-fd8a-434e-b598-2eaaca4269f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:18.998776 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3623dc-fd8a-434e-b598-2eaaca4269f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:18.999599 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3623dc-fd8a-434e-b598-2eaaca4269f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:18.999911 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3623dc-fd8a-434e-b598-2eaaca4269f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:19.001293 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3623dc-fd8a-434e-b598-2eaaca4269f7 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:19.012906 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 262/513] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:19.013730 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3623dc-fd8a-434e-b598-2eaaca4269f7 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:19.019828 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95584e3f-c920-45cb-bb3c-abf5cfb1c173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:19.020503 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95584e3f-c920-45cb-bb3c-abf5cfb1c173 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:19.020785 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95584e3f-c920-45cb-bb3c-abf5cfb1c173 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:19.021059 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95584e3f-c920-45cb-bb3c-abf5cfb1c173 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:19.021793 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95584e3f-c920-45cb-bb3c-abf5cfb1c173 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:19.022249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95584e3f-c920-45cb-bb3c-abf5cfb1c173 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:19.024469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95584e3f-c920-45cb-bb3c-abf5cfb1c173 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:19.033572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:19.037523 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 252/514] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:19.038990 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95584e3f-c920-45cb-bb3c-abf5cfb1c173 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:19.067883 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:19.135114 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3623dc-fd8a-434e-b598-2eaaca4269f7 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:19.165741 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95584e3f-c920-45cb-bb3c-abf5cfb1c173 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:19.171396 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10209195-fe4d-4705-b3a4-32626d9e7b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:19.172070 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10209195-fe4d-4705-b3a4-32626d9e7b70 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:19.172357 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10209195-fe4d-4705-b3a4-32626d9e7b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:19.172636 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10209195-fe4d-4705-b3a4-32626d9e7b70 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:19.173367 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10209195-fe4d-4705-b3a4-32626d9e7b70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:19.173684 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10209195-fe4d-4705-b3a4-32626d9e7b70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:19.175127 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10209195-fe4d-4705-b3a4-32626d9e7b70 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:19.189532 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 263/515] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:19.190398 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10209195-fe4d-4705-b3a4-32626d9e7b70 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:19.212208 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a7601-f65a-441a-a08a-9605711bd508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:19.213007 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a7601-f65a-441a-a08a-9605711bd508 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:19.213290 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a7601-f65a-441a-a08a-9605711bd508 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:19.213567 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a7601-f65a-441a-a08a-9605711bd508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:19.224904 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a7601-f65a-441a-a08a-9605711bd508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:19.226440 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a7601-f65a-441a-a08a-9605711bd508 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:19.246787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-c15a7601-f65a-441a-a08a-9605711bd508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:19.246787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:19.246787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:19.246787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:19.246787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:19.246787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:19.246787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:19.246787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:19.246787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:19.246787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:19.246787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:19.246787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:19.246787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:19.246787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:19.246787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:19.248497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:19.248497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:19.248497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:19.248497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:19.248497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:19.248497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:19.248497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:19.248497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:19.248497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:19.248497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:19.248497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:19.248497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:19.248497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:19.248497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:19.248497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:19.248497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:19.248497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:19.250204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:19.250204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:19.250204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:19.250204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:19.250204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 253/516] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:19.250204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a7601-f65a-441a-a08a-9605711bd508 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:19.306889 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:19.310871 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10209195-fe4d-4705-b3a4-32626d9e7b70 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:19.313518 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:19.351395 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c25188-e920-4071-8088-d1f3dcbfa4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:19.352073 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c25188-e920-4071-8088-d1f3dcbfa4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:19.352360 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c25188-e920-4071-8088-d1f3dcbfa4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:19.352646 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c25188-e920-4071-8088-d1f3dcbfa4f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:19.353376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c25188-e920-4071-8088-d1f3dcbfa4f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:19.353686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c25188-e920-4071-8088-d1f3dcbfa4f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:19.355124 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c25188-e920-4071-8088-d1f3dcbfa4f9 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:19.358993 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a7601-f65a-441a-a08a-9605711bd508 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:19.367026 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 264/517] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:19.367847 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c25188-e920-4071-8088-d1f3dcbfa4f9 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:19.393501 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc67746-3c33-4e83-81e7-3d99bbd216b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:19.394203 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc67746-3c33-4e83-81e7-3d99bbd216b5 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:19.394492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc67746-3c33-4e83-81e7-3d99bbd216b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:19.394805 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc67746-3c33-4e83-81e7-3d99bbd216b5 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:19.395517 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc67746-3c33-4e83-81e7-3d99bbd216b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:19.396983 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc67746-3c33-4e83-81e7-3d99bbd216b5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:19.421738 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 254/518] 10.222.0.25 () {60 vars in 1132 bytes} [Mon May 23 12:19:19 2022] POST /identity/v3/users => generated 247 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:19:19.423167 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc67746-3c33-4e83-81e7-3d99bbd216b5 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:19.536462 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c25188-e920-4071-8088-d1f3dcbfa4f9 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:19.586159 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc67746-3c33-4e83-81e7-3d99bbd216b5 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:19.586811 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51722d77-da20-43ba-b360-182143f9dc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:19.588339 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51722d77-da20-43ba-b360-182143f9dc9d None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:19.588808 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51722d77-da20-43ba-b360-182143f9dc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:19.589276 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51722d77-da20-43ba-b360-182143f9dc9d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:19.604377 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:19.605959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51722d77-da20-43ba-b360-182143f9dc9d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:19.608315 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51722d77-da20-43ba-b360-182143f9dc9d None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:19.627621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-51722d77-da20-43ba-b360-182143f9dc9d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 12:19:19.627621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:19.627621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:19.627621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:19.627621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:19.627621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:19.627621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:19.627621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:19.627621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:19.627621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:19.627621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:19.627621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:19.627621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:19.627621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:19.627621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:19.627621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:19.629475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:19.629475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:19.629475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:19.629475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:19.629475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:19.629475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:19.629475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:19.629475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:19.629475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:19.629475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:19.629475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:19.629475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:19.629475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:19.629475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:19.629475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:19.629475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:19.629475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:19.629475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:19.631551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:19.631551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:19.631551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:19.631551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:19.631551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:19.631551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:19.631551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:19.631551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:19.631551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 12:19:19.631551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:19.631551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 265/519] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:19:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:19.631551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51722d77-da20-43ba-b360-182143f9dc9d None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:19.648666 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0defa28-07d6-46cd-9ee5-23a0cfc35d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:19.649573 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0defa28-07d6-46cd-9ee5-23a0cfc35d73 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:19.649918 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0defa28-07d6-46cd-9ee5-23a0cfc35d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:19.650263 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0defa28-07d6-46cd-9ee5-23a0cfc35d73 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:19.659085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0defa28-07d6-46cd-9ee5-23a0cfc35d73 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:19.660807 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0defa28-07d6-46cd-9ee5-23a0cfc35d73 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:19.666570 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:19.680605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-c0defa28-07d6-46cd-9ee5-23a0cfc35d73 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 12:19:19.680605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:19.680605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:19.680605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:19.680605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:19.680605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:19.680605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:19.680605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:19.680605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:19.680605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:19.680605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:19.680605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:19.680605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:19.680605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:19.680605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:19.680605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:19.681535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:19.681535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:19.681535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:19.681535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:19.681535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:19.681535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:19.681535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:19.681535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:19.681535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:19.681535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:19.681535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:19.681535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:19.681535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:19.681535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:19.681535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:19.681535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:19.681535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:19.681535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:19.682486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:19.682486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:19.682486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:19.682486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:19.682486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:19.682486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:19.682486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:19.682486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:19.682486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 12:19:19.682486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:19.682486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 255/520] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:19:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:19.683138 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0defa28-07d6-46cd-9ee5-23a0cfc35d73 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:19.787193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51722d77-da20-43ba-b360-182143f9dc9d None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:19.804243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0defa28-07d6-46cd-9ee5-23a0cfc35d73 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:19.824538 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b92af-ea89-4fbf-bbd5-055a1a251c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:19.825187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b92af-ea89-4fbf-bbd5-055a1a251c53 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:19.825971 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b92af-ea89-4fbf-bbd5-055a1a251c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:19.825971 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b92af-ea89-4fbf-bbd5-055a1a251c53 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:19.826449 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b92af-ea89-4fbf-bbd5-055a1a251c53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:19.826786 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b92af-ea89-4fbf-bbd5-055a1a251c53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:19.828161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b92af-ea89-4fbf-bbd5-055a1a251c53 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:19.850988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 266/521] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:19.850988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b92af-ea89-4fbf-bbd5-055a1a251c53 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:19.872496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74def1d-e953-43c4-97d0-69f8ea483f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:19.873334 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74def1d-e953-43c4-97d0-69f8ea483f30 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:19.873648 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74def1d-e953-43c4-97d0-69f8ea483f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:19.873994 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74def1d-e953-43c4-97d0-69f8ea483f30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:19.881386 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74def1d-e953-43c4-97d0-69f8ea483f30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:19.883479 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74def1d-e953-43c4-97d0-69f8ea483f30 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:19.899486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-a74def1d-e953-43c4-97d0-69f8ea483f30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:19.899486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:19.899486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:19.899486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:19.899486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:19.899486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:19.899486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:19.899486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:19.899486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:19.899486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:19.899486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:19.899486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:19.899486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:19.899486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:19.899486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:19.901169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:19.901169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:19.901169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:19.901169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:19.901169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:19.901169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:19.901169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:19.901169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:19.901169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:19.901169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:19.901169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:19.901169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:19.901169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:19.901169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:19.901169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:19.901169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:19.901169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:19.902892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:19.902892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:19.902892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:19.902892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:19.902892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:19.902892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:19.902892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:19.902892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:19.905606 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 256/522] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:19.906520 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74def1d-e953-43c4-97d0-69f8ea483f30 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:19.942649 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:19.967845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:19.989959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b92af-ea89-4fbf-bbd5-055a1a251c53 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:20.044545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec846802-5494-48ac-8387-7fd74decb4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:20.045537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec846802-5494-48ac-8387-7fd74decb4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:20.046011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec846802-5494-48ac-8387-7fd74decb4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:20.046465 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec846802-5494-48ac-8387-7fd74decb4d7 None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:20.047847 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec846802-5494-48ac-8387-7fd74decb4d7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:20.048308 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec846802-5494-48ac-8387-7fd74decb4d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:20.050816 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec846802-5494-48ac-8387-7fd74decb4d7 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:20.061405 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74def1d-e953-43c4-97d0-69f8ea483f30 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:20.079784 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 267/523] 10.222.0.25 () {56 vars in 1137 bytes} [Mon May 23 12:19:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:20.081067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec846802-5494-48ac-8387-7fd74decb4d7 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:20.126296 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc2192-fb11-4590-aa31-c768a0538384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:20.127254 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc2192-fb11-4590-aa31-c768a0538384 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:20.127802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc2192-fb11-4590-aa31-c768a0538384 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:20.128182 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc2192-fb11-4590-aa31-c768a0538384 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:20.129493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc2192-fb11-4590-aa31-c768a0538384 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:20.129947 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc2192-fb11-4590-aa31-c768a0538384 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:20.132489 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc2192-fb11-4590-aa31-c768a0538384 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:20.166066 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 257/524] 10.222.0.25 () {56 vars in 1139 bytes} [Mon May 23 12:19:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:20.166066 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc2192-fb11-4590-aa31-c768a0538384 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:20.252832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec846802-5494-48ac-8387-7fd74decb4d7 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:20.301006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc7b98-d7eb-42b6-8913-ef008269161b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:20.301006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc7b98-d7eb-42b6-8913-ef008269161b None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:20.301006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc7b98-d7eb-42b6-8913-ef008269161b None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:20.302098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc7b98-d7eb-42b6-8913-ef008269161b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:20.307062 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:20.310071 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc7b98-d7eb-42b6-8913-ef008269161b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:20.311652 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc7b98-d7eb-42b6-8913-ef008269161b None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:20.327094 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc2192-fb11-4590-aa31-c768a0538384 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:20.327866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-acbc7b98-d7eb-42b6-8913-ef008269161b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:20.327866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:20.327866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:20.327866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:20.327866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:20.327866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:20.327866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:20.327866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:20.327866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:20.327866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:20.327866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:20.327866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:20.327866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:20.327866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:20.327866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:20.329377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:20.329377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:20.329377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:20.329377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:20.329377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:20.329377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:20.329377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:20.329377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:20.329377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:20.329377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:20.329377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:20.329377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:20.329377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:20.329377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:20.329377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:20.329377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:20.329377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:20.331010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:20.331010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:20.331010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:20.331010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:20.331010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:20.331010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:20.331010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:20.331010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:20.331010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 268/525] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:20.331010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc7b98-d7eb-42b6-8913-ef008269161b None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:20.337872 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:20.379145 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7627b-c924-44aa-b18a-1210141aefbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:20.379951 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7627b-c924-44aa-b18a-1210141aefbb None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:20.380370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7627b-c924-44aa-b18a-1210141aefbb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:20.380844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7627b-c924-44aa-b18a-1210141aefbb None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:20.382551 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7627b-c924-44aa-b18a-1210141aefbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:20.382730 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7627b-c924-44aa-b18a-1210141aefbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:20.384522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7627b-c924-44aa-b18a-1210141aefbb None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:20.407277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 258/526] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:20.408239 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7627b-c924-44aa-b18a-1210141aefbb None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:20.466958 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc7b98-d7eb-42b6-8913-ef008269161b None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:20.508419 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf82cf-50c0-4eb6-8e20-3f7061d9b5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:20.509429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf82cf-50c0-4eb6-8e20-3f7061d9b5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:20.509853 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf82cf-50c0-4eb6-8e20-3f7061d9b5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:20.510310 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf82cf-50c0-4eb6-8e20-3f7061d9b5c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:20.530192 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7627b-c924-44aa-b18a-1210141aefbb None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:20.570526 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58369ec-4574-4057-a92a-82905b724b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:20.571351 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58369ec-4574-4057-a92a-82905b724b4f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:20.571639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58369ec-4574-4057-a92a-82905b724b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:20.572035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58369ec-4574-4057-a92a-82905b724b4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:20.590632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:20.603113 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf82cf-50c0-4eb6-8e20-3f7061d9b5c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:20.604637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf82cf-50c0-4eb6-8e20-3f7061d9b5c7 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:20.608037 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:20.661194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58369ec-4574-4057-a92a-82905b724b4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:20.662602 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58369ec-4574-4057-a92a-82905b724b4f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:20.730087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 269/527] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:19:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:19:20.731929 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf82cf-50c0-4eb6-8e20-3f7061d9b5c7 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:20.790980 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 259/528] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:19:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:19:20.791846 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58369ec-4574-4057-a92a-82905b724b4f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:20.847802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:20.873140 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf82cf-50c0-4eb6-8e20-3f7061d9b5c7 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:20.875660 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:20.917040 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58369ec-4574-4057-a92a-82905b724b4f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:20.921471 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78dd55-5e92-4152-88b6-7483a7742f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:20.922752 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78dd55-5e92-4152-88b6-7483a7742f6a None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:20.923220 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78dd55-5e92-4152-88b6-7483a7742f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:20.923682 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78dd55-5e92-4152-88b6-7483a7742f6a None admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:20.925088 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78dd55-5e92-4152-88b6-7483a7742f6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:20.925610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78dd55-5e92-4152-88b6-7483a7742f6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:20.928170 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78dd55-5e92-4152-88b6-7483a7742f6a None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:20.961717 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 270/529] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:20.961717 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78dd55-5e92-4152-88b6-7483a7742f6a None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:20.977882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7ce40-a447-414c-bb13-af5945a26ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:20.978939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7ce40-a447-414c-bb13-af5945a26ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:20.979412 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7ce40-a447-414c-bb13-af5945a26ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:20.979882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7ce40-a447-414c-bb13-af5945a26ee2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:20.981517 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7ce40-a447-414c-bb13-af5945a26ee2 None admin] RBAC: Adding query filter params (role.id=e344e91a09be4d10834ea5f942345beb, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=8ed824e419544b33a2c4413da4b45aaf) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:20.982142 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7ce40-a447-414c-bb13-af5945a26ee2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:20.985103 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7ce40-a447-414c-bb13-af5945a26ee2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:21.002537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 260/530] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:19:20 2022] GET /identity/v3/role_assignments?user.id=8ed824e419544b33a2c4413da4b45aaf&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=e344e91a09be4d10834ea5f942345beb => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:21.002537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7ce40-a447-414c-bb13-af5945a26ee2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:21.138378 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78dd55-5e92-4152-88b6-7483a7742f6a None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:21.188360 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eeeace-7044-4ed3-9be0-afd415c1e579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:21.189132 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eeeace-7044-4ed3-9be0-afd415c1e579 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:21.189424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eeeace-7044-4ed3-9be0-afd415c1e579 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:21.190478 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eeeace-7044-4ed3-9be0-afd415c1e579 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:21.203511 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7ce40-a447-414c-bb13-af5945a26ee2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:21.218348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:21.219615 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eeeace-7044-4ed3-9be0-afd415c1e579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:21.223335 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eeeace-7044-4ed3-9be0-afd415c1e579 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:21.265372 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154e790-7817-4fd3-b39d-2ad0f1c2443a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:21.266711 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154e790-7817-4fd3-b39d-2ad0f1c2443a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:21.267190 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154e790-7817-4fd3-b39d-2ad0f1c2443a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:21.267662 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154e790-7817-4fd3-b39d-2ad0f1c2443a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:21.268919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-18eeeace-7044-4ed3-9be0-afd415c1e579 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:21.268919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:21.268919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:21.268919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:21.268919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:21.268919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:21.268919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:21.268919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:21.268919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:21.268919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:21.268919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:21.268919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:21.268919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:21.268919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:21.268919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:21.271399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:21.271399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:21.271399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:21.271399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:21.271399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:21.271399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:21.271399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:21.271399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:21.271399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:21.271399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:21.271399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:21.271399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:21.271399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:21.271399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:21.271399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:21.271399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:21.271399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:21.272754 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:21.272754 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:21.272754 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:21.272754 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:21.276162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 271/531] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:21.277869 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eeeace-7044-4ed3-9be0-afd415c1e579 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:21.287041 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154e790-7817-4fd3-b39d-2ad0f1c2443a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:21.289803 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154e790-7817-4fd3-b39d-2ad0f1c2443a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:21.308317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:21.321542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-c154e790-7817-4fd3-b39d-2ad0f1c2443a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:21.321542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:21.321542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:21.321542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:21.321542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:21.321542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:21.321542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:21.321542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:21.321542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:21.321542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:21.321542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:21.321542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:21.321542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:21.321542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:21.321542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:21.323270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:21.323270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:21.323270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:21.323270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:21.323270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:21.323270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:21.323270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:21.323270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:21.323270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:21.323270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:21.323270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:21.323270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:21.323270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:21.323270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:21.323270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:21.323270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:21.323270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:21.324939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:21.324939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:21.324939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:21.324939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:21.330155 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 261/532] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:21.331700 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154e790-7817-4fd3-b39d-2ad0f1c2443a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:21.447891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eeeace-7044-4ed3-9be0-afd415c1e579 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:21.467821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154e790-7817-4fd3-b39d-2ad0f1c2443a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:21.492873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671cf42-8f25-451e-ab1e-b96b4adc6cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:21.494054 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671cf42-8f25-451e-ab1e-b96b4adc6cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:21.494474 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671cf42-8f25-451e-ab1e-b96b4adc6cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:21.494956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671cf42-8f25-451e-ab1e-b96b4adc6cb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:21.496115 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671cf42-8f25-451e-ab1e-b96b4adc6cb4 None admin] RBAC: Adding query filter params (role.id=e344e91a09be4d10834ea5f942345beb, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=d49997b9108145b78eb4db1d8823bf4d) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:21.496848 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671cf42-8f25-451e-ab1e-b96b4adc6cb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:21.498608 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671cf42-8f25-451e-ab1e-b96b4adc6cb4 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:21.505100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c80a8-7f4f-410a-ae03-3fc47022a503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:21.505880 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c80a8-7f4f-410a-ae03-3fc47022a503 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:21.506181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 272/533] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:19:21 2022] GET /identity/v3/role_assignments?user.id=d49997b9108145b78eb4db1d8823bf4d&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=e344e91a09be4d10834ea5f942345beb => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:21.507551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671cf42-8f25-451e-ab1e-b96b4adc6cb4 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:21.511111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c80a8-7f4f-410a-ae03-3fc47022a503 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:21.511530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c80a8-7f4f-410a-ae03-3fc47022a503 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:21.512433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c80a8-7f4f-410a-ae03-3fc47022a503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:21.512852 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c80a8-7f4f-410a-ae03-3fc47022a503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:21.514530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c80a8-7f4f-410a-ae03-3fc47022a503 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:21.549119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 262/534] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:21.556392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c80a8-7f4f-410a-ae03-3fc47022a503 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:21.611340 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:21.628463 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:21.641986 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671cf42-8f25-451e-ab1e-b96b4adc6cb4 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:21.685441 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff76557-705a-49ee-ae8e-d9cfc52b5733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:21.686236 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff76557-705a-49ee-ae8e-d9cfc52b5733 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:21.686551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff76557-705a-49ee-ae8e-d9cfc52b5733 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:21.687234 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff76557-705a-49ee-ae8e-d9cfc52b5733 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:21.688726 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff76557-705a-49ee-ae8e-d9cfc52b5733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:21.689091 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff76557-705a-49ee-ae8e-d9cfc52b5733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:21.691030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff76557-705a-49ee-ae8e-d9cfc52b5733 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:21.706882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 273/535] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:21.716329 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff76557-705a-49ee-ae8e-d9cfc52b5733 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:21.808714 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c80a8-7f4f-410a-ae03-3fc47022a503 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:21.856153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d358be2-c1b3-468d-9e30-7d74715625f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:21.857647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d358be2-c1b3-468d-9e30-7d74715625f8 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:21.858189 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d358be2-c1b3-468d-9e30-7d74715625f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:21.858468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d358be2-c1b3-468d-9e30-7d74715625f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:21.866954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d358be2-c1b3-468d-9e30-7d74715625f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:21.868686 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d358be2-c1b3-468d-9e30-7d74715625f8 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:21.884554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-1d358be2-c1b3-468d-9e30-7d74715625f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:21.884554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:21.884554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:21.884554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:21.884554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:21.884554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:21.884554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:21.884554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:21.884554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:21.884554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:21.884554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:21.884554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:21.884554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:21.884554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:21.884554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:21.886111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:21.886111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:21.886111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:21.886111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:21.886111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:21.886111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:21.886111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:21.886111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:21.886111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:21.886111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:21.886111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:21.886111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:21.886111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:21.886111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:21.886111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:21.886111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:21.886111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:21.887893 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:21.887893 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:21.887893 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:21.887893 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:21.887893 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:21.887893 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:21.887893 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:21.887893 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:21.887893 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 263/536] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:21.891863 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d358be2-c1b3-468d-9e30-7d74715625f8 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:21.932434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff76557-705a-49ee-ae8e-d9cfc52b5733 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:21.969925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75335ed6-faae-480b-bbae-c1d04a44cfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:21.970716 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75335ed6-faae-480b-bbae-c1d04a44cfbc None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:21.971020 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75335ed6-faae-480b-bbae-c1d04a44cfbc None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:21.971301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75335ed6-faae-480b-bbae-c1d04a44cfbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:21.979007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75335ed6-faae-480b-bbae-c1d04a44cfbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:21.980541 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75335ed6-faae-480b-bbae-c1d04a44cfbc None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:21.982356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:21.997182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-75335ed6-faae-480b-bbae-c1d04a44cfbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:21.997182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:21.997182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:21.997182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:21.997182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:21.997182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:21.997182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:21.997182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:21.997182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:21.997182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:21.997182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:21.997182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:21.997182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:21.997182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:21.997182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:22.000226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:22.000226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:22.000226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:22.000226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:22.000226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:22.000226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:22.000226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:22.000226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:22.000226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:22.000226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:22.000226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:22.000226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:22.000226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:22.000226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:22.000226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:22.000226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:22.000226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:22.008091 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:22.008091 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:22.008091 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:22.008091 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:22.008091 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:22.008091 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:22.008091 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:22.008091 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:22.008091 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 274/537] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:22.010437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:22.010687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75335ed6-faae-480b-bbae-c1d04a44cfbc None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:22.023366 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d358be2-c1b3-468d-9e30-7d74715625f8 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:22.059469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d3e9d-e74a-4aee-b32e-caf619832799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:22.060138 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d3e9d-e74a-4aee-b32e-caf619832799 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:22.060411 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d3e9d-e74a-4aee-b32e-caf619832799 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:22.066532 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d3e9d-e74a-4aee-b32e-caf619832799 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:22.066532 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d3e9d-e74a-4aee-b32e-caf619832799 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:22.066532 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d3e9d-e74a-4aee-b32e-caf619832799 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:22.066532 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d3e9d-e74a-4aee-b32e-caf619832799 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:22.095111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 264/538] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:22.103988 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d3e9d-e74a-4aee-b32e-caf619832799 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:22.194383 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75335ed6-faae-480b-bbae-c1d04a44cfbc None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:22.236405 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d3e9d-e74a-4aee-b32e-caf619832799 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:22.277789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefe4e5-5e72-4a0b-bad7-22a1a090497b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:22.278721 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefe4e5-5e72-4a0b-bad7-22a1a090497b None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:22.278879 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefe4e5-5e72-4a0b-bad7-22a1a090497b None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:22.279032 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefe4e5-5e72-4a0b-bad7-22a1a090497b None admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:22.279947 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefe4e5-5e72-4a0b-bad7-22a1a090497b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:22.280262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefe4e5-5e72-4a0b-bad7-22a1a090497b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:22.281905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefe4e5-5e72-4a0b-bad7-22a1a090497b None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:22.282912 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c85d5e-0bd0-45ca-9117-b452cc3b490c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:22.283752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c85d5e-0bd0-45ca-9117-b452cc3b490c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:22.284108 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c85d5e-0bd0-45ca-9117-b452cc3b490c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:22.284489 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c85d5e-0bd0-45ca-9117-b452cc3b490c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:22.285449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c85d5e-0bd0-45ca-9117-b452cc3b490c None admin] RBAC: Adding query filter params (role.id=e344e91a09be4d10834ea5f942345beb, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=3a3f520fcbe544c9be7e33a64eb1dc20) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:22.285832 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c85d5e-0bd0-45ca-9117-b452cc3b490c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:22.287390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c85d5e-0bd0-45ca-9117-b452cc3b490c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:22.294476 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 265/539] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:19:22 2022] GET /identity/v3/role_assignments?user.id=3a3f520fcbe544c9be7e33a64eb1dc20&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=e344e91a09be4d10834ea5f942345beb => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:22.296002 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 275/540] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:22.300455 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b0153-e8b6-410c-a78c-628d16ee662a None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:22.300804 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b0153-e8b6-410c-a78c-628d16ee662a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:22.301058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b0153-e8b6-410c-a78c-628d16ee662a None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:22.301337 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefe4e5-5e72-4a0b-bad7-22a1a090497b None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:22.302730 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 266/541] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:22.313298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48492d2-3715-484d-9a2f-31ed8e62860f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:22.313774 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48492d2-3715-484d-9a2f-31ed8e62860f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:22.314020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48492d2-3715-484d-9a2f-31ed8e62860f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:22.334847 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:22.342821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b48492d2-3715-484d-9a2f-31ed8e62860f None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:22.344118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b48492d2-3715-484d-9a2f-31ed8e62860f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:22.433575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:22.491836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 267/542] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:19:22.512738 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefe4e5-5e72-4a0b-bad7-22a1a090497b None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:22.537421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48492d2-3715-484d-9a2f-31ed8e62860f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:22.582708 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9e641-9363-45a6-a56c-56a029ffcc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:22.583374 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9e641-9363-45a6-a56c-56a029ffcc33 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:22.583661 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9e641-9363-45a6-a56c-56a029ffcc33 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:22.583940 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9e641-9363-45a6-a56c-56a029ffcc33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:22.585318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9e641-9363-45a6-a56c-56a029ffcc33 None admin] RBAC: Adding query filter params (role.id=e344e91a09be4d10834ea5f942345beb, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=74674b52807742abb7e144bba3bb6e56) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:22.585631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9e641-9363-45a6-a56c-56a029ffcc33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:22.594528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9e641-9363-45a6-a56c-56a029ffcc33 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:22.599955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 276/543] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:19:22 2022] GET /identity/v3/role_assignments?user.id=74674b52807742abb7e144bba3bb6e56&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=e344e91a09be4d10834ea5f942345beb => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:22.690098 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48492d2-3715-484d-9a2f-31ed8e62860f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:22.734283 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43d3e2-b338-44a9-a4c8-a6b987d4f866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:22.735203 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43d3e2-b338-44a9-a4c8-a6b987d4f866 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:22.735538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43d3e2-b338-44a9-a4c8-a6b987d4f866 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:22.735824 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43d3e2-b338-44a9-a4c8-a6b987d4f866 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:22.739133 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:22.750080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43d3e2-b338-44a9-a4c8-a6b987d4f866 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:22.758194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-9f43d3e2-b338-44a9-a4c8-a6b987d4f866 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:22.758194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:22.758194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:22.758194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:22.758194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:22.758194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:22.758194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:22.758194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:22.758194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:22.758194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:22.758194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:22.758194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:22.758194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:22.758194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:22.758194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:22.758194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:22.760011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:22.760011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:22.760011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:22.760011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:22.760011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:22.760011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:22.760011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:22.760011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:22.760011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:22.760011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:22.760011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:22.760011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:22.760011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:22.760011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:22.760011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:22.760011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:22.761599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:22.761599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:22.761599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:22.761599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:22.761599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:22.761599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:22.761599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:22.761599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:22.761599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:22.761599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:22.761599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:22.761599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:22.761599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 268/544] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:19:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:22.774182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9e641-9363-45a6-a56c-56a029ffcc33 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:22.924681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9e641-9363-45a6-a56c-56a029ffcc33 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:22.967466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:22.997391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7735cd-519f-46bd-b9fc-599e9a183123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:23.000399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7735cd-519f-46bd-b9fc-599e9a183123 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:23.000846 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7735cd-519f-46bd-b9fc-599e9a183123 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:23.001328 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7735cd-519f-46bd-b9fc-599e9a183123 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:23.003901 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7735cd-519f-46bd-b9fc-599e9a183123 None admin] RBAC: Adding query filter params (name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:23.004454 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7735cd-519f-46bd-b9fc-599e9a183123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:23.007441 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7735cd-519f-46bd-b9fc-599e9a183123 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:23.023986 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 277/545] 10.222.0.25 () {56 vars in 1103 bytes} [Mon May 23 12:19:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:23.031066 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43d3e2-b338-44a9-a4c8-a6b987d4f866 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:23.230003 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43d3e2-b338-44a9-a4c8-a6b987d4f866 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:23.292337 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f0145-6de6-42a6-b396-7ff06e71a40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:23.293596 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f0145-6de6-42a6-b396-7ff06e71a40a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:23.294097 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f0145-6de6-42a6-b396-7ff06e71a40a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:23.294625 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f0145-6de6-42a6-b396-7ff06e71a40a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:23.313878 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f0145-6de6-42a6-b396-7ff06e71a40a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:23.316575 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f0145-6de6-42a6-b396-7ff06e71a40a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:23.349996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-8e6f0145-6de6-42a6-b396-7ff06e71a40a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:23.349996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:23.349996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:23.349996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:23.349996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:23.349996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:23.349996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:23.349996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:23.349996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:23.349996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:23.349996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:23.349996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:23.349996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:23.349996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:23.349996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:23.351651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:23.351651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:23.351651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:23.351651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:23.351651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:23.351651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:23.351651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:23.351651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:23.351651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:23.351651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:23.351651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:23.351651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:23.351651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:23.351651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:23.351651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:23.351651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:23.351651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:23.352583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:23.352583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:23.352583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:23.352583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:23.353843 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 269/546] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:23.364272 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7735cd-519f-46bd-b9fc-599e9a183123 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:23.614068 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7735cd-519f-46bd-b9fc-599e9a183123 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:23.695562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1f3d0-4ae0-486e-b93c-a54b69a2e526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:23.696638 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1f3d0-4ae0-486e-b93c-a54b69a2e526 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:23.697178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1f3d0-4ae0-486e-b93c-a54b69a2e526 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:23.697655 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1f3d0-4ae0-486e-b93c-a54b69a2e526 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:23.698963 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1f3d0-4ae0-486e-b93c-a54b69a2e526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:23.699474 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1f3d0-4ae0-486e-b93c-a54b69a2e526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:23.701973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1f3d0-4ae0-486e-b93c-a54b69a2e526 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:23.733197 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 278/547] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:23.739129 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f0145-6de6-42a6-b396-7ff06e71a40a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:23.841623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:23.939568 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f0145-6de6-42a6-b396-7ff06e71a40a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:24.023535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e718f6-8ae4-41e4-8828-d224251f6ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:24.024893 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e718f6-8ae4-41e4-8828-d224251f6ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:24.025392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e718f6-8ae4-41e4-8828-d224251f6ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:24.025881 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e718f6-8ae4-41e4-8828-d224251f6ff6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:24.048222 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e718f6-8ae4-41e4-8828-d224251f6ff6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:24.051071 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e718f6-8ae4-41e4-8828-d224251f6ff6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:24.095042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-38e718f6-8ae4-41e4-8828-d224251f6ff6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 12:19:24.095042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:24.095042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:24.095042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:24.095042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:24.095042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:24.095042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:24.095042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:24.095042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:24.095042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:24.095042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:24.095042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:24.095042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:24.095042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:24.095042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:24.095042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:24.096496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:24.096496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:24.096496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:24.096496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:24.096496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:24.096496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:24.096496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:24.096496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:24.096496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:24.096496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:24.096496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:24.096496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:24.096496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:24.096496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:24.096496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:24.096496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:24.096496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:24.096496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:24.097561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:24.097561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:24.097561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:24.097561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:24.097561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:24.097561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:24.097561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:24.097561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:24.097561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 12:19:24.097561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:24.098085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 270/548] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:19:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:24.105096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1f3d0-4ae0-486e-b93c-a54b69a2e526 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:24.213133 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a264c8b-7548-4ecb-bf68-05757ae1502e None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:24.213539 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a264c8b-7548-4ecb-bf68-05757ae1502e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:24.214011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a264c8b-7548-4ecb-bf68-05757ae1502e None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:24.216751 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 271/549] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:24.239099 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:24.240902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c748800-ce62-4f5b-be7f-3707d1ea3c0b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:24.241406 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c748800-ce62-4f5b-be7f-3707d1ea3c0b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:24.241893 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c748800-ce62-4f5b-be7f-3707d1ea3c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:24.295102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1f3d0-4ae0-486e-b93c-a54b69a2e526 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:24.316212 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0c748800-ce62-4f5b-be7f-3707d1ea3c0b None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:24.318126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0c748800-ce62-4f5b-be7f-3707d1ea3c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:24.332004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153273cc-6c78-461a-8277-91230aff1efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:24.332908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153273cc-6c78-461a-8277-91230aff1efe None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:24.333261 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153273cc-6c78-461a-8277-91230aff1efe None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:24.333608 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153273cc-6c78-461a-8277-91230aff1efe None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:24.334623 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153273cc-6c78-461a-8277-91230aff1efe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:24.335597 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153273cc-6c78-461a-8277-91230aff1efe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:24.337299 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153273cc-6c78-461a-8277-91230aff1efe None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:24.385160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 279/550] 10.222.0.25 () {56 vars in 1135 bytes} [Mon May 23 12:19:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:24.390318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153273cc-6c78-461a-8277-91230aff1efe None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:24.489456 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 272/551] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:24.514585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c748800-ce62-4f5b-be7f-3707d1ea3c0b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:24.606679 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:24.685512 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153273cc-6c78-461a-8277-91230aff1efe None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:24.690958 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:24.729979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c748800-ce62-4f5b-be7f-3707d1ea3c0b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:24.774321 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7500ae-4d21-4293-9605-9b80abcf8979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:24.774910 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7500ae-4d21-4293-9605-9b80abcf8979 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:24.775201 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7500ae-4d21-4293-9605-9b80abcf8979 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:24.775475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7500ae-4d21-4293-9605-9b80abcf8979 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:24.801579 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c53e89-7301-4c62-935a-88ac4367bf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:24.804099 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c53e89-7301-4c62-935a-88ac4367bf7a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:24.805141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c53e89-7301-4c62-935a-88ac4367bf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:24.808286 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c53e89-7301-4c62-935a-88ac4367bf7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:24.842067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c53e89-7301-4c62-935a-88ac4367bf7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:24.870728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-95c53e89-7301-4c62-935a-88ac4367bf7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:24.870728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:24.870728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:24.870728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:24.870728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:24.870728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:24.870728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:24.870728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:24.870728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:24.870728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:24.870728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:24.870728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:24.870728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:24.870728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:24.870728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:24.870728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:24.872661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:24.872661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:24.872661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:24.872661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:24.872661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:24.872661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:24.872661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:24.872661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:24.872661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:24.872661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:24.872661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:24.872661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:24.872661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:24.872661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:24.872661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:24.872661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:24.874304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:24.874304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:24.874304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:24.874304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:24.874304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:24.874304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:24.874304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:24.874304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:24.874304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:24.874304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:24.874304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:24.874304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:24.885425 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 273/552] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:19:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:24.898374 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c53e89-7301-4c62-935a-88ac4367bf7a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:24.929085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7500ae-4d21-4293-9605-9b80abcf8979 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:24.930785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7500ae-4d21-4293-9605-9b80abcf8979 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:25.044664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 280/553] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:19:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:19:25.046174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dc2cf-f701-4768-89c4-91f15114eb2c None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:25.046611 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dc2cf-f701-4768-89c4-91f15114eb2c None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:25.046995 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dc2cf-f701-4768-89c4-91f15114eb2c None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:25.052534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 281/554] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:25.054196 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399dc2cf-f701-4768-89c4-91f15114eb2c None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:25.057446 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:25.095747 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:25.103366 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c53e89-7301-4c62-935a-88ac4367bf7a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:25.171424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399dc2cf-f701-4768-89c4-91f15114eb2c None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:25.172981 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26565bbe-3b24-4d05-bc80-53d08cc37041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:25.174725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26565bbe-3b24-4d05-bc80-53d08cc37041 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:25.175514 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26565bbe-3b24-4d05-bc80-53d08cc37041 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:25.176259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26565bbe-3b24-4d05-bc80-53d08cc37041 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:25.177949 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26565bbe-3b24-4d05-bc80-53d08cc37041 None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:25.178852 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26565bbe-3b24-4d05-bc80-53d08cc37041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:25.182079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26565bbe-3b24-4d05-bc80-53d08cc37041 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:25.201259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 274/555] 10.222.0.25 () {56 vars in 1103 bytes} [Mon May 23 12:19:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:25.204081 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1451b0b-a093-48ab-8742-d545316ae531 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:25.205013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1451b0b-a093-48ab-8742-d545316ae531 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:25.205852 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1451b0b-a093-48ab-8742-d545316ae531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:25.210392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d58973-1a20-4091-ab01-b4b8ac4dc239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:25.211294 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d58973-1a20-4091-ab01-b4b8ac4dc239 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:25.211642 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d58973-1a20-4091-ab01-b4b8ac4dc239 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:25.211983 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d58973-1a20-4091-ab01-b4b8ac4dc239 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:25.223541 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d58973-1a20-4091-ab01-b4b8ac4dc239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:25.225659 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d58973-1a20-4091-ab01-b4b8ac4dc239 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:25.238322 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d1451b0b-a093-48ab-8742-d545316ae531 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:25.240848 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d1451b0b-a093-48ab-8742-d545316ae531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:25.245087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-78d58973-1a20-4091-ab01-b4b8ac4dc239 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:25.245087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:25.245087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:25.245087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:25.245087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:25.245087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:25.245087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:25.245087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:25.245087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:25.245087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:25.245087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:25.245087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:25.245087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:25.245087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:25.245087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:25.246761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:25.246761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:25.246761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:25.246761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:25.246761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:25.246761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:25.246761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:25.246761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:25.246761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:25.246761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:25.246761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:25.246761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:25.246761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:25.246761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:25.246761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:25.246761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:25.246761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:25.248514 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:25.248514 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:25.248514 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:25.248514 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:25.248514 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 282/556] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:25.248514 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d58973-1a20-4091-ab01-b4b8ac4dc239 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:25.311943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:25.361985 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d58973-1a20-4091-ab01-b4b8ac4dc239 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:25.382299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 275/557] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:25.384727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1451b0b-a093-48ab-8742-d545316ae531 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:25.415724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30626261-d078-426e-bffa-f3427af89af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:25.416565 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30626261-d078-426e-bffa-f3427af89af4 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:25.416831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30626261-d078-426e-bffa-f3427af89af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:25.417078 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30626261-d078-426e-bffa-f3427af89af4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:25.435472 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30626261-d078-426e-bffa-f3427af89af4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:25.437379 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30626261-d078-426e-bffa-f3427af89af4 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:25.457888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-30626261-d078-426e-bffa-f3427af89af4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:25.457888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:25.457888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:25.457888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:25.457888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:25.457888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:25.457888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:25.457888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:25.457888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:25.457888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:25.457888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:25.457888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:25.457888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:25.457888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:25.457888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:25.461030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:25.461030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:25.461030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:25.461030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:25.461030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:25.461030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:25.461030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:25.461030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:25.461030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:25.461030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:25.461030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:25.461030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:25.461030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:25.461030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:25.461030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:25.461030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:25.461030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:25.463449 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:25.463449 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:25.463449 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:25.463449 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:25.463449 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 283/558] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:25.463449 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30626261-d078-426e-bffa-f3427af89af4 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:25.570033 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:25.570928 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30626261-d078-426e-bffa-f3427af89af4 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:25.580051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:25.591943 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1451b0b-a093-48ab-8742-d545316ae531 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:25.610996 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f99a8-7184-452e-af49-b91d13c7104a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:25.612053 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f99a8-7184-452e-af49-b91d13c7104a None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:25.612234 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f99a8-7184-452e-af49-b91d13c7104a None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:25.612593 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f99a8-7184-452e-af49-b91d13c7104a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:25.624683 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f99a8-7184-452e-af49-b91d13c7104a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:25.633313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-692f99a8-7184-452e-af49-b91d13c7104a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:25.633313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:25.633313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:25.633313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:25.633313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:25.633313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:25.633313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:25.633313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:25.633313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:25.633313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:25.633313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:25.633313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:25.633313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:25.633313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:25.633313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:25.633313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:25.635154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:25.635154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:25.635154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:25.635154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:25.635154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:25.635154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:25.635154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:25.635154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:25.635154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:25.635154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:25.635154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:25.635154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:25.635154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:25.635154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:25.635154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:25.635154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:25.636782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:25.636782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:25.636782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:25.636782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:25.636782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:25.636782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:25.636782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:25.636782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:25.636782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:25.636782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:25.636782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:25.636782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:25.636782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 284/559] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:19:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:25.636782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f99a8-7184-452e-af49-b91d13c7104a None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:25.663830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c087c-dc6d-478c-ae07-f1973bd04091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:25.664500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c087c-dc6d-478c-ae07-f1973bd04091 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:25.664902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c087c-dc6d-478c-ae07-f1973bd04091 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:25.665217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c087c-dc6d-478c-ae07-f1973bd04091 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:25.665979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c087c-dc6d-478c-ae07-f1973bd04091 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:25.666244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c087c-dc6d-478c-ae07-f1973bd04091 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:25.667669 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c087c-dc6d-478c-ae07-f1973bd04091 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:25.680913 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 276/560] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:25.684079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c087c-dc6d-478c-ae07-f1973bd04091 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:25.751403 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f99a8-7184-452e-af49-b91d13c7104a None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:25.790985 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844fd86-4aea-482d-ad0a-ffd6b5e34687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:25.792009 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844fd86-4aea-482d-ad0a-ffd6b5e34687 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:25.792475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844fd86-4aea-482d-ad0a-ffd6b5e34687 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:25.792924 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844fd86-4aea-482d-ad0a-ffd6b5e34687 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:25.794196 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844fd86-4aea-482d-ad0a-ffd6b5e34687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:25.794773 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844fd86-4aea-482d-ad0a-ffd6b5e34687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:25.797307 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844fd86-4aea-482d-ad0a-ffd6b5e34687 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:25.821157 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 285/561] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:25.821518 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cad48d-83ec-4687-8cc8-34fb83007160 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:25.821972 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cad48d-83ec-4687-8cc8-34fb83007160 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:25.822466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cad48d-83ec-4687-8cc8-34fb83007160 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:25.825125 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 286/562] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:25.826315 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cad48d-83ec-4687-8cc8-34fb83007160 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:25.834644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c087c-dc6d-478c-ae07-f1973bd04091 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:25.871186 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b60ff8-0f89-4922-bdcd-4b783f98a2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:25.871815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b60ff8-0f89-4922-bdcd-4b783f98a2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:25.872100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b60ff8-0f89-4922-bdcd-4b783f98a2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:25.872374 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b60ff8-0f89-4922-bdcd-4b783f98a2d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:25.873141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b60ff8-0f89-4922-bdcd-4b783f98a2d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:25.873346 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:25.873493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b60ff8-0f89-4922-bdcd-4b783f98a2d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:25.875367 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b60ff8-0f89-4922-bdcd-4b783f98a2d2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:25.888249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 277/563] 10.222.0.25 () {56 vars in 1103 bytes} [Mon May 23 12:19:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:25.888249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b60ff8-0f89-4922-bdcd-4b783f98a2d2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:25.911910 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:26.001035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cad48d-83ec-4687-8cc8-34fb83007160 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:26.053332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b60ff8-0f89-4922-bdcd-4b783f98a2d2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:26.055435 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abd3f7-2041-421a-b1a6-0ff201844f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:26.056605 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abd3f7-2041-421a-b1a6-0ff201844f32 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:26.057661 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abd3f7-2041-421a-b1a6-0ff201844f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:26.057661 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abd3f7-2041-421a-b1a6-0ff201844f32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:26.073827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abd3f7-2041-421a-b1a6-0ff201844f32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:26.076310 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abd3f7-2041-421a-b1a6-0ff201844f32 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:26.099899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-09abd3f7-2041-421a-b1a6-0ff201844f32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:26.099899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:26.099899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:26.099899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:26.099899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:26.099899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:26.099899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:26.099899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:26.099899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:26.099899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:26.099899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:26.099899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:26.099899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:26.099899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:26.099899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:26.101011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:26.101011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:26.101011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:26.101011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:26.101011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:26.101011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:26.101011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:26.101011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:26.101011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:26.101011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:26.101011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:26.101011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:26.101011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:26.101011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:26.101011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:26.101011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:26.101011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:26.102030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:26.102030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:26.102030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:26.102030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:26.102030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:26.102030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:26.102030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:26.102030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:26.102030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 287/564] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:26.103851 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cde736-5886-4172-97ba-52487bca1472 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:26.104341 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cde736-5886-4172-97ba-52487bca1472 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:26.104828 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cde736-5886-4172-97ba-52487bca1472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:26.121029 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5ff96-1d0e-40b2-853b-ab223f70bf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:26.122374 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5ff96-1d0e-40b2-853b-ab223f70bf6c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:26.122900 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5ff96-1d0e-40b2-853b-ab223f70bf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:26.123353 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5ff96-1d0e-40b2-853b-ab223f70bf6c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:26.132448 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-b4cde736-5886-4172-97ba-52487bca1472 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:26.134358 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-b4cde736-5886-4172-97ba-52487bca1472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:26.136213 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5ff96-1d0e-40b2-853b-ab223f70bf6c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:26.138671 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5ff96-1d0e-40b2-853b-ab223f70bf6c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:26.163486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-5df5ff96-1d0e-40b2-853b-ab223f70bf6c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 12:19:26.163486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:26.163486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:26.163486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:26.163486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:26.163486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:26.163486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:26.163486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:26.163486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:26.163486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:26.163486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:26.163486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:26.163486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:26.163486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:26.163486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:26.163486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:26.164729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:26.164729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:26.164729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:26.164729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:26.164729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:26.164729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:26.164729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:26.164729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:26.164729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:26.164729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:26.164729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:26.164729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:26.164729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:26.164729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:26.164729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:26.164729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:26.164729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:26.164729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:26.170648 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:26.170648 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:26.170648 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:26.170648 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:26.170648 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:26.170648 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:26.170648 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:26.170648 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:26.170648 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 12:19:26.170648 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:26.170648 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 278/565] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:19:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:26.170648 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5ff96-1d0e-40b2-853b-ab223f70bf6c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:26.230296 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 288/566] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:26.231299 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cde736-5886-4172-97ba-52487bca1472 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:26.249055 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:26.258970 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:26.285228 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5ff96-1d0e-40b2-853b-ab223f70bf6c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:26.321647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675264b-273d-40df-9219-550a8c6854b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:26.322545 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675264b-273d-40df-9219-550a8c6854b2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:26.322831 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675264b-273d-40df-9219-550a8c6854b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:26.323115 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675264b-273d-40df-9219-550a8c6854b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:26.333664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675264b-273d-40df-9219-550a8c6854b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:26.335174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675264b-273d-40df-9219-550a8c6854b2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:26.344715 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cde736-5886-4172-97ba-52487bca1472 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:26.356207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-3675264b-273d-40df-9219-550a8c6854b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:26.356207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:26.356207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:26.356207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:26.356207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:26.356207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:26.356207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:26.356207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:26.356207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:26.356207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:26.356207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:26.356207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:26.356207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:26.356207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:26.356207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:26.357179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:26.357179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:26.357179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:26.357179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:26.357179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:26.357179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:26.357179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:26.357179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:26.357179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:26.357179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:26.357179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:26.357179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:26.357179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:26.357179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:26.357179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:26.357179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:26.357179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:26.358349 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:26.358349 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:26.358349 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:26.358349 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:26.358826 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 279/567] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:26.359599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675264b-273d-40df-9219-550a8c6854b2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:26.390585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53337b7-ddfb-4e12-85f6-aec49659e4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:26.391245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53337b7-ddfb-4e12-85f6-aec49659e4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:26.391530 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53337b7-ddfb-4e12-85f6-aec49659e4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:26.391809 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53337b7-ddfb-4e12-85f6-aec49659e4f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:26.392587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53337b7-ddfb-4e12-85f6-aec49659e4f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:26.392895 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53337b7-ddfb-4e12-85f6-aec49659e4f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:26.394344 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53337b7-ddfb-4e12-85f6-aec49659e4f5 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:26.405572 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 289/568] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:26.406906 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8cc79-2222-40c4-867e-e176185c426b None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:26.407206 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8cc79-2222-40c4-867e-e176185c426b None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:26.407488 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8cc79-2222-40c4-867e-e176185c426b None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:26.408905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 290/569] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:26.409400 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8cc79-2222-40c4-867e-e176185c426b None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:26.487159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:26.501696 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675264b-273d-40df-9219-550a8c6854b2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:26.514717 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8cc79-2222-40c4-867e-e176185c426b None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:26.530295 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:26.541746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d44951-58b5-47b3-866e-539fe1018744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:26.542419 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d44951-58b5-47b3-866e-539fe1018744 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:26.542734 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d44951-58b5-47b3-866e-539fe1018744 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:26.543013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d44951-58b5-47b3-866e-539fe1018744 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:26.543852 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d44951-58b5-47b3-866e-539fe1018744 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:26.544160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d44951-58b5-47b3-866e-539fe1018744 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:26.545609 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d44951-58b5-47b3-866e-539fe1018744 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:26.555718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8c20a-345d-4f2c-9cf8-8da7df4b8eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:26.556922 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8c20a-345d-4f2c-9cf8-8da7df4b8eea None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:26.557366 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8c20a-345d-4f2c-9cf8-8da7df4b8eea None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:26.557806 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8c20a-345d-4f2c-9cf8-8da7df4b8eea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:26.563050 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 280/570] 10.222.0.25 () {56 vars in 1137 bytes} [Mon May 23 12:19:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:26.563873 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d44951-58b5-47b3-866e-539fe1018744 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:26.573577 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8c20a-345d-4f2c-9cf8-8da7df4b8eea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:26.587566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-fcd8c20a-345d-4f2c-9cf8-8da7df4b8eea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:26.587566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:26.587566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:26.587566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:26.587566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:26.587566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:26.587566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:26.587566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:26.587566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:26.587566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:26.587566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:26.587566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:26.587566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:26.587566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:26.587566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:26.587566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:26.588494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:26.588494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:26.588494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:26.588494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:26.588494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:26.588494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:26.588494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:26.588494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:26.588494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:26.588494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:26.588494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:26.588494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:26.588494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:26.588494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:26.588494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:26.588494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:26.589305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:26.589305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:26.589305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:26.589305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:26.589305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:26.589305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:26.589305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:26.589305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:26.589305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:26.589305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:26.589305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:26.589305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:26.589926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 291/571] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:19:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:26.590524 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8c20a-345d-4f2c-9cf8-8da7df4b8eea None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:26.690160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d44951-58b5-47b3-866e-539fe1018744 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:26.708889 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8c20a-345d-4f2c-9cf8-8da7df4b8eea None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:26.725731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb00cb-841c-40d8-bb24-5a9dcc7f4803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:26.726631 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb00cb-841c-40d8-bb24-5a9dcc7f4803 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:26.727048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb00cb-841c-40d8-bb24-5a9dcc7f4803 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:26.727439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb00cb-841c-40d8-bb24-5a9dcc7f4803 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:26.728173 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb00cb-841c-40d8-bb24-5a9dcc7f4803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:26.728484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb00cb-841c-40d8-bb24-5a9dcc7f4803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:26.729983 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb00cb-841c-40d8-bb24-5a9dcc7f4803 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:26.743424 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 281/572] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:26.745752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bcb3d-58da-49e5-b4d5-e0b17de77ca3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:26.745938 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b116efc-93aa-4b50-b84a-f8bdd9232335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:26.746257 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bcb3d-58da-49e5-b4d5-e0b17de77ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:26.746631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b116efc-93aa-4b50-b84a-f8bdd9232335 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:26.746794 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bcb3d-58da-49e5-b4d5-e0b17de77ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:26.746989 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b116efc-93aa-4b50-b84a-f8bdd9232335 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:26.747380 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b116efc-93aa-4b50-b84a-f8bdd9232335 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:26.748517 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b116efc-93aa-4b50-b84a-f8bdd9232335 None admin] RBAC: Adding query filter params (role.id=e344e91a09be4d10834ea5f942345beb, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=03ca1edc22174d258ddeda25407ee6ed) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:26.748828 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b116efc-93aa-4b50-b84a-f8bdd9232335 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:26.750287 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b116efc-93aa-4b50-b84a-f8bdd9232335 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:26.753477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:26.758706 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 292/573] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:19:26 2022] GET /identity/v3/role_assignments?user.id=03ca1edc22174d258ddeda25407ee6ed&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=e344e91a09be4d10834ea5f942345beb => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:26.760310 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b116efc-93aa-4b50-b84a-f8bdd9232335 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:26.771819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-176bcb3d-58da-49e5-b4d5-e0b17de77ca3 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:26.773840 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-176bcb3d-58da-49e5-b4d5-e0b17de77ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:26.829009 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:26.882941 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 282/574] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:26.885542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176bcb3d-58da-49e5-b4d5-e0b17de77ca3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:26.900243 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b116efc-93aa-4b50-b84a-f8bdd9232335 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:26.945476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329edb0-22cc-4afc-a37b-48dbbe44632f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:26.946434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329edb0-22cc-4afc-a37b-48dbbe44632f None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:26.946755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329edb0-22cc-4afc-a37b-48dbbe44632f None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:26.947039 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329edb0-22cc-4afc-a37b-48dbbe44632f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:26.958265 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329edb0-22cc-4afc-a37b-48dbbe44632f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:26.960299 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329edb0-22cc-4afc-a37b-48dbbe44632f None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:26.978645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-e329edb0-22cc-4afc-a37b-48dbbe44632f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:26.978645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:26.978645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:26.978645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:26.978645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:26.978645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:26.978645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:26.978645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:26.978645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:26.978645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:26.978645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:26.978645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:26.978645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:26.978645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:26.978645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:26.980456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:26.980456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:26.980456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:26.980456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:26.980456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:26.980456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:26.980456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:26.980456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:26.980456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:26.980456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:26.980456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:26.980456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:26.980456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:26.980456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:26.980456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:26.980456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:26.980456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:26.982353 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:26.982353 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:26.982353 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:26.982353 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:26.982353 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 293/575] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:26.982353 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329edb0-22cc-4afc-a37b-48dbbe44632f None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:27.034346 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176bcb3d-58da-49e5-b4d5-e0b17de77ca3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:27.047042 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:27.073326 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43159b5b-38af-4102-9187-765b231fa128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:27.074112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43159b5b-38af-4102-9187-765b231fa128 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:27.074404 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43159b5b-38af-4102-9187-765b231fa128 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:27.074685 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43159b5b-38af-4102-9187-765b231fa128 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:27.075448 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43159b5b-38af-4102-9187-765b231fa128 None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:27.075756 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43159b5b-38af-4102-9187-765b231fa128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:27.077165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43159b5b-38af-4102-9187-765b231fa128 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:27.087387 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 283/576] 10.222.0.25 () {56 vars in 1103 bytes} [Mon May 23 12:19:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:27.087945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43159b5b-38af-4102-9187-765b231fa128 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:27.106392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329edb0-22cc-4afc-a37b-48dbbe44632f None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:27.141275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:27.144049 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75d4b5-c70f-4576-8f4b-583284c678ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:27.144612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75d4b5-c70f-4576-8f4b-583284c678ff None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:27.144854 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75d4b5-c70f-4576-8f4b-583284c678ff None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:27.144996 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75d4b5-c70f-4576-8f4b-583284c678ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:27.154072 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75d4b5-c70f-4576-8f4b-583284c678ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:27.156558 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75d4b5-c70f-4576-8f4b-583284c678ff None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:27.173429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-7d75d4b5-c70f-4576-8f4b-583284c678ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 12:19:27.173429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:27.173429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:27.173429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:27.173429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:27.173429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:27.173429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:27.173429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:27.173429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:27.173429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:27.173429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:27.173429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:27.173429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:27.173429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:27.173429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:27.173429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:27.180006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:27.180006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:27.180006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:27.180006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:27.180006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:27.180006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:27.180006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:27.180006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:27.180006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:27.180006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:27.180006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:27.180006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:27.180006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:27.180006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:27.180006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:27.180006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:27.180006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:27.180006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:27.181629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:27.181629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:27.181629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:27.181629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:27.181629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:27.181629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:27.181629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:27.181629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:27.181629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 12:19:27.181629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:27.181629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 294/577] 10.222.0.25 () {56 vars in 1093 bytes} [Mon May 23 12:19:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:27.181629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75d4b5-c70f-4576-8f4b-583284c678ff None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:27.253728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43159b5b-38af-4102-9187-765b231fa128 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:27.294728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f324b28-3aaa-4534-bb76-df1d8bfd4d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:27.295784 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f324b28-3aaa-4534-bb76-df1d8bfd4d5c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:27.296057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f324b28-3aaa-4534-bb76-df1d8bfd4d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:27.296331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f324b28-3aaa-4534-bb76-df1d8bfd4d5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:27.310275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f324b28-3aaa-4534-bb76-df1d8bfd4d5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:27.313558 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75d4b5-c70f-4576-8f4b-583284c678ff None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:27.318325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-6f324b28-3aaa-4534-bb76-df1d8bfd4d5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:27.318325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:27.318325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:27.318325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:27.318325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:27.318325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:27.318325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:27.318325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:27.318325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:27.318325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:27.318325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:27.318325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:27.318325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:27.318325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:27.318325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:27.318325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:27.320764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:27.320764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:27.320764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:27.320764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:27.320764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:27.320764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:27.320764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:27.320764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:27.320764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:27.320764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:27.320764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:27.320764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:27.320764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:27.320764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:27.320764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:27.320764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:27.322390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:27.322390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:27.322390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:27.322390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:27.322390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:27.322390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:27.322390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:27.322390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:27.322390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:27.322390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:27.322390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:27.322390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:27.322390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 284/578] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:19:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:27.322390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f324b28-3aaa-4534-bb76-df1d8bfd4d5c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:27.337857 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:27.365006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdf110-702c-4c7c-a3e6-a11e013dbb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:27.365821 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdf110-702c-4c7c-a3e6-a11e013dbb45 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:27.366117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdf110-702c-4c7c-a3e6-a11e013dbb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:27.366401 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdf110-702c-4c7c-a3e6-a11e013dbb45 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:27.367197 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdf110-702c-4c7c-a3e6-a11e013dbb45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:27.367511 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdf110-702c-4c7c-a3e6-a11e013dbb45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:27.369361 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdf110-702c-4c7c-a3e6-a11e013dbb45 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:27.385022 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 295/579] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:27.385623 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdf110-702c-4c7c-a3e6-a11e013dbb45 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:27.430933 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:27.440496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f324b28-3aaa-4534-bb76-df1d8bfd4d5c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:27.479248 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d9eac-4527-42a6-99d3-9f62eed4d27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:27.480039 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d9eac-4527-42a6-99d3-9f62eed4d27c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:27.480323 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d9eac-4527-42a6-99d3-9f62eed4d27c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:27.480696 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d9eac-4527-42a6-99d3-9f62eed4d27c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:27.491544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d9eac-4527-42a6-99d3-9f62eed4d27c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:27.493103 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d9eac-4527-42a6-99d3-9f62eed4d27c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:27.502560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdf110-702c-4c7c-a3e6-a11e013dbb45 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:27.511979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-f36d9eac-4527-42a6-99d3-9f62eed4d27c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:27.511979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:27.511979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:27.511979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:27.511979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:27.511979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:27.511979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:27.511979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:27.511979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:27.511979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:27.511979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:27.511979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:27.511979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:27.511979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:27.511979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:27.514462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:27.514462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:27.514462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:27.514462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:27.514462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:27.514462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:27.514462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:27.514462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:27.514462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:27.514462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:27.514462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:27.514462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:27.514462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:27.514462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:27.514462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:27.514462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:27.514462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:27.516240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:27.516240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:27.516240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:27.516240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:27.517741 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 285/580] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:27.518608 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d9eac-4527-42a6-99d3-9f62eed4d27c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:27.549037 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a394b9-5836-49e9-8c2e-2fa4894572c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:27.549929 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a394b9-5836-49e9-8c2e-2fa4894572c3 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:27.550213 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a394b9-5836-49e9-8c2e-2fa4894572c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:27.550595 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a394b9-5836-49e9-8c2e-2fa4894572c3 None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:27.551461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a394b9-5836-49e9-8c2e-2fa4894572c3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:27.551758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a394b9-5836-49e9-8c2e-2fa4894572c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:27.553304 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a394b9-5836-49e9-8c2e-2fa4894572c3 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:27.573100 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 296/581] 10.222.0.25 () {56 vars in 1133 bytes} [Mon May 23 12:19:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:27.574287 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a394b9-5836-49e9-8c2e-2fa4894572c3 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:27.611742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:27.657291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d9eac-4527-42a6-99d3-9f62eed4d27c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:27.703925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a394b9-5836-49e9-8c2e-2fa4894572c3 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:27.705583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8118aea-d68e-4993-bd7c-705949a6feab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:27.706413 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8118aea-d68e-4993-bd7c-705949a6feab None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:27.706724 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8118aea-d68e-4993-bd7c-705949a6feab None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:27.707022 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8118aea-d68e-4993-bd7c-705949a6feab None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:27.707885 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8118aea-d68e-4993-bd7c-705949a6feab None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:27.708186 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8118aea-d68e-4993-bd7c-705949a6feab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:27.710192 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8118aea-d68e-4993-bd7c-705949a6feab None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:27.719855 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 286/582] 10.222.0.25 () {56 vars in 1103 bytes} [Mon May 23 12:19:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:27.720686 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8118aea-d68e-4993-bd7c-705949a6feab None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:27.734013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:27.759804 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746113d-2b5b-4c1c-a251-4dcb26f5d602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:27.760986 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746113d-2b5b-4c1c-a251-4dcb26f5d602 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:27.761500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746113d-2b5b-4c1c-a251-4dcb26f5d602 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:27.761958 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746113d-2b5b-4c1c-a251-4dcb26f5d602 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:27.769740 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5746113d-2b5b-4c1c-a251-4dcb26f5d602 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:27.771354 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5746113d-2b5b-4c1c-a251-4dcb26f5d602 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:27.787575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-5746113d-2b5b-4c1c-a251-4dcb26f5d602 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:27.787575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:27.787575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:27.787575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:27.787575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:27.787575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:27.787575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:27.787575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:27.787575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:27.787575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:27.787575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:27.787575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:27.787575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:27.787575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:27.787575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:27.789670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:27.789670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:27.789670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:27.789670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:27.789670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:27.789670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:27.789670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:27.789670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:27.789670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:27.789670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:27.789670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:27.789670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:27.789670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:27.789670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:27.789670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:27.789670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:27.789670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:27.791891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:27.791891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:27.791891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:27.791891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:27.791891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:27.791891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:27.791891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:27.791891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:27.791891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 297/583] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:27.791891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746113d-2b5b-4c1c-a251-4dcb26f5d602 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:27.855603 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8118aea-d68e-4993-bd7c-705949a6feab None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:27.899179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd3305-918e-4308-a146-fadc1f5070e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:27.900075 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd3305-918e-4308-a146-fadc1f5070e2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:27.900492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd3305-918e-4308-a146-fadc1f5070e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:27.900958 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd3305-918e-4308-a146-fadc1f5070e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:27.901905 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd3305-918e-4308-a146-fadc1f5070e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:27.902350 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd3305-918e-4308-a146-fadc1f5070e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:27.904253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:27.904484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd3305-918e-4308-a146-fadc1f5070e2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:27.916822 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746113d-2b5b-4c1c-a251-4dcb26f5d602 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:27.920675 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 287/584] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:27.921328 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd3305-918e-4308-a146-fadc1f5070e2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:27.964703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296cefe-aa7d-44f1-929b-c88ce7f0354f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:27.965404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296cefe-aa7d-44f1-929b-c88ce7f0354f None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:27.965692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296cefe-aa7d-44f1-929b-c88ce7f0354f None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:27.965966 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296cefe-aa7d-44f1-929b-c88ce7f0354f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:27.980581 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296cefe-aa7d-44f1-929b-c88ce7f0354f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:27.982101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296cefe-aa7d-44f1-929b-c88ce7f0354f None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:28.002452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-4296cefe-aa7d-44f1-929b-c88ce7f0354f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:28.002452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:28.002452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:28.002452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:28.002452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:28.002452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:28.002452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:28.002452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:28.002452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:28.002452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:28.002452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:28.002452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:28.002452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:28.002452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:28.002452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:28.003942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:28.003942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:28.003942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:28.003942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:28.003942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:28.003942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:28.003942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:28.003942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:28.003942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:28.003942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:28.003942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:28.003942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:28.003942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:28.003942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:28.003942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:28.003942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:28.003942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:28.005912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:28.005912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:28.005912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:28.005912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:28.005912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 298/585] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:28.005912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296cefe-aa7d-44f1-929b-c88ce7f0354f None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:28.013257 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:28.049384 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd3305-918e-4308-a146-fadc1f5070e2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:28.089037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5ef47-f3db-4050-8716-e2a6351fee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:28.090392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5ef47-f3db-4050-8716-e2a6351fee37 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:28.090901 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5ef47-f3db-4050-8716-e2a6351fee37 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:28.091360 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5ef47-f3db-4050-8716-e2a6351fee37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:28.103752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5ef47-f3db-4050-8716-e2a6351fee37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:28.105393 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5ef47-f3db-4050-8716-e2a6351fee37 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:28.127858 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-0bd5ef47-f3db-4050-8716-e2a6351fee37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:28.127858 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:28.127858 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:28.127858 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:28.127858 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:28.127858 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:28.127858 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:28.127858 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:28.127858 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:28.127858 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:28.127858 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:28.127858 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:28.127858 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:28.127858 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:28.127858 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:28.128996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:28.128996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:28.128996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:28.128996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:28.128996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:28.128996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:28.128996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:28.128996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:28.128996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:28.128996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:28.128996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:28.128996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:28.128996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:28.128996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:28.128996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:28.128996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:28.128996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:28.135167 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:28.135167 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:28.135167 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:28.135167 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:28.135445 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296cefe-aa7d-44f1-929b-c88ce7f0354f None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:28.135535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 288/586] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:28.135535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5ef47-f3db-4050-8716-e2a6351fee37 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:28.173525 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad9987-d8f9-4c4f-85c5-83043f9d2b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:28.174288 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad9987-d8f9-4c4f-85c5-83043f9d2b99 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:28.174684 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad9987-d8f9-4c4f-85c5-83043f9d2b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:28.175029 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad9987-d8f9-4c4f-85c5-83043f9d2b99 None admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:28.175891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad9987-d8f9-4c4f-85c5-83043f9d2b99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:28.176272 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad9987-d8f9-4c4f-85c5-83043f9d2b99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:28.177825 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad9987-d8f9-4c4f-85c5-83043f9d2b99 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:28.202041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 299/587] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:28.202041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad9987-d8f9-4c4f-85c5-83043f9d2b99 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:28.202041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:28.260940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5ef47-f3db-4050-8716-e2a6351fee37 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:28.291820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:28.311745 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb6be6-2d6e-4be3-b411-87a5c5e3170d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:28.313256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb6be6-2d6e-4be3-b411-87a5c5e3170d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:28.313694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb6be6-2d6e-4be3-b411-87a5c5e3170d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:28.314109 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb6be6-2d6e-4be3-b411-87a5c5e3170d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:28.314483 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad9987-d8f9-4c4f-85c5-83043f9d2b99 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:28.325747 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb6be6-2d6e-4be3-b411-87a5c5e3170d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:28.328102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb6be6-2d6e-4be3-b411-87a5c5e3170d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:28.351942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d8109-0d2f-483f-9f6e-e03a06ce6730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:28.352612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d8109-0d2f-483f-9f6e-e03a06ce6730 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:28.352899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d8109-0d2f-483f-9f6e-e03a06ce6730 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:28.353180 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d8109-0d2f-483f-9f6e-e03a06ce6730 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:28.353493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-2abb6be6-2d6e-4be3-b411-87a5c5e3170d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 12:19:28.353493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:28.353493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:28.353493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:28.353493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:28.353493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:28.353493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:28.353493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:28.353493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:28.353493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:28.353493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:28.353493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:28.353493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:28.353493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:28.353493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:28.353493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:28.354639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:28.354639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:28.354639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:28.354639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:28.354639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:28.354639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:28.354639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:28.354639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:28.354639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:28.354639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:28.354639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:28.354639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:28.354639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:28.354639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:28.354639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:28.354639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:28.354639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:28.354639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:28.355810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:28.355810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:28.355810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:28.355810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:28.355810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:28.355810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:28.355810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:28.355810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:28.355810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 12:19:28.355810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:28.356957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d8109-0d2f-483f-9f6e-e03a06ce6730 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:28.356957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d8109-0d2f-483f-9f6e-e03a06ce6730 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:28.357085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 289/588] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:19:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:28.357085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb6be6-2d6e-4be3-b411-87a5c5e3170d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:28.358721 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d8109-0d2f-483f-9f6e-e03a06ce6730 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:28.377177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 300/589] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:28.377177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d8109-0d2f-483f-9f6e-e03a06ce6730 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:28.451579 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:28.496338 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb6be6-2d6e-4be3-b411-87a5c5e3170d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:28.514266 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d8109-0d2f-483f-9f6e-e03a06ce6730 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:28.536944 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d8d1b-cf25-431f-b1d9-6d8c6786851f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:28.537727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d8d1b-cf25-431f-b1d9-6d8c6786851f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:28.537922 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d8d1b-cf25-431f-b1d9-6d8c6786851f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:28.538200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d8d1b-cf25-431f-b1d9-6d8c6786851f None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:28.538966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d8d1b-cf25-431f-b1d9-6d8c6786851f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:28.539274 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d8d1b-cf25-431f-b1d9-6d8c6786851f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:28.540823 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d8d1b-cf25-431f-b1d9-6d8c6786851f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:28.558075 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 290/590] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:28.558075 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d8d1b-cf25-431f-b1d9-6d8c6786851f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:28.563516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0304fec-5c60-452b-b0dc-bcd1b27ee4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:28.564411 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0304fec-5c60-452b-b0dc-bcd1b27ee4eb None admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:28.564704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0304fec-5c60-452b-b0dc-bcd1b27ee4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:28.564986 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0304fec-5c60-452b-b0dc-bcd1b27ee4eb None admin] PATH_INFO: `/v3/projects/402397b981be4f0c9e778a2771c41937/users/8ed824e419544b33a2c4413da4b45aaf/roles/e344e91a09be4d10834ea5f942345beb` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:28.580503 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0304fec-5c60-452b-b0dc-bcd1b27ee4eb None admin] RBAC: Authorizing `identity:create_grant(project_id=402397b981be4f0c9e778a2771c41937, user_id=8ed824e419544b33a2c4413da4b45aaf, role_id=e344e91a09be4d10834ea5f942345beb)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:28.581976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0304fec-5c60-452b-b0dc-bcd1b27ee4eb None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:28.606546 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 301/591] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:19:28 2022] PUT /identity/v3/projects/402397b981be4f0c9e778a2771c41937/users/8ed824e419544b33a2c4413da4b45aaf/roles/e344e91a09be4d10834ea5f942345beb => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:19:28.606546 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0304fec-5c60-452b-b0dc-bcd1b27ee4eb None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:28.634621 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:28.748354 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d8d1b-cf25-431f-b1d9-6d8c6786851f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:28.814688 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b641fa-5d8b-400e-9d06-b89fbb61cc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:28.816052 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b641fa-5d8b-400e-9d06-b89fbb61cc83 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:28.816528 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b641fa-5d8b-400e-9d06-b89fbb61cc83 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:28.817000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b641fa-5d8b-400e-9d06-b89fbb61cc83 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:28.819808 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b641fa-5d8b-400e-9d06-b89fbb61cc83 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:28.820682 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b641fa-5d8b-400e-9d06-b89fbb61cc83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:28.823376 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b641fa-5d8b-400e-9d06-b89fbb61cc83 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:28.823509 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0304fec-5c60-452b-b0dc-bcd1b27ee4eb None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:28.848902 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:28.857247 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 291/592] 10.222.0.25 () {56 vars in 1137 bytes} [Mon May 23 12:19:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:28.858400 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b641fa-5d8b-400e-9d06-b89fbb61cc83 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:28.880994 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648af2e5-6d9b-4c90-9a28-35996868bc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:28.882007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648af2e5-6d9b-4c90-9a28-35996868bc07 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:28.882414 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648af2e5-6d9b-4c90-9a28-35996868bc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:28.882859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648af2e5-6d9b-4c90-9a28-35996868bc07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:28.894380 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648af2e5-6d9b-4c90-9a28-35996868bc07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:28.897219 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648af2e5-6d9b-4c90-9a28-35996868bc07 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:28.919771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-648af2e5-6d9b-4c90-9a28-35996868bc07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:28.919771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:28.919771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:28.919771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:28.919771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:28.919771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:28.919771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:28.919771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:28.919771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:28.919771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:28.919771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:28.919771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:28.919771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:28.919771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:28.919771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:28.921408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:28.921408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:28.921408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:28.921408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:28.921408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:28.921408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:28.921408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:28.921408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:28.921408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:28.921408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:28.921408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:28.921408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:28.921408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:28.921408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:28.921408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:28.921408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:28.921408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:28.924070 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:28.924070 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:28.924070 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:28.924070 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:28.924070 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:28.924070 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:28.924070 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:28.924070 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:28.924070 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 302/593] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:28.924070 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648af2e5-6d9b-4c90-9a28-35996868bc07 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:28.994936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:28.999709 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b641fa-5d8b-400e-9d06-b89fbb61cc83 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:29.042920 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0ee67-d0c1-448e-a17e-59935b5c0bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:29.043896 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0ee67-d0c1-448e-a17e-59935b5c0bae None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:29.044252 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0ee67-d0c1-448e-a17e-59935b5c0bae None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:29.044626 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0ee67-d0c1-448e-a17e-59935b5c0bae None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:29.053338 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0ee67-d0c1-448e-a17e-59935b5c0bae None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:29.055189 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0ee67-d0c1-448e-a17e-59935b5c0bae None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:29.073030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-84d0ee67-d0c1-448e-a17e-59935b5c0bae None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 12:19:29.073030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:29.073030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:29.073030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:29.073030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:29.073030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:29.073030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:29.073030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:29.073030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:29.073030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:29.073030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:29.073030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:29.073030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:29.073030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:29.073030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:29.073030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:29.074712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:29.074712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:29.074712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:29.074712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:29.074712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:29.074712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:29.074712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:29.074712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:29.074712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:29.074712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:29.074712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:29.074712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:29.074712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:29.074712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:29.074712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:29.074712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:29.074712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:29.074712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:29.076615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:29.076615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:29.076615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:29.076615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:29.076615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:29.076615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:29.076615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:29.076615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:29.076615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 12:19:29.076615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:29.082546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 292/594] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:19:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:29.082546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0ee67-d0c1-448e-a17e-59935b5c0bae None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:29.128233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648af2e5-6d9b-4c90-9a28-35996868bc07 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:29.177486 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d6eee-669d-4731-bedb-093c928b5421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:29.178330 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d6eee-669d-4731-bedb-093c928b5421 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:29.178647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d6eee-669d-4731-bedb-093c928b5421 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:29.178928 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d6eee-669d-4731-bedb-093c928b5421 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:29.191525 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d6eee-669d-4731-bedb-093c928b5421 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:29.193011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d6eee-669d-4731-bedb-093c928b5421 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:29.212641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-805d6eee-669d-4731-bedb-093c928b5421 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:29.212641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:29.212641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:29.212641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:29.212641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:29.212641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:29.212641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:29.212641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:29.212641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:29.212641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:29.212641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:29.212641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:29.212641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:29.212641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:29.212641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:29.213585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:29.213585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:29.213585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:29.213585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:29.213585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:29.213585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:29.213585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:29.213585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:29.213585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:29.213585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:29.213585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:29.213585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:29.213585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:29.213585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:29.213585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:29.213585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:29.213585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:29.214487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:29.214487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:29.214487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:29.214487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:29.214487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 303/595] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:29.214805 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d6eee-669d-4731-bedb-093c928b5421 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:29.231304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0ee67-d0c1-448e-a17e-59935b5c0bae None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:29.246182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:29.272425 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621317a5-52bf-4508-bfc1-683d8bb7a7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:29.273181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621317a5-52bf-4508-bfc1-683d8bb7a7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:29.273471 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621317a5-52bf-4508-bfc1-683d8bb7a7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:29.273748 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621317a5-52bf-4508-bfc1-683d8bb7a7a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:29.274725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621317a5-52bf-4508-bfc1-683d8bb7a7a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:29.275036 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621317a5-52bf-4508-bfc1-683d8bb7a7a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:29.276512 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621317a5-52bf-4508-bfc1-683d8bb7a7a3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:29.290438 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 293/596] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:29.291897 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7878f-5e79-412a-9e68-aedca7cbf2c3 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:29.292195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7878f-5e79-412a-9e68-aedca7cbf2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:29.292466 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7878f-5e79-412a-9e68-aedca7cbf2c3 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:29.294145 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 294/597] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:29.300920 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7878f-5e79-412a-9e68-aedca7cbf2c3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:29.325085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:29.363948 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d6eee-669d-4731-bedb-093c928b5421 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:29.421940 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501794f5-7938-4d50-b561-e0a2c6005cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:29.423078 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501794f5-7938-4d50-b561-e0a2c6005cda None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:29.423554 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501794f5-7938-4d50-b561-e0a2c6005cda None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:29.424056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501794f5-7938-4d50-b561-e0a2c6005cda None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:29.425583 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501794f5-7938-4d50-b561-e0a2c6005cda None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:29.425872 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7878f-5e79-412a-9e68-aedca7cbf2c3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:29.426115 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501794f5-7938-4d50-b561-e0a2c6005cda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:29.429316 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501794f5-7938-4d50-b561-e0a2c6005cda None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:29.461107 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 304/598] 10.222.0.25 () {56 vars in 1139 bytes} [Mon May 23 12:19:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:29.461948 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501794f5-7938-4d50-b561-e0a2c6005cda None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:29.480075 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88396397-28c9-4029-9ba4-8f1eb7e54644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:29.481186 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88396397-28c9-4029-9ba4-8f1eb7e54644 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:29.481674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88396397-28c9-4029-9ba4-8f1eb7e54644 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:29.482153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88396397-28c9-4029-9ba4-8f1eb7e54644 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:29.483637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88396397-28c9-4029-9ba4-8f1eb7e54644 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:29.484149 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88396397-28c9-4029-9ba4-8f1eb7e54644 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:29.486256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88396397-28c9-4029-9ba4-8f1eb7e54644 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:29.505266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 295/599] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:29.507513 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d35cb-cac5-49e7-8456-7255894f725d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:29.508004 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d35cb-cac5-49e7-8456-7255894f725d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:29.508496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d35cb-cac5-49e7-8456-7255894f725d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:29.534830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9e8d35cb-cac5-49e7-8456-7255894f725d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:29.536780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9e8d35cb-cac5-49e7-8456-7255894f725d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:29.554942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:29.575860 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501794f5-7938-4d50-b561-e0a2c6005cda None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:29.611881 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0815c-b2b4-4138-918f-0e10b3d05ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:29.612761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0815c-b2b4-4138-918f-0e10b3d05ef8 None admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:29.613049 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0815c-b2b4-4138-918f-0e10b3d05ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:29.613329 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0815c-b2b4-4138-918f-0e10b3d05ef8 None admin] PATH_INFO: `/v3/projects/402397b981be4f0c9e778a2771c41937/users/d49997b9108145b78eb4db1d8823bf4d/roles/e344e91a09be4d10834ea5f942345beb` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:29.628754 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0815c-b2b4-4138-918f-0e10b3d05ef8 None admin] RBAC: Authorizing `identity:create_grant(project_id=402397b981be4f0c9e778a2771c41937, user_id=d49997b9108145b78eb4db1d8823bf4d, role_id=e344e91a09be4d10834ea5f942345beb)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:29.630215 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0815c-b2b4-4138-918f-0e10b3d05ef8 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:29.643450 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 296/600] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:29.644307 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d35cb-cac5-49e7-8456-7255894f725d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:29.656947 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 305/601] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:19:29 2022] PUT /identity/v3/projects/402397b981be4f0c9e778a2771c41937/users/d49997b9108145b78eb4db1d8823bf4d/roles/e344e91a09be4d10834ea5f942345beb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:19:29.658086 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0815c-b2b4-4138-918f-0e10b3d05ef8 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:29.679090 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:29.796453 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d35cb-cac5-49e7-8456-7255894f725d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:29.837945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b249f5-38f2-47bb-a286-0ae0eefa1f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:29.839202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b249f5-38f2-47bb-a286-0ae0eefa1f93 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:29.839704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b249f5-38f2-47bb-a286-0ae0eefa1f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:29.840200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b249f5-38f2-47bb-a286-0ae0eefa1f93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:29.853076 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b249f5-38f2-47bb-a286-0ae0eefa1f93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:29.854993 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b249f5-38f2-47bb-a286-0ae0eefa1f93 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:29.865709 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0815c-b2b4-4138-918f-0e10b3d05ef8 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:29.875989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-29b249f5-38f2-47bb-a286-0ae0eefa1f93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:29.875989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:29.875989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:29.875989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:29.875989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:29.875989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:29.875989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:29.875989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:29.875989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:29.875989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:29.875989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:29.875989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:29.875989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:29.875989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:29.875989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:29.876936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:29.876936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:29.876936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:29.876936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:29.876936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:29.876936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:29.876936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:29.876936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:29.876936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:29.876936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:29.876936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:29.876936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:29.876936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:29.876936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:29.876936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:29.876936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:29.876936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:29.877822 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:29.877822 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:29.877822 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:29.877822 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:29.880154 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 297/602] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:29.881746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b249f5-38f2-47bb-a286-0ae0eefa1f93 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:29.915825 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:29.927474 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0e15f-fb8c-42d5-b53a-f6353d3815f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:29.928837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0e15f-fb8c-42d5-b53a-f6353d3815f8 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:29.929316 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0e15f-fb8c-42d5-b53a-f6353d3815f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:29.929775 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0e15f-fb8c-42d5-b53a-f6353d3815f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:29.941926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0e15f-fb8c-42d5-b53a-f6353d3815f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:29.945084 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0e15f-fb8c-42d5-b53a-f6353d3815f8 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:29.965214 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:29.971451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-84e0e15f-fb8c-42d5-b53a-f6353d3815f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:29.971451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:29.971451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:29.971451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:29.971451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:29.971451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:29.971451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:29.971451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:29.971451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:29.971451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:29.971451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:29.971451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:29.971451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:29.971451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:29.971451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:29.972390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:29.972390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:29.972390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:29.972390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:29.972390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:29.972390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:29.972390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:29.972390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:29.972390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:29.972390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:29.972390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:29.972390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:29.972390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:29.972390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:29.972390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:29.972390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:29.972390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:29.973258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:29.973258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:29.973258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:29.973258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:29.973258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:29.973258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:29.973258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:29.973258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:29.974234 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 306/603] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:29.975552 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0e15f-fb8c-42d5-b53a-f6353d3815f8 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:30.024359 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b249f5-38f2-47bb-a286-0ae0eefa1f93 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:30.068348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817f9c3-1653-4b27-86b1-b6372db05215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:30.070968 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817f9c3-1653-4b27-86b1-b6372db05215 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:30.071493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817f9c3-1653-4b27-86b1-b6372db05215 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:30.072354 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817f9c3-1653-4b27-86b1-b6372db05215 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:30.088621 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817f9c3-1653-4b27-86b1-b6372db05215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:30.099643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-e817f9c3-1653-4b27-86b1-b6372db05215 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:30.099643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:30.099643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:30.099643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:30.099643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:30.099643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:30.099643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:30.099643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:30.099643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:30.099643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:30.099643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:30.099643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:30.099643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:30.099643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:30.099643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:30.099643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:30.100632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:30.100632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:30.100632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:30.100632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:30.100632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:30.100632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:30.100632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:30.100632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:30.100632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:30.100632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:30.100632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:30.100632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:30.100632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:30.100632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:30.100632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:30.100632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:30.101456 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:30.101456 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:30.101456 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:30.101456 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:30.101456 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:30.101456 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:30.101456 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:30.101456 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:30.101456 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:30.101456 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:30.101456 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:30.101456 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:30.105968 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 298/604] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:19:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:30.107096 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817f9c3-1653-4b27-86b1-b6372db05215 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:30.176449 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0e15f-fb8c-42d5-b53a-f6353d3815f8 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:30.224083 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01746d1d-eabc-4881-804f-79c10ba43819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:30.225162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01746d1d-eabc-4881-804f-79c10ba43819 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:30.225636 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01746d1d-eabc-4881-804f-79c10ba43819 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:30.226128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01746d1d-eabc-4881-804f-79c10ba43819 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:30.227255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01746d1d-eabc-4881-804f-79c10ba43819 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:30.227765 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01746d1d-eabc-4881-804f-79c10ba43819 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:30.229589 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01746d1d-eabc-4881-804f-79c10ba43819 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:30.248038 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 307/605] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:30.249427 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01746d1d-eabc-4881-804f-79c10ba43819 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:30.276051 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817f9c3-1653-4b27-86b1-b6372db05215 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:30.312149 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:30.314049 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:30.338298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e41cd1-fab0-4cf9-b52b-a2512bd061b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:30.339672 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e41cd1-fab0-4cf9-b52b-a2512bd061b9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:30.340857 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e41cd1-fab0-4cf9-b52b-a2512bd061b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:30.340857 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e41cd1-fab0-4cf9-b52b-a2512bd061b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:30.342348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e41cd1-fab0-4cf9-b52b-a2512bd061b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:30.342981 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e41cd1-fab0-4cf9-b52b-a2512bd061b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:30.345700 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e41cd1-fab0-4cf9-b52b-a2512bd061b9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:30.369022 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 299/606] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:30.370459 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e41cd1-fab0-4cf9-b52b-a2512bd061b9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:30.375682 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01746d1d-eabc-4881-804f-79c10ba43819 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:30.426330 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834839d-5acf-4e25-a8af-0bd14aea9d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:30.427362 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834839d-5acf-4e25-a8af-0bd14aea9d5f None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:30.427850 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834839d-5acf-4e25-a8af-0bd14aea9d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:30.428974 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834839d-5acf-4e25-a8af-0bd14aea9d5f None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:30.430082 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834839d-5acf-4e25-a8af-0bd14aea9d5f None admin] RBAC: Adding query filter params (name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:30.430953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834839d-5acf-4e25-a8af-0bd14aea9d5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:30.432778 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834839d-5acf-4e25-a8af-0bd14aea9d5f None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:30.442957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 308/607] 10.222.0.25 () {56 vars in 1103 bytes} [Mon May 23 12:19:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:30.444140 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834839d-5acf-4e25-a8af-0bd14aea9d5f None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:30.562797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834839d-5acf-4e25-a8af-0bd14aea9d5f None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:30.568307 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e41cd1-fab0-4cf9-b52b-a2512bd061b9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:30.580021 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:30.606128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200ca76-2724-4b66-a2d2-584837c1f8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:30.607319 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200ca76-2724-4b66-a2d2-584837c1f8f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:30.608000 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200ca76-2724-4b66-a2d2-584837c1f8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:30.608422 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200ca76-2724-4b66-a2d2-584837c1f8f6 None admin] PATH_INFO: `/v3/projects/402397b981be4f0c9e778a2771c41937/users/3a3f520fcbe544c9be7e33a64eb1dc20/roles/e344e91a09be4d10834ea5f942345beb` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:30.627508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200ca76-2724-4b66-a2d2-584837c1f8f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=402397b981be4f0c9e778a2771c41937, user_id=3a3f520fcbe544c9be7e33a64eb1dc20, role_id=e344e91a09be4d10834ea5f942345beb)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:30.629997 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200ca76-2724-4b66-a2d2-584837c1f8f6 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:30.636565 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d350c8d-5ec7-4e6f-9d67-3c5f4f3097cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:30.638251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d350c8d-5ec7-4e6f-9d67-3c5f4f3097cf None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:30.638915 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d350c8d-5ec7-4e6f-9d67-3c5f4f3097cf None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:30.640054 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d350c8d-5ec7-4e6f-9d67-3c5f4f3097cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:30.654163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 309/608] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:19:30 2022] PUT /identity/v3/projects/402397b981be4f0c9e778a2771c41937/users/3a3f520fcbe544c9be7e33a64eb1dc20/roles/e344e91a09be4d10834ea5f942345beb => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:19:30.655188 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d350c8d-5ec7-4e6f-9d67-3c5f4f3097cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:30.655894 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200ca76-2724-4b66-a2d2-584837c1f8f6 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:30.658254 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d350c8d-5ec7-4e6f-9d67-3c5f4f3097cf None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:30.687811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-9d350c8d-5ec7-4e6f-9d67-3c5f4f3097cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:30.687811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:30.687811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:30.687811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:30.687811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:30.687811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:30.687811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:30.687811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:30.687811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:30.687811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:30.687811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:30.687811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:30.687811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:30.687811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:30.687811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:30.689309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:30.689309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:30.689309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:30.689309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:30.689309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:30.689309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:30.689309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:30.689309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:30.689309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:30.689309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:30.689309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:30.689309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:30.689309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:30.689309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:30.689309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:30.689309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:30.689309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:30.690316 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:30.690316 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:30.690316 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:30.690316 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:30.690316 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:30.690316 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:30.690316 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:30.690316 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:30.693211 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 300/609] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:30.703007 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d350c8d-5ec7-4e6f-9d67-3c5f4f3097cf None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:30.780471 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:30.796519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200ca76-2724-4b66-a2d2-584837c1f8f6 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:30.862088 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc63277-b83d-4bb2-8579-574d385717c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:30.863499 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc63277-b83d-4bb2-8579-574d385717c9 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:30.863834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc63277-b83d-4bb2-8579-574d385717c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:30.864080 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc63277-b83d-4bb2-8579-574d385717c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:30.872473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d350c8d-5ec7-4e6f-9d67-3c5f4f3097cf None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:30.878246 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc63277-b83d-4bb2-8579-574d385717c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:30.879758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc63277-b83d-4bb2-8579-574d385717c9 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:30.902975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-0bc63277-b83d-4bb2-8579-574d385717c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:30.902975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:30.902975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:30.902975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:30.902975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:30.902975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:30.902975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:30.902975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:30.902975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:30.902975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:30.902975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:30.902975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:30.902975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:30.902975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:30.902975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:30.904519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:30.904519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:30.904519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:30.904519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:30.904519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:30.904519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:30.904519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:30.904519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:30.904519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:30.904519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:30.904519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:30.904519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:30.904519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:30.904519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:30.904519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:30.904519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:30.904519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:30.906173 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:30.906173 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:30.906173 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:30.906173 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:30.908565 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 310/610] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:30.911298 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc63277-b83d-4bb2-8579-574d385717c9 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:30.935758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:30.942265 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2abd95-44ed-497b-b602-cbf593e55465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:30.944048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2abd95-44ed-497b-b602-cbf593e55465 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:30.944932 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2abd95-44ed-497b-b602-cbf593e55465 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:30.945655 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2abd95-44ed-497b-b602-cbf593e55465 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:30.947505 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2abd95-44ed-497b-b602-cbf593e55465 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:30.948447 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2abd95-44ed-497b-b602-cbf593e55465 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:30.951636 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2abd95-44ed-497b-b602-cbf593e55465 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:30.986796 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 301/611] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:30.996805 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2abd95-44ed-497b-b602-cbf593e55465 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:31.045581 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc63277-b83d-4bb2-8579-574d385717c9 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:31.091310 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab36fc-c2c7-4f88-a965-648e321d62df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:31.091986 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab36fc-c2c7-4f88-a965-648e321d62df None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:31.092331 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab36fc-c2c7-4f88-a965-648e321d62df None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:31.092615 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab36fc-c2c7-4f88-a965-648e321d62df None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:31.093347 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab36fc-c2c7-4f88-a965-648e321d62df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:31.093657 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab36fc-c2c7-4f88-a965-648e321d62df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:31.095322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab36fc-c2c7-4f88-a965-648e321d62df None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:31.111725 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 311/612] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:31.117961 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab36fc-c2c7-4f88-a965-648e321d62df None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:31.171017 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:31.175145 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2abd95-44ed-497b-b602-cbf593e55465 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:31.217123 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b00d6-9682-41cb-aaf4-8abb1812ab84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:31.218272 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b00d6-9682-41cb-aaf4-8abb1812ab84 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:31.218734 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b00d6-9682-41cb-aaf4-8abb1812ab84 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:31.219185 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b00d6-9682-41cb-aaf4-8abb1812ab84 None admin] PATH_INFO: `/v3/projects/402397b981be4f0c9e778a2771c41937/users/74674b52807742abb7e144bba3bb6e56/roles/e344e91a09be4d10834ea5f942345beb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:31.236857 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b00d6-9682-41cb-aaf4-8abb1812ab84 None admin] RBAC: Authorizing `identity:create_grant(project_id=402397b981be4f0c9e778a2771c41937, user_id=74674b52807742abb7e144bba3bb6e56, role_id=e344e91a09be4d10834ea5f942345beb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:31.238558 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b00d6-9682-41cb-aaf4-8abb1812ab84 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:31.265902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 302/613] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:19:30 2022] PUT /identity/v3/projects/402397b981be4f0c9e778a2771c41937/users/74674b52807742abb7e144bba3bb6e56/roles/e344e91a09be4d10834ea5f942345beb => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:19:31.294568 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:31.321959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab36fc-c2c7-4f88-a965-648e321d62df None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:31.365606 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7793b70-2d73-4dc5-bfd1-20018a2605c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:31.366730 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7793b70-2d73-4dc5-bfd1-20018a2605c4 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:31.367163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7793b70-2d73-4dc5-bfd1-20018a2605c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:31.367588 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7793b70-2d73-4dc5-bfd1-20018a2605c4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:31.376573 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7793b70-2d73-4dc5-bfd1-20018a2605c4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:31.378276 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7793b70-2d73-4dc5-bfd1-20018a2605c4 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:31.394413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-e7793b70-2d73-4dc5-bfd1-20018a2605c4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 12:19:31.394413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:31.394413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:31.394413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:31.394413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:31.394413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:31.394413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:31.394413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:31.394413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:31.394413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:31.394413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:31.394413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:31.394413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:31.394413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:31.394413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:31.394413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:31.395610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:31.395610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:31.395610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:31.395610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:31.395610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:31.395610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:31.395610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:31.395610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:31.395610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:31.395610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:31.395610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:31.395610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:31.395610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:31.395610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:31.395610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:31.395610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:31.395610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:31.395610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:31.396769 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:31.396769 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:31.396769 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:31.396769 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:31.396769 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:31.396769 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:31.396769 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:31.396769 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:31.396769 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 12:19:31.396769 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:31.402607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 312/614] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:19:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:31.405042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b00d6-9682-41cb-aaf4-8abb1812ab84 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:31.529726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b00d6-9682-41cb-aaf4-8abb1812ab84 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:31.579912 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5dcc4d-b4cc-4f9a-a6f9-62f35bf5ac63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:31.580982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dcc4d-b4cc-4f9a-a6f9-62f35bf5ac63 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:31.581469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dcc4d-b4cc-4f9a-a6f9-62f35bf5ac63 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:31.581990 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dcc4d-b4cc-4f9a-a6f9-62f35bf5ac63 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:31.583068 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5dcc4d-b4cc-4f9a-a6f9-62f35bf5ac63 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:31.583582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5dcc4d-b4cc-4f9a-a6f9-62f35bf5ac63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:31.585810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5dcc4d-b4cc-4f9a-a6f9-62f35bf5ac63 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:31.611897 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 303/615] 10.222.0.25 () {56 vars in 1135 bytes} [Mon May 23 12:19:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:31.613594 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7793b70-2d73-4dc5-bfd1-20018a2605c4 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:31.729224 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7793b70-2d73-4dc5-bfd1-20018a2605c4 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:31.766947 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcc02c-9c4c-4cbf-8ae1-dfe2e9a1c832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:31.768146 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcc02c-9c4c-4cbf-8ae1-dfe2e9a1c832 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:31.768636 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcc02c-9c4c-4cbf-8ae1-dfe2e9a1c832 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:31.769138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcc02c-9c4c-4cbf-8ae1-dfe2e9a1c832 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:31.780819 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:31.788188 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bcc02c-9c4c-4cbf-8ae1-dfe2e9a1c832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:31.789837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bcc02c-9c4c-4cbf-8ae1-dfe2e9a1c832 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:31.812120 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-98bcc02c-9c4c-4cbf-8ae1-dfe2e9a1c832 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:31.812120 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:31.812120 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:31.812120 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:31.812120 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:31.812120 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:31.812120 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:31.812120 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:31.812120 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:31.812120 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:31.812120 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:31.812120 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:31.812120 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:31.812120 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:31.812120 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:31.813697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:31.813697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:31.813697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:31.813697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:31.813697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:31.813697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:31.813697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:31.813697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:31.813697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:31.813697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:31.813697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:31.813697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:31.813697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:31.813697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:31.813697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:31.813697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:31.813697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:31.815779 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:31.815779 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:31.815779 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:31.815779 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:31.818134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 313/616] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:31.819745 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5dcc4d-b4cc-4f9a-a6f9-62f35bf5ac63 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:31.834239 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:31.988190 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5dcc4d-b4cc-4f9a-a6f9-62f35bf5ac63 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:32.054118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1fc5d-9e1c-4bf5-9f1c-6974e472e27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:32.055708 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1fc5d-9e1c-4bf5-9f1c-6974e472e27a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:32.056465 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1fc5d-9e1c-4bf5-9f1c-6974e472e27a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:32.057234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1fc5d-9e1c-4bf5-9f1c-6974e472e27a None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:32.058885 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1fc5d-9e1c-4bf5-9f1c-6974e472e27a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:32.059703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1fc5d-9e1c-4bf5-9f1c-6974e472e27a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:32.062481 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1fc5d-9e1c-4bf5-9f1c-6974e472e27a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:32.089333 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 304/617] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:32.095062 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcc02c-9c4c-4cbf-8ae1-dfe2e9a1c832 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:32.184383 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de4f87-b531-45cd-8c84-4350840939b2 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:32.184837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de4f87-b531-45cd-8c84-4350840939b2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:32.184956 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de4f87-b531-45cd-8c84-4350840939b2 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:32.190125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 305/618] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:32.198578 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d6eae-4b6d-49a0-855b-05b6f8f62349 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:32.198937 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d6eae-4b6d-49a0-855b-05b6f8f62349 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:32.199514 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d6eae-4b6d-49a0-855b-05b6f8f62349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:32.251690 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a34d6eae-4b6d-49a0-855b-05b6f8f62349 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:32.252832 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a34d6eae-4b6d-49a0-855b-05b6f8f62349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:32.323618 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcc02c-9c4c-4cbf-8ae1-dfe2e9a1c832 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:32.384447 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3514b86-a0aa-4484-a9f4-b3fb22be5572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:32.385593 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3514b86-a0aa-4484-a9f4-b3fb22be5572 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:32.386068 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3514b86-a0aa-4484-a9f4-b3fb22be5572 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:32.386592 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3514b86-a0aa-4484-a9f4-b3fb22be5572 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:32.399055 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3514b86-a0aa-4484-a9f4-b3fb22be5572 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:32.401594 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3514b86-a0aa-4484-a9f4-b3fb22be5572 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:32.402700 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:32.415049 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 306/619] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:19:32.428962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-a3514b86-a0aa-4484-a9f4-b3fb22be5572 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:32.428962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:32.428962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:32.428962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:32.428962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:32.428962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:32.428962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:32.428962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:32.428962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:32.428962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:32.428962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:32.428962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:32.428962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:32.428962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:32.428962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:32.429925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:32.429925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:32.429925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:32.429925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:32.429925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:32.429925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:32.429925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:32.429925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:32.429925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:32.429925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:32.429925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:32.429925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:32.429925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:32.429925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:32.429925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:32.429925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:32.429925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:32.430831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:32.430831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:32.430831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:32.430831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:32.430831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:32.430831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:32.430831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:32.430831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:32.431807 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 314/620] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:32.437705 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d6eae-4b6d-49a0-855b-05b6f8f62349 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:32.498369 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3514b86-a0aa-4484-a9f4-b3fb22be5572 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:32.597946 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:32.622905 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d6eae-4b6d-49a0-855b-05b6f8f62349 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:32.704437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5139e-66eb-4b54-932d-2ef05ecaf299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:32.705521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5139e-66eb-4b54-932d-2ef05ecaf299 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:32.706010 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5139e-66eb-4b54-932d-2ef05ecaf299 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:32.706529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5139e-66eb-4b54-932d-2ef05ecaf299 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:32.707543 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5139e-66eb-4b54-932d-2ef05ecaf299 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:32.708066 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5139e-66eb-4b54-932d-2ef05ecaf299 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:32.718534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5139e-66eb-4b54-932d-2ef05ecaf299 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:32.732815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3514b86-a0aa-4484-a9f4-b3fb22be5572 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:32.738716 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 307/621] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:32.741833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5139e-66eb-4b54-932d-2ef05ecaf299 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:32.815909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13543f-429b-48af-8c88-65bf5c8214d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:32.817291 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13543f-429b-48af-8c88-65bf5c8214d0 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:32.820310 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13543f-429b-48af-8c88-65bf5c8214d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:32.820839 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13543f-429b-48af-8c88-65bf5c8214d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:32.858912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13543f-429b-48af-8c88-65bf5c8214d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:32.885644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-2e13543f-429b-48af-8c88-65bf5c8214d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:32.885644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:32.885644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:32.885644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:32.885644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:32.885644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:32.885644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:32.885644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:32.885644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:32.885644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:32.885644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:32.885644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:32.885644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:32.885644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:32.885644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:32.885644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:32.886719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:32.886719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:32.886719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:32.886719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:32.886719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:32.886719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:32.886719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:32.886719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:32.886719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:32.886719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:32.886719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:32.886719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:32.886719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:32.886719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:32.886719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:32.886719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:32.887560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:32.887560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:32.887560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:32.887560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:32.887560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:32.887560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:32.887560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:32.887560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:32.887560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:32.887560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:32.887560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:32.887560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:32.889682 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 315/622] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:19:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:32.898382 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13543f-429b-48af-8c88-65bf5c8214d0 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:32.922862 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:32.995394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5139e-66eb-4b54-932d-2ef05ecaf299 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:33.062259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab8522-6345-4d4b-a9d0-c38fb1f8a0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:33.064156 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab8522-6345-4d4b-a9d0-c38fb1f8a0ed None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:33.064624 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab8522-6345-4d4b-a9d0-c38fb1f8a0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:33.065215 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab8522-6345-4d4b-a9d0-c38fb1f8a0ed None admin] PATH_INFO: `/v3/projects/402397b981be4f0c9e778a2771c41937/users/03ca1edc22174d258ddeda25407ee6ed/roles/e344e91a09be4d10834ea5f942345beb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:33.092277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab8522-6345-4d4b-a9d0-c38fb1f8a0ed None admin] RBAC: Authorizing `identity:create_grant(project_id=402397b981be4f0c9e778a2771c41937, user_id=03ca1edc22174d258ddeda25407ee6ed, role_id=e344e91a09be4d10834ea5f942345beb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:33.092492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13543f-429b-48af-8c88-65bf5c8214d0 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:33.094792 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab8522-6345-4d4b-a9d0-c38fb1f8a0ed None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:33.109743 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:33.132577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 308/623] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:19:32 2022] PUT /identity/v3/projects/402397b981be4f0c9e778a2771c41937/users/03ca1edc22174d258ddeda25407ee6ed/roles/e344e91a09be4d10834ea5f942345beb => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:19:33.135615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce006087-4c49-4e2c-9789-af052180105a None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:33.136482 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce006087-4c49-4e2c-9789-af052180105a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:33.137269 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce006087-4c49-4e2c-9789-af052180105a None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:33.140471 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 309/624] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:33.150580 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6a8c9-fc8c-4055-8daa-cd1264689ced None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:33.150580 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6a8c9-fc8c-4055-8daa-cd1264689ced None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:33.150580 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6a8c9-fc8c-4055-8daa-cd1264689ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:33.166860 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffe97c-b212-4d48-bebf-b55787e4987f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:33.167983 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffe97c-b212-4d48-bebf-b55787e4987f None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:33.170004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffe97c-b212-4d48-bebf-b55787e4987f None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:33.170815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffe97c-b212-4d48-bebf-b55787e4987f None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:33.172296 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffe97c-b212-4d48-bebf-b55787e4987f None admin] RBAC: Adding query filter params (name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:33.172850 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffe97c-b212-4d48-bebf-b55787e4987f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:33.175610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffe97c-b212-4d48-bebf-b55787e4987f None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:33.211305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-e6b6a8c9-fc8c-4055-8daa-cd1264689ced None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:33.215584 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 316/625] 10.222.0.25 () {56 vars in 1103 bytes} [Mon May 23 12:19:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:33.216332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e6b6a8c9-fc8c-4055-8daa-cd1264689ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:33.222281 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffe97c-b212-4d48-bebf-b55787e4987f None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:33.390790 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 310/626] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:33.433542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6a8c9-fc8c-4055-8daa-cd1264689ced None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:33.449478 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffe97c-b212-4d48-bebf-b55787e4987f None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:33.486635 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c3fad-0b80-43d1-b135-ed17809a9071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:33.487440 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c3fad-0b80-43d1-b135-ed17809a9071 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:33.487725 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c3fad-0b80-43d1-b135-ed17809a9071 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:33.487995 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c3fad-0b80-43d1-b135-ed17809a9071 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:33.500637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c3fad-0b80-43d1-b135-ed17809a9071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:33.502139 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c3fad-0b80-43d1-b135-ed17809a9071 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:33.508639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:33.524363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-4a9c3fad-0b80-43d1-b135-ed17809a9071 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:33.524363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:33.524363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:33.524363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:33.524363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:33.524363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:33.524363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:33.524363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:33.524363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:33.524363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:33.524363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:33.524363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:33.524363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:33.524363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:33.524363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:33.526135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:33.526135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:33.526135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:33.526135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:33.526135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:33.526135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:33.526135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:33.526135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:33.526135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:33.526135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:33.526135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:33.526135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:33.526135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:33.526135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:33.526135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:33.526135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:33.526135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:33.527933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:33.527933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:33.527933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:33.527933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:33.531967 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 317/627] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:33.531967 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c3fad-0b80-43d1-b135-ed17809a9071 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:33.584666 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:33.618438 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6a8c9-fc8c-4055-8daa-cd1264689ced None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:33.641895 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c3fad-0b80-43d1-b135-ed17809a9071 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:33.679580 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a38a5-3c6c-4975-a27b-6986e91a50df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:33.680557 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a38a5-3c6c-4975-a27b-6986e91a50df None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:33.680953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a38a5-3c6c-4975-a27b-6986e91a50df None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:33.681231 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a38a5-3c6c-4975-a27b-6986e91a50df None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:33.681941 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712caffa-dbef-4e99-90ef-17a858479950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:33.682126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a38a5-3c6c-4975-a27b-6986e91a50df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:33.682257 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a38a5-3c6c-4975-a27b-6986e91a50df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:33.683394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712caffa-dbef-4e99-90ef-17a858479950 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:33.683671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a38a5-3c6c-4975-a27b-6986e91a50df None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:33.683914 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712caffa-dbef-4e99-90ef-17a858479950 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:33.684370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712caffa-dbef-4e99-90ef-17a858479950 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:33.701381 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 318/628] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:33.702655 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a38a5-3c6c-4975-a27b-6986e91a50df None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:33.703772 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712caffa-dbef-4e99-90ef-17a858479950 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:33.719764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-712caffa-dbef-4e99-90ef-17a858479950 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:33.719764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:33.719764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:33.719764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:33.719764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:33.719764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:33.719764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:33.719764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:33.719764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:33.719764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:33.719764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:33.719764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:33.719764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:33.719764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:33.719764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:33.719764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:33.721527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:33.721527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:33.721527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:33.721527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:33.721527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:33.721527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:33.721527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:33.721527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:33.721527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:33.721527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:33.721527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:33.721527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:33.721527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:33.721527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:33.721527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:33.721527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:33.723243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:33.723243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:33.723243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:33.723243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:33.723243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:33.723243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:33.723243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:33.723243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:33.723243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:33.723243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:33.723243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:33.723243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:33.723243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 311/629] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:19:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:33.731694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712caffa-dbef-4e99-90ef-17a858479950 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:33.795064 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:33.808084 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a38a5-3c6c-4975-a27b-6986e91a50df None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:33.876055 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713465b9-6738-49d4-b1e7-c836bc4857c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:33.876923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713465b9-6738-49d4-b1e7-c836bc4857c2 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:33.877213 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713465b9-6738-49d4-b1e7-c836bc4857c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:33.877489 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713465b9-6738-49d4-b1e7-c836bc4857c2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:33.894470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713465b9-6738-49d4-b1e7-c836bc4857c2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:33.895983 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713465b9-6738-49d4-b1e7-c836bc4857c2 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:33.911072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:33.916263 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712caffa-dbef-4e99-90ef-17a858479950 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:33.944755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-713465b9-6738-49d4-b1e7-c836bc4857c2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 12:19:33.944755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:33.944755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:33.944755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:33.944755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:33.944755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:33.944755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:33.944755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:33.944755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:33.944755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:33.944755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:33.944755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:33.944755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:33.944755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:33.944755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:33.944755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:33.945837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:33.945837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:33.945837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:33.945837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:33.945837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:33.945837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:33.945837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:33.945837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:33.945837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:33.945837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:33.945837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:33.945837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:33.945837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:33.945837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:33.945837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:33.945837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:33.945837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:33.945837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:33.946826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:33.946826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:33.946826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:33.946826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:33.946826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:33.946826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:33.946826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:33.946826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:33.946826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 12:19:33.946826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:33.954917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 319/630] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:19:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:33.956396 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713465b9-6738-49d4-b1e7-c836bc4857c2 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:33.979875 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f612b-b112-4f0f-a10c-a1f4ed0da7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:33.980924 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f612b-b112-4f0f-a10c-a1f4ed0da7ab None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:33.981387 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f612b-b112-4f0f-a10c-a1f4ed0da7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:33.981845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f612b-b112-4f0f-a10c-a1f4ed0da7ab None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:33.983414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f612b-b112-4f0f-a10c-a1f4ed0da7ab None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:33.983925 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f612b-b112-4f0f-a10c-a1f4ed0da7ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:33.986145 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f612b-b112-4f0f-a10c-a1f4ed0da7ab None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:34.000758 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 312/631] 10.222.0.25 () {56 vars in 1103 bytes} [Mon May 23 12:19:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:34.009369 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f612b-b112-4f0f-a10c-a1f4ed0da7ab None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:34.174084 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713465b9-6738-49d4-b1e7-c836bc4857c2 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:34.189959 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f612b-b112-4f0f-a10c-a1f4ed0da7ab None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:34.218757 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa7d2f-d726-41b7-a030-a04a72d2c999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:34.219436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa7d2f-d726-41b7-a030-a04a72d2c999 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:34.219724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa7d2f-d726-41b7-a030-a04a72d2c999 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:34.219998 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa7d2f-d726-41b7-a030-a04a72d2c999 None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:34.220939 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa7d2f-d726-41b7-a030-a04a72d2c999 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:34.221253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa7d2f-d726-41b7-a030-a04a72d2c999 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:34.222831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa7d2f-d726-41b7-a030-a04a72d2c999 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:34.226949 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05c9ac-1a69-4d7b-93ef-f28ad804f508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:34.227749 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05c9ac-1a69-4d7b-93ef-f28ad804f508 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:34.228033 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05c9ac-1a69-4d7b-93ef-f28ad804f508 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:34.228308 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05c9ac-1a69-4d7b-93ef-f28ad804f508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:34.239377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:34.240050 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05c9ac-1a69-4d7b-93ef-f28ad804f508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:34.241772 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05c9ac-1a69-4d7b-93ef-f28ad804f508 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:34.244462 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 320/632] 10.222.0.25 () {56 vars in 1137 bytes} [Mon May 23 12:19:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:34.245923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b0aff-bba2-4edc-89b7-1122cdf9c450 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:34.246197 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b0aff-bba2-4edc-89b7-1122cdf9c450 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:34.246472 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b0aff-bba2-4edc-89b7-1122cdf9c450 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:34.254128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 321/633] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:34.255000 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b0aff-bba2-4edc-89b7-1122cdf9c450 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:34.269577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-2b05c9ac-1a69-4d7b-93ef-f28ad804f508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:34.269577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:34.269577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:34.269577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:34.269577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:34.269577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:34.269577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:34.269577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:34.269577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:34.269577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:34.269577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:34.269577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:34.269577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:34.269577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:34.269577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:34.272012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:34.272012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:34.272012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:34.272012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:34.272012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:34.272012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:34.272012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:34.272012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:34.272012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:34.272012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:34.272012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:34.272012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:34.272012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:34.272012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:34.272012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:34.272012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:34.272012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:34.274381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:34.274381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:34.274381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:34.274381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:34.274381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 313/634] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:34.274381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d7334-a34b-4007-babc-80d66871c45d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:34.274381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d7334-a34b-4007-babc-80d66871c45d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:34.274381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d7334-a34b-4007-babc-80d66871c45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:34.299142 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-128d7334-a34b-4007-babc-80d66871c45d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:34.300428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-128d7334-a34b-4007-babc-80d66871c45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:34.309908 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:34.385695 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 314/635] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:34.387010 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d7334-a34b-4007-babc-80d66871c45d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:34.393190 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b0aff-bba2-4edc-89b7-1122cdf9c450 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:34.430477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa9fcd-0798-4345-9d28-b3fbf9140414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:34.431523 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa9fcd-0798-4345-9d28-b3fbf9140414 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:34.431953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa9fcd-0798-4345-9d28-b3fbf9140414 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:34.432396 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa9fcd-0798-4345-9d28-b3fbf9140414 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:34.504152 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:34.507215 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa9fcd-0798-4345-9d28-b3fbf9140414 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:34.508811 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa9fcd-0798-4345-9d28-b3fbf9140414 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:34.520780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d7334-a34b-4007-babc-80d66871c45d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:34.558185 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672d2ff-1354-41ca-9dd9-a939e0130ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:34.559174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672d2ff-1354-41ca-9dd9-a939e0130ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:34.559607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672d2ff-1354-41ca-9dd9-a939e0130ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:34.560029 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672d2ff-1354-41ca-9dd9-a939e0130ab7 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:34.560901 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672d2ff-1354-41ca-9dd9-a939e0130ab7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:34.561353 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672d2ff-1354-41ca-9dd9-a939e0130ab7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:34.562931 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672d2ff-1354-41ca-9dd9-a939e0130ab7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:34.575783 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 315/636] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:34.577060 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672d2ff-1354-41ca-9dd9-a939e0130ab7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:34.581491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:34.637059 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 322/637] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:19:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:19:34.638037 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa9fcd-0798-4345-9d28-b3fbf9140414 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:34.701753 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672d2ff-1354-41ca-9dd9-a939e0130ab7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:34.741689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa562f-4ca7-4241-abde-3c93790d9fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:34.742874 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa562f-4ca7-4241-abde-3c93790d9fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:34.743511 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa562f-4ca7-4241-abde-3c93790d9fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:34.743980 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa562f-4ca7-4241-abde-3c93790d9fb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:34.748407 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:34.753530 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa9fcd-0798-4345-9d28-b3fbf9140414 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:34.758705 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa562f-4ca7-4241-abde-3c93790d9fb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:34.766818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-fbfa562f-4ca7-4241-abde-3c93790d9fb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:34.766818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:34.766818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:34.766818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:34.766818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:34.766818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:34.766818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:34.766818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:34.766818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:34.766818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:34.766818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:34.766818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:34.766818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:34.766818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:34.766818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:34.766818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:34.768000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:34.768000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:34.768000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:34.768000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:34.768000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:34.768000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:34.768000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:34.768000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:34.768000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:34.768000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:34.768000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:34.768000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:34.768000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:34.768000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:34.768000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:34.768000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:34.768966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:34.768966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:34.768966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:34.768966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:34.768966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:34.768966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:34.768966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:34.768966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:34.768966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:34.768966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:34.768966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:34.768966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:34.774613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 316/638] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:19:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:34.775661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa562f-4ca7-4241-abde-3c93790d9fb4 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:34.793214 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f432d5-6ab6-4e3f-9807-1fbc6c0a9745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:34.794096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f432d5-6ab6-4e3f-9807-1fbc6c0a9745 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:34.794296 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f432d5-6ab6-4e3f-9807-1fbc6c0a9745 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:34.794603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f432d5-6ab6-4e3f-9807-1fbc6c0a9745 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:34.803331 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f432d5-6ab6-4e3f-9807-1fbc6c0a9745 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:34.804808 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f432d5-6ab6-4e3f-9807-1fbc6c0a9745 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:34.820159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-35f432d5-6ab6-4e3f-9807-1fbc6c0a9745 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 12:19:34.820159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:34.820159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:34.820159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:34.820159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:34.820159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:34.820159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:34.820159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:34.820159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:34.820159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:34.820159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:34.820159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:34.820159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:34.820159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:34.820159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:34.820159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:34.822023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:34.822023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:34.822023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:34.822023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:34.822023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:34.822023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:34.822023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:34.822023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:34.822023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:34.822023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:34.822023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:34.822023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:34.822023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:34.822023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:34.822023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:34.822023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:34.822023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:34.822023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:34.823965 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:34.823965 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:34.823965 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:34.823965 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:34.823965 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:34.823965 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:34.823965 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:34.823965 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:34.823965 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 12:19:34.823965 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:34.823965 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 323/639] 10.222.0.25 () {56 vars in 1093 bytes} [Mon May 23 12:19:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:34.823965 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f432d5-6ab6-4e3f-9807-1fbc6c0a9745 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:34.854252 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:34.901286 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa562f-4ca7-4241-abde-3c93790d9fb4 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:34.938977 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e469c5-dc9c-4a62-933f-2ce93fc06eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:34.939784 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e469c5-dc9c-4a62-933f-2ce93fc06eff None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:34.940056 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e469c5-dc9c-4a62-933f-2ce93fc06eff None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:34.940327 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e469c5-dc9c-4a62-933f-2ce93fc06eff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:34.951662 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e469c5-dc9c-4a62-933f-2ce93fc06eff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:34.953189 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e469c5-dc9c-4a62-933f-2ce93fc06eff None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:34.954891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f432d5-6ab6-4e3f-9807-1fbc6c0a9745 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:34.971165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-26e469c5-dc9c-4a62-933f-2ce93fc06eff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:34.971165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:34.971165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:34.971165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:34.971165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:34.971165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:34.971165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:34.971165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:34.971165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:34.971165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:34.971165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:34.971165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:34.971165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:34.971165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:34.971165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:34.972240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:34.972240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:34.972240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:34.972240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:34.972240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:34.972240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:34.972240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:34.972240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:34.972240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:34.972240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:34.972240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:34.972240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:34.972240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:34.972240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:34.972240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:34.972240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:34.972240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:34.973507 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:34.973507 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:34.973507 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:34.973507 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:34.973507 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 317/640] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:34.973796 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba820e-eb9b-428c-b801-1f04c67c4bb1 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:34.975423 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba820e-eb9b-428c-b801-1f04c67c4bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:34.975423 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba820e-eb9b-428c-b801-1f04c67c4bb1 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:34.976170 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 318/641] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:34.976703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba820e-eb9b-428c-b801-1f04c67c4bb1 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:35.005067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac0439-4b66-46e6-b021-50acc271d12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:35.005913 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac0439-4b66-46e6-b021-50acc271d12c None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:35.006225 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac0439-4b66-46e6-b021-50acc271d12c None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:35.006528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac0439-4b66-46e6-b021-50acc271d12c None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:35.007286 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac0439-4b66-46e6-b021-50acc271d12c None admin] RBAC: Adding query filter params (name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:35.007590 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac0439-4b66-46e6-b021-50acc271d12c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:35.008978 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac0439-4b66-46e6-b021-50acc271d12c None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:35.017800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 324/642] 10.222.0.25 () {56 vars in 1103 bytes} [Mon May 23 12:19:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:35.019387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac0439-4b66-46e6-b021-50acc271d12c None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:35.058043 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:35.118318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba820e-eb9b-428c-b801-1f04c67c4bb1 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:35.138664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:35.155634 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac0439-4b66-46e6-b021-50acc271d12c None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:35.164623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c779133-a4f4-4361-b514-8a91f7173091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:35.165658 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c779133-a4f4-4361-b514-8a91f7173091 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:35.166673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c779133-a4f4-4361-b514-8a91f7173091 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:35.166964 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c779133-a4f4-4361-b514-8a91f7173091 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:35.168464 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c779133-a4f4-4361-b514-8a91f7173091 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:35.169132 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c779133-a4f4-4361-b514-8a91f7173091 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:35.171244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c779133-a4f4-4361-b514-8a91f7173091 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:35.196171 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 319/643] 10.222.0.25 () {56 vars in 1133 bytes} [Mon May 23 12:19:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:35.197606 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b0fcf-ef7c-489f-b7f5-4ba19051d832 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:35.197832 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b0fcf-ef7c-489f-b7f5-4ba19051d832 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:35.198093 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b0fcf-ef7c-489f-b7f5-4ba19051d832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:35.199470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc405ab-1939-4985-8bde-ff4e38acc30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:35.200135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc405ab-1939-4985-8bde-ff4e38acc30a None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:35.200500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc405ab-1939-4985-8bde-ff4e38acc30a None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:35.200782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc405ab-1939-4985-8bde-ff4e38acc30a None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:35.201553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc405ab-1939-4985-8bde-ff4e38acc30a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:35.201855 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc405ab-1939-4985-8bde-ff4e38acc30a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:35.203555 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc405ab-1939-4985-8bde-ff4e38acc30a None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:35.215336 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-320b0fcf-ef7c-489f-b7f5-4ba19051d832 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:35.216525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-320b0fcf-ef7c-489f-b7f5-4ba19051d832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:35.226019 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 325/644] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:35.226019 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc405ab-1939-4985-8bde-ff4e38acc30a None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:35.311402 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 320/645] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:35.311875 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b0fcf-ef7c-489f-b7f5-4ba19051d832 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:35.340345 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:35.363609 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc405ab-1939-4985-8bde-ff4e38acc30a None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:35.406817 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a532ffc-d231-4149-ba0a-6a38cdbd23b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:35.408025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a532ffc-d231-4149-ba0a-6a38cdbd23b4 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:35.408390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a532ffc-d231-4149-ba0a-6a38cdbd23b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:35.408743 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a532ffc-d231-4149-ba0a-6a38cdbd23b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:35.420626 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a532ffc-d231-4149-ba0a-6a38cdbd23b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:35.422098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a532ffc-d231-4149-ba0a-6a38cdbd23b4 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:35.430745 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b0fcf-ef7c-489f-b7f5-4ba19051d832 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:35.432676 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:35.440699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-6a532ffc-d231-4149-ba0a-6a38cdbd23b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:35.440699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:35.440699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:35.440699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:35.440699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:35.440699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:35.440699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:35.440699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:35.440699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:35.440699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:35.440699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:35.440699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:35.440699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:35.440699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:35.440699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:35.441670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:35.441670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:35.441670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:35.441670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:35.441670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:35.441670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:35.441670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:35.441670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:35.441670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:35.441670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:35.441670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:35.441670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:35.441670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:35.441670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:35.441670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:35.441670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:35.441670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:35.442767 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:35.442767 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:35.442767 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:35.442767 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:35.446662 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 326/646] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:35.448235 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a532ffc-d231-4149-ba0a-6a38cdbd23b4 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:35.472260 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d06431-68b4-4544-9353-b9ba7027d8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:35.472858 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d06431-68b4-4544-9353-b9ba7027d8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:35.473117 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d06431-68b4-4544-9353-b9ba7027d8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:35.473392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d06431-68b4-4544-9353-b9ba7027d8c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:35.552999 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d06431-68b4-4544-9353-b9ba7027d8c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:35.555258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d06431-68b4-4544-9353-b9ba7027d8c3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:35.584919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a532ffc-d231-4149-ba0a-6a38cdbd23b4 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:35.646107 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099b752-576a-44b2-a34a-26fcd151f28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:35.648908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099b752-576a-44b2-a34a-26fcd151f28c None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:35.650160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099b752-576a-44b2-a34a-26fcd151f28c None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:35.651098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099b752-576a-44b2-a34a-26fcd151f28c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:35.655730 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:35.667438 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099b752-576a-44b2-a34a-26fcd151f28c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:35.669720 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099b752-576a-44b2-a34a-26fcd151f28c None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:35.680602 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 321/647] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:19:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:19:35.681047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d06431-68b4-4544-9353-b9ba7027d8c3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:35.683996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:35.695295 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-8099b752-576a-44b2-a34a-26fcd151f28c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:35.695295 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:35.695295 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:35.695295 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:35.695295 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:35.695295 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:35.695295 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:35.695295 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:35.695295 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:35.695295 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:35.695295 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:35.695295 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:35.695295 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:35.695295 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:35.695295 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:35.696758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:35.696758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:35.696758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:35.696758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:35.696758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:35.696758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:35.696758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:35.696758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:35.696758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:35.696758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:35.696758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:35.696758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:35.696758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:35.696758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:35.696758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:35.696758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:35.696758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:35.697943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:35.697943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:35.697943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:35.697943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:35.697943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:35.697943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:35.697943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:35.697943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:35.697943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 327/648] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:35.698624 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099b752-576a-44b2-a34a-26fcd151f28c None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:35.811729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d06431-68b4-4544-9353-b9ba7027d8c3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:35.822901 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099b752-576a-44b2-a34a-26fcd151f28c None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:35.856999 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8daaa-f0d2-4d5f-82f3-7dccd05e054c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:35.858061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8daaa-f0d2-4d5f-82f3-7dccd05e054c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:35.858342 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8daaa-f0d2-4d5f-82f3-7dccd05e054c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:35.858651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8daaa-f0d2-4d5f-82f3-7dccd05e054c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:35.860780 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839e776-8488-46a5-96bc-8af4386834bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:35.861450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839e776-8488-46a5-96bc-8af4386834bc None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:35.861746 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839e776-8488-46a5-96bc-8af4386834bc None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:35.862156 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839e776-8488-46a5-96bc-8af4386834bc None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:35.862923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839e776-8488-46a5-96bc-8af4386834bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:35.863237 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839e776-8488-46a5-96bc-8af4386834bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:35.864616 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839e776-8488-46a5-96bc-8af4386834bc None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:35.873043 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8daaa-f0d2-4d5f-82f3-7dccd05e054c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:35.880831 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-91e8daaa-f0d2-4d5f-82f3-7dccd05e054c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:35.880831 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:35.880831 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:35.880831 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:35.880831 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:35.880831 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:35.880831 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:35.880831 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:35.880831 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:35.880831 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:35.880831 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:35.880831 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:35.880831 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:35.880831 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:35.880831 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:35.880831 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:35.881982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:35.881982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:35.881982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:35.881982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:35.881982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:35.881982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:35.881982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:35.881982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:35.881982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:35.881982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:35.881982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:35.881982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:35.881982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:35.881982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:35.881982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:35.881982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:35.882861 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:35.882861 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:35.882861 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:35.882861 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:35.882861 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:35.882861 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:35.882861 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:35.882861 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:35.882861 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:35.882861 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:35.882861 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:35.882861 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:35.882861 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 322/649] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:19:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:35.883545 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8daaa-f0d2-4d5f-82f3-7dccd05e054c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:35.886539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 328/650] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:35.886539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839e776-8488-46a5-96bc-8af4386834bc None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:35.944079 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:35.946290 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:35.988117 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8daaa-f0d2-4d5f-82f3-7dccd05e054c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:35.988776 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839e776-8488-46a5-96bc-8af4386834bc None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:36.027826 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce365340-feec-4da6-aab7-4a00effdb53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:36.028655 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce365340-feec-4da6-aab7-4a00effdb53d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:36.029103 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce365340-feec-4da6-aab7-4a00effdb53d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:36.029222 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce365340-feec-4da6-aab7-4a00effdb53d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:36.033328 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25809d-9ecb-4c4f-bc98-5178c10e0a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:36.033931 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25809d-9ecb-4c4f-bc98-5178c10e0a3f None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:36.034197 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25809d-9ecb-4c4f-bc98-5178c10e0a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:36.034591 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25809d-9ecb-4c4f-bc98-5178c10e0a3f None admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:36.035283 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25809d-9ecb-4c4f-bc98-5178c10e0a3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:36.035696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25809d-9ecb-4c4f-bc98-5178c10e0a3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:36.037524 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25809d-9ecb-4c4f-bc98-5178c10e0a3f None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:36.040238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce365340-feec-4da6-aab7-4a00effdb53d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:36.041699 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce365340-feec-4da6-aab7-4a00effdb53d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:36.050142 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 329/651] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:36.051560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00432d81-0472-48c3-a0c7-16e3cfdf80c9 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:36.051847 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00432d81-0472-48c3-a0c7-16e3cfdf80c9 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:36.052083 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00432d81-0472-48c3-a0c7-16e3cfdf80c9 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:36.053843 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 330/652] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:36.054572 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00432d81-0472-48c3-a0c7-16e3cfdf80c9 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:36.062064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-ce365340-feec-4da6-aab7-4a00effdb53d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:36.062064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:36.062064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:36.062064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:36.062064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:36.062064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:36.062064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:36.062064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:36.062064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:36.062064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:36.062064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:36.062064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:36.062064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:36.062064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:36.062064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:36.063238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:36.063238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:36.063238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:36.063238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:36.063238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:36.063238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:36.063238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:36.063238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:36.063238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:36.063238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:36.063238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:36.063238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:36.063238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:36.063238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:36.063238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:36.063238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:36.063238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:36.064185 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:36.064185 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:36.064185 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:36.064185 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:36.064185 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 323/653] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:36.064185 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce365340-feec-4da6-aab7-4a00effdb53d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:36.171251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00432d81-0472-48c3-a0c7-16e3cfdf80c9 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:36.187424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:36.188406 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce365340-feec-4da6-aab7-4a00effdb53d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:36.204120 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:36.210031 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d084068-bcfa-4b50-8d71-c17b4fcffd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:36.210746 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d084068-bcfa-4b50-8d71-c17b4fcffd54 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:36.211035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d084068-bcfa-4b50-8d71-c17b4fcffd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:36.211311 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d084068-bcfa-4b50-8d71-c17b4fcffd54 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:36.212054 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d084068-bcfa-4b50-8d71-c17b4fcffd54 None admin] RBAC: Adding query filter params (name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:36.212362 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d084068-bcfa-4b50-8d71-c17b4fcffd54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:36.213796 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d084068-bcfa-4b50-8d71-c17b4fcffd54 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:36.222972 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 331/654] 10.222.0.25 () {56 vars in 1103 bytes} [Mon May 23 12:19:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:36.223797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d084068-bcfa-4b50-8d71-c17b4fcffd54 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:36.233172 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0b851-4137-4ea6-a88b-38d08b767d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:36.234120 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0b851-4137-4ea6-a88b-38d08b767d8d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:36.234478 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0b851-4137-4ea6-a88b-38d08b767d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:36.234880 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0b851-4137-4ea6-a88b-38d08b767d8d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:36.244814 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0b851-4137-4ea6-a88b-38d08b767d8d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:36.246314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0b851-4137-4ea6-a88b-38d08b767d8d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:36.261325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-7fd0b851-4137-4ea6-a88b-38d08b767d8d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 12:19:36.261325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:36.261325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:36.261325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:36.261325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:36.261325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:36.261325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:36.261325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:36.261325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:36.261325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:36.261325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:36.261325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:36.261325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:36.261325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:36.261325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:36.261325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:36.262462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:36.262462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:36.262462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:36.262462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:36.262462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:36.262462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:36.262462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:36.262462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:36.262462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:36.262462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:36.262462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:36.262462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:36.262462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:36.262462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:36.262462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:36.262462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:36.262462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:36.262462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:36.263622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:36.263622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:36.263622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:36.263622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:36.263622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:36.263622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:36.263622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:36.263622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:36.263622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 12:19:36.263622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:36.263622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 324/655] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:19:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:36.264323 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55fa82-0b8d-4bcd-a5f2-88b39cad2abc None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:36.264323 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55fa82-0b8d-4bcd-a5f2-88b39cad2abc None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:36.264323 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55fa82-0b8d-4bcd-a5f2-88b39cad2abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:36.281792 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1e55fa82-0b8d-4bcd-a5f2-88b39cad2abc None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:36.283044 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1e55fa82-0b8d-4bcd-a5f2-88b39cad2abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:36.368877 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 325/656] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:36.370049 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d084068-bcfa-4b50-8d71-c17b4fcffd54 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:36.370343 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55fa82-0b8d-4bcd-a5f2-88b39cad2abc None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:36.427132 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d54ad-76b5-4975-b1bc-5d4547038d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:36.428535 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d54ad-76b5-4975-b1bc-5d4547038d91 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:36.428932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d54ad-76b5-4975-b1bc-5d4547038d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:36.429480 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d54ad-76b5-4975-b1bc-5d4547038d91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:36.430660 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d54ad-76b5-4975-b1bc-5d4547038d91 None admin] RBAC: Adding query filter params (role.id=e344e91a09be4d10834ea5f942345beb, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=8ed824e419544b33a2c4413da4b45aaf) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:36.430972 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d54ad-76b5-4975-b1bc-5d4547038d91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:36.433090 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d54ad-76b5-4975-b1bc-5d4547038d91 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:36.450534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 332/657] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:19:36 2022] GET /identity/v3/role_assignments?user.id=8ed824e419544b33a2c4413da4b45aaf&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=e344e91a09be4d10834ea5f942345beb => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:36.450534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d54ad-76b5-4975-b1bc-5d4547038d91 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:36.502577 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:36.518666 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55fa82-0b8d-4bcd-a5f2-88b39cad2abc None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:36.523986 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:36.563802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161255b7-20df-4108-bdd0-86fe20b4035a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:36.564483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161255b7-20df-4108-bdd0-86fe20b4035a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:36.564763 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161255b7-20df-4108-bdd0-86fe20b4035a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:36.565031 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161255b7-20df-4108-bdd0-86fe20b4035a None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:36.565770 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161255b7-20df-4108-bdd0-86fe20b4035a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:36.566074 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161255b7-20df-4108-bdd0-86fe20b4035a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:36.567562 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161255b7-20df-4108-bdd0-86fe20b4035a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:36.584569 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 326/658] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:36.585453 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161255b7-20df-4108-bdd0-86fe20b4035a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:36.593421 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d54ad-76b5-4975-b1bc-5d4547038d91 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:36.646784 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3918e-f305-40aa-8472-656596186aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:36.647656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3918e-f305-40aa-8472-656596186aec None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:36.648028 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3918e-f305-40aa-8472-656596186aec None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:36.648382 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3918e-f305-40aa-8472-656596186aec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:36.663823 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3918e-f305-40aa-8472-656596186aec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:36.665633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3918e-f305-40aa-8472-656596186aec None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:36.689176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-2dc3918e-f305-40aa-8472-656596186aec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:36.689176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:36.689176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:36.689176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:36.689176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:36.689176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:36.689176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:36.689176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:36.689176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:36.689176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:36.689176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:36.689176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:36.689176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:36.689176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:36.689176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:36.690185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:36.690185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:36.690185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:36.690185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:36.690185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:36.690185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:36.690185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:36.690185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:36.690185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:36.690185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:36.690185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:36.690185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:36.690185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:36.690185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:36.690185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:36.690185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:36.690185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:36.691118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:36.691118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:36.691118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:36.691118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:36.691118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 333/659] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:36.692620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3918e-f305-40aa-8472-656596186aec None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:36.722177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161255b7-20df-4108-bdd0-86fe20b4035a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:36.763046 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e4596-7d3d-49da-a190-fb1552a30472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:36.763829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e4596-7d3d-49da-a190-fb1552a30472 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:36.764477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e4596-7d3d-49da-a190-fb1552a30472 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:36.764761 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e4596-7d3d-49da-a190-fb1552a30472 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:36.765857 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e4596-7d3d-49da-a190-fb1552a30472 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:36.766281 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e4596-7d3d-49da-a190-fb1552a30472 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:36.767826 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e4596-7d3d-49da-a190-fb1552a30472 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:36.788907 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 327/660] 10.222.0.25 () {56 vars in 1137 bytes} [Mon May 23 12:19:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:36.789832 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e4596-7d3d-49da-a190-fb1552a30472 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:36.808943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:36.819601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:36.820662 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3918e-f305-40aa-8472-656596186aec None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:36.864002 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f341e-29b3-4752-81b1-a99bd6465fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:36.864931 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f341e-29b3-4752-81b1-a99bd6465fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:36.865251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f341e-29b3-4752-81b1-a99bd6465fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:36.865631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f341e-29b3-4752-81b1-a99bd6465fc8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:36.877851 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f341e-29b3-4752-81b1-a99bd6465fc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:36.886149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-ca3f341e-29b3-4752-81b1-a99bd6465fc8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:36.886149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:36.886149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:36.886149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:36.886149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:36.886149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:36.886149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:36.886149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:36.886149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:36.886149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:36.886149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:36.886149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:36.886149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:36.886149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:36.886149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:36.886149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:36.887904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:36.887904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:36.887904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:36.887904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:36.887904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:36.887904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:36.887904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:36.887904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:36.887904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:36.887904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:36.887904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:36.887904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:36.887904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:36.887904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:36.887904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:36.887904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:36.889619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:36.889619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:36.889619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:36.889619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:36.889619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:36.889619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:36.889619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:36.889619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:36.889619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:36.889619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:36.889619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:36.889619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:36.889619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 334/661] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:19:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:36.889619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f341e-29b3-4752-81b1-a99bd6465fc8 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:36.927523 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e4596-7d3d-49da-a190-fb1552a30472 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:36.970017 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0351c-4042-4529-82d3-2fc7f9d0dc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:36.970855 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0351c-4042-4529-82d3-2fc7f9d0dc8e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:36.971145 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0351c-4042-4529-82d3-2fc7f9d0dc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:36.971495 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0351c-4042-4529-82d3-2fc7f9d0dc8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:36.979556 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0351c-4042-4529-82d3-2fc7f9d0dc8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:36.981263 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0351c-4042-4529-82d3-2fc7f9d0dc8e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:36.998116 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-97f0351c-4042-4529-82d3-2fc7f9d0dc8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:36.998116 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:36.998116 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:36.998116 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:36.998116 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:36.998116 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:36.998116 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:36.998116 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:36.998116 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:36.998116 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:36.998116 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:36.998116 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:36.998116 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:36.998116 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:36.998116 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:37.005433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:37.005433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:37.005433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:37.005433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:37.005433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:37.005433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:37.005433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:37.005433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:37.005433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:37.005433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:37.005433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:37.005433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:37.005433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:37.005433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:37.005433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:37.005433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:37.005433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:37.008485 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:37.008485 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:37.008485 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:37.008485 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:37.008485 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:37.008485 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:37.008485 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:37.008485 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:37.008485 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 328/662] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:37.008485 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0351c-4042-4529-82d3-2fc7f9d0dc8e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:37.025356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f341e-29b3-4752-81b1-a99bd6465fc8 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:37.064251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce1c48-fb06-4168-b723-7b27b3c797c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:37.064919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce1c48-fb06-4168-b723-7b27b3c797c0 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:37.065205 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce1c48-fb06-4168-b723-7b27b3c797c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:37.065481 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce1c48-fb06-4168-b723-7b27b3c797c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:37.066208 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce1c48-fb06-4168-b723-7b27b3c797c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:37.066541 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce1c48-fb06-4168-b723-7b27b3c797c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:37.067927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce1c48-fb06-4168-b723-7b27b3c797c0 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:37.082361 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 335/663] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:37.083054 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce1c48-fb06-4168-b723-7b27b3c797c0 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:37.098449 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:37.113355 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:37.134907 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0351c-4042-4529-82d3-2fc7f9d0dc8e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:37.181318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca727aa0-4504-47c5-a793-82663cf7f1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:37.182581 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca727aa0-4504-47c5-a793-82663cf7f1db None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:37.183233 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca727aa0-4504-47c5-a793-82663cf7f1db None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:37.183867 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca727aa0-4504-47c5-a793-82663cf7f1db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:37.206269 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce1c48-fb06-4168-b723-7b27b3c797c0 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:37.257469 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23766a6a-3824-48c4-a4a9-00fc5e0141ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:37.258766 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23766a6a-3824-48c4-a4a9-00fc5e0141ec None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:37.259340 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23766a6a-3824-48c4-a4a9-00fc5e0141ec None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:37.259963 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23766a6a-3824-48c4-a4a9-00fc5e0141ec None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:37.261395 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23766a6a-3824-48c4-a4a9-00fc5e0141ec None admin] RBAC: Adding query filter params (name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:37.262124 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23766a6a-3824-48c4-a4a9-00fc5e0141ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:37.264640 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23766a6a-3824-48c4-a4a9-00fc5e0141ec None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:37.275699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 336/664] 10.222.0.25 () {56 vars in 1103 bytes} [Mon May 23 12:19:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:37.276740 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23766a6a-3824-48c4-a4a9-00fc5e0141ec None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:37.287493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca727aa0-4504-47c5-a793-82663cf7f1db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:37.289102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca727aa0-4504-47c5-a793-82663cf7f1db None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:37.371061 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:37.392086 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:37.404495 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23766a6a-3824-48c4-a4a9-00fc5e0141ec None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:37.416891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 329/665] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:19:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:19:37.417684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca727aa0-4504-47c5-a793-82663cf7f1db None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:37.452341 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856313c-8ecd-4b75-9192-0491ace75e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:37.452923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856313c-8ecd-4b75-9192-0491ace75e85 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:37.453214 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856313c-8ecd-4b75-9192-0491ace75e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:37.453495 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856313c-8ecd-4b75-9192-0491ace75e85 None admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:37.454286 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856313c-8ecd-4b75-9192-0491ace75e85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:37.454631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856313c-8ecd-4b75-9192-0491ace75e85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:37.456098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856313c-8ecd-4b75-9192-0491ace75e85 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:37.470858 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 337/666] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:37.471808 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856313c-8ecd-4b75-9192-0491ace75e85 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:37.543704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca727aa0-4504-47c5-a793-82663cf7f1db None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:37.582409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2658b-3f13-49fd-a19e-b0bd51869523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:37.583371 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2658b-3f13-49fd-a19e-b0bd51869523 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:37.583652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2658b-3f13-49fd-a19e-b0bd51869523 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:37.584441 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2658b-3f13-49fd-a19e-b0bd51869523 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:37.592273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2658b-3f13-49fd-a19e-b0bd51869523 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:37.593755 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2658b-3f13-49fd-a19e-b0bd51869523 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:37.606217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856313c-8ecd-4b75-9192-0491ace75e85 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:37.610341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-07c2658b-3f13-49fd-a19e-b0bd51869523 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 12:19:37.610341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:37.610341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:37.610341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:37.610341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:37.610341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:37.610341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:37.610341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:37.610341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:37.610341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:37.610341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:37.610341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:37.610341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:37.610341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:37.610341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:37.610341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:37.611483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:37.611483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:37.611483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:37.611483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:37.611483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:37.611483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:37.611483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:37.611483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:37.611483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:37.611483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:37.611483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:37.611483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:37.611483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:37.611483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:37.611483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:37.611483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:37.611483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:37.611483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:37.612436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:37.612436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:37.612436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:37.612436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:37.612436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:37.612436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:37.612436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:37.612436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:37.612436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 12:19:37.612436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:37.612436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 330/667] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:19:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:37.612436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2658b-3f13-49fd-a19e-b0bd51869523 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:37.658156 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b5af1-5e77-43f6-9266-7ced69794cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:37.659004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b5af1-5e77-43f6-9266-7ced69794cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:37.659294 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b5af1-5e77-43f6-9266-7ced69794cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:37.659649 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b5af1-5e77-43f6-9266-7ced69794cb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:37.662801 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:37.671908 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:37.673930 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b5af1-5e77-43f6-9266-7ced69794cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:37.675426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b5af1-5e77-43f6-9266-7ced69794cb3 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:37.694932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-629b5af1-5e77-43f6-9266-7ced69794cb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:37.694932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:37.694932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:37.694932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:37.694932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:37.694932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:37.694932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:37.694932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:37.694932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:37.694932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:37.694932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:37.694932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:37.694932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:37.694932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:37.694932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:37.696085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:37.696085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:37.696085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:37.696085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:37.696085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:37.696085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:37.696085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:37.696085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:37.696085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:37.696085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:37.696085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:37.696085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:37.696085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:37.696085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:37.696085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:37.696085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:37.696085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:37.696983 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:37.696983 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:37.696983 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:37.696983 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:37.696983 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 338/668] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:37.697509 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b5af1-5e77-43f6-9266-7ced69794cb3 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:37.751046 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2658b-3f13-49fd-a19e-b0bd51869523 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:37.808517 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e897be-a436-4d1b-b104-e124067f0770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:37.809620 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e897be-a436-4d1b-b104-e124067f0770 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:37.809998 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e897be-a436-4d1b-b104-e124067f0770 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:37.810360 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e897be-a436-4d1b-b104-e124067f0770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:37.827511 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e897be-a436-4d1b-b104-e124067f0770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:37.829575 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e897be-a436-4d1b-b104-e124067f0770 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:37.838353 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b5af1-5e77-43f6-9266-7ced69794cb3 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:37.855445 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-95e897be-a436-4d1b-b104-e124067f0770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:37.855445 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:37.855445 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:37.855445 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:37.855445 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:37.855445 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:37.855445 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:37.855445 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:37.855445 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:37.855445 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:37.855445 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:37.855445 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:37.855445 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:37.855445 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:37.855445 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:37.856536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:37.856536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:37.856536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:37.856536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:37.856536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:37.856536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:37.856536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:37.856536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:37.856536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:37.856536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:37.856536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:37.856536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:37.856536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:37.856536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:37.856536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:37.856536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:37.856536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:37.857778 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:37.857778 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:37.857778 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:37.857778 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:37.857778 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 331/669] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:37.858244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e897be-a436-4d1b-b104-e124067f0770 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:37.886812 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d107803-eb59-4dc6-9821-7d71126af483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:37.888073 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d107803-eb59-4dc6-9821-7d71126af483 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:37.888512 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d107803-eb59-4dc6-9821-7d71126af483 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:37.888939 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d107803-eb59-4dc6-9821-7d71126af483 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:37.889948 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d107803-eb59-4dc6-9821-7d71126af483 None admin] RBAC: Adding query filter params (role.id=e344e91a09be4d10834ea5f942345beb, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=d49997b9108145b78eb4db1d8823bf4d) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:37.890411 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d107803-eb59-4dc6-9821-7d71126af483 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:37.892019 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d107803-eb59-4dc6-9821-7d71126af483 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:37.910723 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 339/670] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:19:37 2022] GET /identity/v3/role_assignments?user.id=d49997b9108145b78eb4db1d8823bf4d&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=e344e91a09be4d10834ea5f942345beb => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:37.911951 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d107803-eb59-4dc6-9821-7d71126af483 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:37.999036 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:38.009004 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:38.017397 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e897be-a436-4d1b-b104-e124067f0770 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:38.069053 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e1a9b-b378-49aa-a0b6-a975a5594f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:38.069656 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e1a9b-b378-49aa-a0b6-a975a5594f58 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:38.070038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e1a9b-b378-49aa-a0b6-a975a5594f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:38.070464 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e1a9b-b378-49aa-a0b6-a975a5594f58 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:38.071997 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e1a9b-b378-49aa-a0b6-a975a5594f58 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:38.072605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e1a9b-b378-49aa-a0b6-a975a5594f58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:38.075044 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e1a9b-b378-49aa-a0b6-a975a5594f58 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:38.081500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d107803-eb59-4dc6-9821-7d71126af483 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:38.105270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 332/671] 10.222.0.25 () {56 vars in 1139 bytes} [Mon May 23 12:19:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:38.106623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e1a9b-b378-49aa-a0b6-a975a5594f58 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:38.136605 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bec9b7-9d87-4220-8f5a-731b678e56f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:38.137574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bec9b7-9d87-4220-8f5a-731b678e56f7 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:38.137868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bec9b7-9d87-4220-8f5a-731b678e56f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:38.138158 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bec9b7-9d87-4220-8f5a-731b678e56f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:38.139090 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bec9b7-9d87-4220-8f5a-731b678e56f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:38.139416 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bec9b7-9d87-4220-8f5a-731b678e56f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:38.141112 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bec9b7-9d87-4220-8f5a-731b678e56f7 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:38.155580 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 340/672] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:38.157458 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bec9b7-9d87-4220-8f5a-731b678e56f7 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:38.269204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e1a9b-b378-49aa-a0b6-a975a5594f58 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:38.298417 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bec9b7-9d87-4220-8f5a-731b678e56f7 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:38.309844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab6ce6-9a05-4ec9-96cc-88ebeb598076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:38.310537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab6ce6-9a05-4ec9-96cc-88ebeb598076 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:38.310827 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab6ce6-9a05-4ec9-96cc-88ebeb598076 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:38.311109 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab6ce6-9a05-4ec9-96cc-88ebeb598076 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:38.311848 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab6ce6-9a05-4ec9-96cc-88ebeb598076 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:38.312171 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab6ce6-9a05-4ec9-96cc-88ebeb598076 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:38.312537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:38.313595 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab6ce6-9a05-4ec9-96cc-88ebeb598076 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:38.327891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 333/673] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:38.328917 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab6ce6-9a05-4ec9-96cc-88ebeb598076 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:38.339076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa7810-de30-47f5-86b9-96398ee4490e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:38.339811 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa7810-de30-47f5-86b9-96398ee4490e None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:38.340136 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa7810-de30-47f5-86b9-96398ee4490e None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:38.340423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa7810-de30-47f5-86b9-96398ee4490e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:38.382903 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:38.447407 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa7810-de30-47f5-86b9-96398ee4490e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:38.449311 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa7810-de30-47f5-86b9-96398ee4490e None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:38.465960 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab6ce6-9a05-4ec9-96cc-88ebeb598076 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:38.510211 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93738e-e4d5-4e4a-af67-16460dad9656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:38.511076 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93738e-e4d5-4e4a-af67-16460dad9656 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:38.511365 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93738e-e4d5-4e4a-af67-16460dad9656 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:38.511655 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93738e-e4d5-4e4a-af67-16460dad9656 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:38.521136 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93738e-e4d5-4e4a-af67-16460dad9656 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:38.524084 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93738e-e4d5-4e4a-af67-16460dad9656 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:38.543394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-ce93738e-e4d5-4e4a-af67-16460dad9656 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 12:19:38.543394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:38.543394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:38.543394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:38.543394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:38.543394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:38.543394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:38.543394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:38.543394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:38.543394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:38.543394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:38.543394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:38.543394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:38.543394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:38.543394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:38.543394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:38.544588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:38.544588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:38.544588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:38.544588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:38.544588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:38.544588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:38.544588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:38.544588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:38.544588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:38.544588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:38.544588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:38.544588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:38.544588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:38.544588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:38.544588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:38.544588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:38.544588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:38.544588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:38.545732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:38.545732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:38.545732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:38.545732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:38.545732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:38.545732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:38.545732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:38.545732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:38.545732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 12:19:38.545732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:38.547302 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 334/674] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:19:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:38.548334 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93738e-e4d5-4e4a-af67-16460dad9656 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:38.583504 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 341/675] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:19:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:19:38.584674 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa7810-de30-47f5-86b9-96398ee4490e None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:38.601295 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:38.654891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:38.705008 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93738e-e4d5-4e4a-af67-16460dad9656 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:38.728674 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa7810-de30-47f5-86b9-96398ee4490e None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:38.763869 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fcdf4-70b0-40b4-931e-73f05de98c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:38.765987 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fcdf4-70b0-40b4-931e-73f05de98c80 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:38.767026 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fcdf4-70b0-40b4-931e-73f05de98c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:38.767530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fcdf4-70b0-40b4-931e-73f05de98c80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:38.777930 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71b771-1859-4066-a6fd-f0f8dd6d1797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:38.778127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45fcdf4-70b0-40b4-931e-73f05de98c80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:38.778701 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71b771-1859-4066-a6fd-f0f8dd6d1797 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:38.779048 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71b771-1859-4066-a6fd-f0f8dd6d1797 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:38.779387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71b771-1859-4066-a6fd-f0f8dd6d1797 None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:38.780293 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71b771-1859-4066-a6fd-f0f8dd6d1797 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:38.780535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45fcdf4-70b0-40b4-931e-73f05de98c80 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:38.780740 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71b771-1859-4066-a6fd-f0f8dd6d1797 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:38.782425 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71b771-1859-4066-a6fd-f0f8dd6d1797 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:38.799887 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-f45fcdf4-70b0-40b4-931e-73f05de98c80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:38.799887 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:38.799887 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:38.799887 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:38.799887 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:38.799887 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:38.799887 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:38.799887 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:38.799887 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:38.799887 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:38.799887 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:38.799887 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:38.799887 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:38.799887 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:38.799887 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:38.801032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:38.801032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:38.801032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:38.801032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:38.801032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:38.801032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:38.801032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:38.801032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:38.801032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:38.801032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:38.801032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:38.801032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:38.801032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:38.801032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:38.801032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:38.801032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:38.801032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:38.802121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:38.802121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:38.802121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:38.802121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:38.802121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:38.802121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:38.802121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:38.802121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:38.808544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 335/676] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:38.808544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fcdf4-70b0-40b4-931e-73f05de98c80 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:38.816887 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 342/677] 10.222.0.25 () {56 vars in 1135 bytes} [Mon May 23 12:19:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:38.817995 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71b771-1859-4066-a6fd-f0f8dd6d1797 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:38.916706 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:38.932241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fcdf4-70b0-40b4-931e-73f05de98c80 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:38.956647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71b771-1859-4066-a6fd-f0f8dd6d1797 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:38.968186 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:38.974573 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e842c-765d-45fd-b215-b44c721b7d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:38.975473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e842c-765d-45fd-b215-b44c721b7d50 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:38.975763 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e842c-765d-45fd-b215-b44c721b7d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:38.976038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e842c-765d-45fd-b215-b44c721b7d50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:38.987582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e842c-765d-45fd-b215-b44c721b7d50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:38.994810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e842c-765d-45fd-b215-b44c721b7d50 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:39.007667 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b24cd-2afc-443a-aa83-8e53705241ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:39.008337 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b24cd-2afc-443a-aa83-8e53705241ca None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:39.008616 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b24cd-2afc-443a-aa83-8e53705241ca None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:39.008896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b24cd-2afc-443a-aa83-8e53705241ca None admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:39.009687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b24cd-2afc-443a-aa83-8e53705241ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:39.010030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b24cd-2afc-443a-aa83-8e53705241ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:39.011457 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b24cd-2afc-443a-aa83-8e53705241ca None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:39.013305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-120e842c-765d-45fd-b215-b44c721b7d50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:39.013305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:39.013305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:39.013305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:39.013305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:39.013305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:39.013305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:39.013305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:39.013305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:39.013305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:39.013305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:39.013305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:39.013305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:39.013305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:39.013305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:39.014175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:39.014175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:39.014175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:39.014175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:39.014175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:39.014175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:39.014175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:39.014175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:39.014175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:39.014175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:39.014175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:39.014175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:39.014175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:39.014175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:39.014175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:39.014175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:39.014175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:39.015106 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:39.015106 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:39.015106 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:39.015106 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:39.015106 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 336/678] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:39.015374 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e842c-765d-45fd-b215-b44c721b7d50 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:39.027922 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 343/679] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:39.034157 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3c445-4087-4c4c-8909-b8fcfc8da0e0 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:39.034462 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3c445-4087-4c4c-8909-b8fcfc8da0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:39.034785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3c445-4087-4c4c-8909-b8fcfc8da0e0 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:39.036285 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 344/680] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:39.040486 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3c445-4087-4c4c-8909-b8fcfc8da0e0 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:39.148124 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e842c-765d-45fd-b215-b44c721b7d50 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:39.161381 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3c445-4087-4c4c-8909-b8fcfc8da0e0 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:39.189500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:39.189632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49cc2e-a5b2-48cc-b0b0-3c67ba643a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:39.190344 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49cc2e-a5b2-48cc-b0b0-3c67ba643a8c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:39.191056 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49cc2e-a5b2-48cc-b0b0-3c67ba643a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:39.191056 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49cc2e-a5b2-48cc-b0b0-3c67ba643a8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:39.198764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bab36-89b5-4eb2-810c-b25112cd00ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:39.199429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bab36-89b5-4eb2-810c-b25112cd00ed None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:39.199712 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bab36-89b5-4eb2-810c-b25112cd00ed None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:39.199985 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bab36-89b5-4eb2-810c-b25112cd00ed None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:39.200711 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bab36-89b5-4eb2-810c-b25112cd00ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:39.201018 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bab36-89b5-4eb2-810c-b25112cd00ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:39.202381 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bab36-89b5-4eb2-810c-b25112cd00ed None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:39.215717 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 345/681] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:39.220667 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bab36-89b5-4eb2-810c-b25112cd00ed None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:39.251623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:39.269047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49cc2e-a5b2-48cc-b0b0-3c67ba643a8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:39.270589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49cc2e-a5b2-48cc-b0b0-3c67ba643a8c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:39.333669 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bab36-89b5-4eb2-810c-b25112cd00ed None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:39.371643 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad376f18-1692-40f9-b334-70e5f541c4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:39.372302 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad376f18-1692-40f9-b334-70e5f541c4bf None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:39.372591 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad376f18-1692-40f9-b334-70e5f541c4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:39.372873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad376f18-1692-40f9-b334-70e5f541c4bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:39.373697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad376f18-1692-40f9-b334-70e5f541c4bf None admin] RBAC: Adding query filter params (role.id=e344e91a09be4d10834ea5f942345beb, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=3a3f520fcbe544c9be7e33a64eb1dc20) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:39.374014 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad376f18-1692-40f9-b334-70e5f541c4bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:39.375482 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad376f18-1692-40f9-b334-70e5f541c4bf None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:39.381511 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 346/682] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:19:39 2022] GET /identity/v3/role_assignments?user.id=3a3f520fcbe544c9be7e33a64eb1dc20&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=e344e91a09be4d10834ea5f942345beb => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:39.382772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbae78-e377-47b7-ad1c-802c0ca4c050 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:39.383206 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbae78-e377-47b7-ad1c-802c0ca4c050 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:39.383568 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbae78-e377-47b7-ad1c-802c0ca4c050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:39.386083 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 337/683] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:19:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:19:39.388308 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49cc2e-a5b2-48cc-b0b0-3c67ba643a8c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:39.417306 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-34bbae78-e377-47b7-ad1c-802c0ca4c050 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:39.418806 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-34bbae78-e377-47b7-ad1c-802c0ca4c050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:39.491357 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:39.500232 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:39.519975 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49cc2e-a5b2-48cc-b0b0-3c67ba643a8c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:39.523788 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 347/684] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:39.524916 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbae78-e377-47b7-ad1c-802c0ca4c050 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:39.587491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85baa27f-c1cc-45b4-8c9f-e4e144a6918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:39.589712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85baa27f-c1cc-45b4-8c9f-e4e144a6918b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:39.590203 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85baa27f-c1cc-45b4-8c9f-e4e144a6918b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:39.590898 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85baa27f-c1cc-45b4-8c9f-e4e144a6918b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:39.605672 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85baa27f-c1cc-45b4-8c9f-e4e144a6918b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:39.605672 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85baa27f-c1cc-45b4-8c9f-e4e144a6918b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:39.619541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-85baa27f-c1cc-45b4-8c9f-e4e144a6918b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:39.619541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:39.619541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:39.619541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:39.619541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:39.619541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:39.619541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:39.619541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:39.619541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:39.619541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:39.619541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:39.619541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:39.619541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:39.619541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:39.619541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:39.620493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:39.620493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:39.620493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:39.620493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:39.620493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:39.620493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:39.620493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:39.620493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:39.620493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:39.620493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:39.620493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:39.620493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:39.620493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:39.620493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:39.620493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:39.620493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:39.620493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:39.621418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:39.621418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:39.621418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:39.621418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:39.621418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:39.621418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:39.621418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:39.621418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:39.622234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 338/685] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:39.623110 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85baa27f-c1cc-45b4-8c9f-e4e144a6918b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:39.668082 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbae78-e377-47b7-ad1c-802c0ca4c050 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:39.711303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfeb91-5cbb-4a0c-a7d8-7ec28583bcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:39.712421 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfeb91-5cbb-4a0c-a7d8-7ec28583bcc2 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:39.712884 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfeb91-5cbb-4a0c-a7d8-7ec28583bcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:39.713352 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfeb91-5cbb-4a0c-a7d8-7ec28583bcc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:39.724293 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfeb91-5cbb-4a0c-a7d8-7ec28583bcc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:39.725998 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfeb91-5cbb-4a0c-a7d8-7ec28583bcc2 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:39.745314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-21dfeb91-5cbb-4a0c-a7d8-7ec28583bcc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:39.745314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:39.745314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:39.745314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:39.745314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:39.745314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:39.745314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:39.745314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:39.745314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:39.745314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:39.745314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:39.745314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:39.745314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:39.745314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:39.745314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:39.746255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:39.746255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:39.746255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:39.746255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:39.746255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:39.746255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:39.746255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:39.746255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:39.746255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:39.746255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:39.746255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:39.746255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:39.746255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:39.746255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:39.746255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:39.746255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:39.746255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:39.747178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:39.747178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:39.747178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:39.747178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:39.749406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 348/686] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:39.754593 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfeb91-5cbb-4a0c-a7d8-7ec28583bcc2 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:39.754750 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85baa27f-c1cc-45b4-8c9f-e4e144a6918b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:39.803083 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af086114-ed8e-4d94-ba83-2b9b742cb3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:39.803897 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af086114-ed8e-4d94-ba83-2b9b742cb3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:39.804443 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af086114-ed8e-4d94-ba83-2b9b742cb3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:39.804731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af086114-ed8e-4d94-ba83-2b9b742cb3b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:39.809475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:39.819884 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af086114-ed8e-4d94-ba83-2b9b742cb3b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:39.821900 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af086114-ed8e-4d94-ba83-2b9b742cb3b0 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:39.825653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:39.847119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-af086114-ed8e-4d94-ba83-2b9b742cb3b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:39.847119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:39.847119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:39.847119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:39.847119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:39.847119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:39.847119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:39.847119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:39.847119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:39.847119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:39.847119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:39.847119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:39.847119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:39.847119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:39.847119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:39.848047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:39.848047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:39.848047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:39.848047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:39.848047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:39.848047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:39.848047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:39.848047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:39.848047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:39.848047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:39.848047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:39.848047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:39.848047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:39.848047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:39.848047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:39.848047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:39.848047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:39.848925 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:39.848925 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:39.848925 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:39.848925 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:39.848925 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 339/687] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:39.849699 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af086114-ed8e-4d94-ba83-2b9b742cb3b0 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:39.899454 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfeb91-5cbb-4a0c-a7d8-7ec28583bcc2 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:39.941082 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056b1aa-1959-42fe-9c45-041d17368caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:39.941745 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056b1aa-1959-42fe-9c45-041d17368caa None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:39.942102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056b1aa-1959-42fe-9c45-041d17368caa None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:39.942374 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056b1aa-1959-42fe-9c45-041d17368caa None admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:39.943436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056b1aa-1959-42fe-9c45-041d17368caa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:39.943671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056b1aa-1959-42fe-9c45-041d17368caa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:39.945183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056b1aa-1959-42fe-9c45-041d17368caa None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:39.958149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 349/688] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:39.959783 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056b1aa-1959-42fe-9c45-041d17368caa None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:39.965830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af086114-ed8e-4d94-ba83-2b9b742cb3b0 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:40.010114 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3b24b-4eab-44f1-a544-95a90a49374f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:40.011073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3b24b-4eab-44f1-a544-95a90a49374f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:40.011365 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3b24b-4eab-44f1-a544-95a90a49374f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:40.011646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3b24b-4eab-44f1-a544-95a90a49374f None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:40.012379 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3b24b-4eab-44f1-a544-95a90a49374f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:40.012688 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3b24b-4eab-44f1-a544-95a90a49374f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:40.014877 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3b24b-4eab-44f1-a544-95a90a49374f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:40.036498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 340/689] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:40.036498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3b24b-4eab-44f1-a544-95a90a49374f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:40.077483 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:40.086783 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056b1aa-1959-42fe-9c45-041d17368caa None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:40.107508 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:40.129916 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677d4ec-966e-42df-9b86-50cc0d25ff14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:40.131140 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677d4ec-966e-42df-9b86-50cc0d25ff14 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:40.131440 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677d4ec-966e-42df-9b86-50cc0d25ff14 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:40.131714 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677d4ec-966e-42df-9b86-50cc0d25ff14 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:40.132430 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677d4ec-966e-42df-9b86-50cc0d25ff14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:40.132733 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677d4ec-966e-42df-9b86-50cc0d25ff14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:40.134379 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677d4ec-966e-42df-9b86-50cc0d25ff14 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:40.147906 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 350/690] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:40.149184 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677d4ec-966e-42df-9b86-50cc0d25ff14 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:40.162620 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3b24b-4eab-44f1-a544-95a90a49374f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:40.205107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464fead-dfcd-4ad2-a709-d0b8ada1875c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:40.206192 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464fead-dfcd-4ad2-a709-d0b8ada1875c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:40.206732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464fead-dfcd-4ad2-a709-d0b8ada1875c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:40.207243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464fead-dfcd-4ad2-a709-d0b8ada1875c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:40.208313 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464fead-dfcd-4ad2-a709-d0b8ada1875c None admin] RBAC: Adding query filter params (role.id=e344e91a09be4d10834ea5f942345beb, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=74674b52807742abb7e144bba3bb6e56) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:40.208932 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464fead-dfcd-4ad2-a709-d0b8ada1875c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:40.210738 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464fead-dfcd-4ad2-a709-d0b8ada1875c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:40.218099 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 341/691] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:19:40 2022] GET /identity/v3/role_assignments?user.id=74674b52807742abb7e144bba3bb6e56&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=e344e91a09be4d10834ea5f942345beb => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:40.219394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464fead-dfcd-4ad2-a709-d0b8ada1875c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:40.271180 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677d4ec-966e-42df-9b86-50cc0d25ff14 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:40.310702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234368e-9a62-4665-85e3-18dc944ef775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:40.311497 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234368e-9a62-4665-85e3-18dc944ef775 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:40.311780 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234368e-9a62-4665-85e3-18dc944ef775 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:40.312053 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234368e-9a62-4665-85e3-18dc944ef775 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:40.320506 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234368e-9a62-4665-85e3-18dc944ef775 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:40.321894 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234368e-9a62-4665-85e3-18dc944ef775 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:40.330590 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464fead-dfcd-4ad2-a709-d0b8ada1875c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:40.338138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-4234368e-9a62-4665-85e3-18dc944ef775 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:40.338138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:40.338138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:40.338138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:40.338138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:40.338138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:40.338138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:40.338138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:40.338138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:40.338138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:40.338138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:40.338138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:40.338138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:40.338138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:40.338138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:40.339056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:40.339056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:40.339056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:40.339056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:40.339056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:40.339056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:40.339056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:40.339056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:40.339056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:40.339056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:40.339056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:40.339056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:40.339056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:40.339056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:40.339056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:40.339056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:40.339056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:40.340463 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:40.340463 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:40.340463 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:40.340463 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:40.340463 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:40.340463 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:40.340463 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:40.340463 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:40.340463 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 351/692] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:40.345638 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234368e-9a62-4665-85e3-18dc944ef775 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:40.358360 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:40.367599 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:40.375041 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d17677-90e9-4b97-ab49-37df40192387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:40.375876 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d17677-90e9-4b97-ab49-37df40192387 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:40.376265 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d17677-90e9-4b97-ab49-37df40192387 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:40.376642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d17677-90e9-4b97-ab49-37df40192387 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:40.378051 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d17677-90e9-4b97-ab49-37df40192387 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:40.380012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d17677-90e9-4b97-ab49-37df40192387 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:40.411623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 342/693] 10.222.0.25 () {60 vars in 1132 bytes} [Mon May 23 12:19:40 2022] POST /identity/v3/users => generated 254 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:19:40.414436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db4d58-6fa3-4cfd-98ea-f183b633d2a4 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:40.415176 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db4d58-6fa3-4cfd-98ea-f183b633d2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:40.415607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db4d58-6fa3-4cfd-98ea-f183b633d2a4 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:40.417462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 343/694] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:40.424623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d941e-ed78-4222-a038-5377ee6150bc None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:40.424623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d941e-ed78-4222-a038-5377ee6150bc None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:40.424623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d941e-ed78-4222-a038-5377ee6150bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:40.441864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-270d941e-ed78-4222-a038-5377ee6150bc None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:40.443153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-270d941e-ed78-4222-a038-5377ee6150bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:40.485416 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234368e-9a62-4665-85e3-18dc944ef775 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:40.521975 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 344/695] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 12:19:40.533320 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9d12e-9739-46eb-ba33-32e37a99ea72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:40.533998 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9d12e-9739-46eb-ba33-32e37a99ea72 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:40.534289 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9d12e-9739-46eb-ba33-32e37a99ea72 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:40.534598 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9d12e-9739-46eb-ba33-32e37a99ea72 None admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:40.535464 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9d12e-9739-46eb-ba33-32e37a99ea72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:40.535777 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9d12e-9739-46eb-ba33-32e37a99ea72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:40.537358 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9d12e-9739-46eb-ba33-32e37a99ea72 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:40.546214 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d941e-ed78-4222-a038-5377ee6150bc None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:40.558626 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 352/696] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:40.560597 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9d12e-9739-46eb-ba33-32e37a99ea72 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:40.663254 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:40.694344 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9d12e-9739-46eb-ba33-32e37a99ea72 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:40.699460 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d941e-ed78-4222-a038-5377ee6150bc None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:40.708450 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:40.743283 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969dfdd3-e8d3-4f93-ace3-2e5d09e5f9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:40.744239 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969dfdd3-e8d3-4f93-ace3-2e5d09e5f9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:40.744530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969dfdd3-e8d3-4f93-ace3-2e5d09e5f9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:40.744949 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969dfdd3-e8d3-4f93-ace3-2e5d09e5f9d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:40.753861 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4133e07c-3e2d-4fc5-8c07-844798740819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:40.754553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133e07c-3e2d-4fc5-8c07-844798740819 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:40.754873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133e07c-3e2d-4fc5-8c07-844798740819 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:40.755571 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133e07c-3e2d-4fc5-8c07-844798740819 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:40.756546 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4133e07c-3e2d-4fc5-8c07-844798740819 None admin] RBAC: Adding query filter params (role.id=e344e91a09be4d10834ea5f942345beb, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=03ca1edc22174d258ddeda25407ee6ed) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:40.756921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4133e07c-3e2d-4fc5-8c07-844798740819 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:40.758516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4133e07c-3e2d-4fc5-8c07-844798740819 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:40.766996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969dfdd3-e8d3-4f93-ace3-2e5d09e5f9d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:40.767783 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 353/697] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:19:40 2022] GET /identity/v3/role_assignments?user.id=03ca1edc22174d258ddeda25407ee6ed&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=e344e91a09be4d10834ea5f942345beb => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:40.779249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-969dfdd3-e8d3-4f93-ace3-2e5d09e5f9d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:19:40.779249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:40.779249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:40.779249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:40.779249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:40.779249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:40.779249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:40.779249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:40.779249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:40.779249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:40.779249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:40.779249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:40.779249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:40.779249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:40.779249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:40.779249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:40.780251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:40.780251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:40.780251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:40.780251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:40.780251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:40.780251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:40.780251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:40.780251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:40.780251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:40.780251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:40.780251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:40.780251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:40.780251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:40.780251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:40.780251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:40.780251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:40.781080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:40.781080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:40.781080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:40.781080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:40.781080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:40.781080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:40.781080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:40.781080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:40.781080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:40.781080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:40.781080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:19:40.781080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:40.781080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 345/698] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:19:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:40.787563 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4133e07c-3e2d-4fc5-8c07-844798740819 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:40.904826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4133e07c-3e2d-4fc5-8c07-844798740819 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:40.950184 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877053e0-5cfb-4d17-b6bd-20484126125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:40.951117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877053e0-5cfb-4d17-b6bd-20484126125a None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:40.951117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877053e0-5cfb-4d17-b6bd-20484126125a None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:40.951429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877053e0-5cfb-4d17-b6bd-20484126125a None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:40.952129 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877053e0-5cfb-4d17-b6bd-20484126125a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:40.952443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877053e0-5cfb-4d17-b6bd-20484126125a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:40.953868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877053e0-5cfb-4d17-b6bd-20484126125a None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:40.960537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:40.964527 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 354/699] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:19:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:40.971557 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969dfdd3-e8d3-4f93-ace3-2e5d09e5f9d4 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:41.098099 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969dfdd3-e8d3-4f93-ace3-2e5d09e5f9d4 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:41.135400 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2b2fe-9ad3-40dc-88f6-3c800f93fbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:41.136256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2b2fe-9ad3-40dc-88f6-3c800f93fbea None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:41.136549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2b2fe-9ad3-40dc-88f6-3c800f93fbea None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:41.136830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2b2fe-9ad3-40dc-88f6-3c800f93fbea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:41.148467 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2b2fe-9ad3-40dc-88f6-3c800f93fbea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:41.149957 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2b2fe-9ad3-40dc-88f6-3c800f93fbea None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:41.168892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-23a2b2fe-9ad3-40dc-88f6-3c800f93fbea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:41.168892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:41.168892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:41.168892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:41.168892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:41.168892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:41.168892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:41.168892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:41.168892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:41.168892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:41.168892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:41.168892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:41.168892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:41.168892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:41.168892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:41.169833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:41.169833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:41.169833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:41.169833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:41.169833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:41.169833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:41.169833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:41.169833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:41.169833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:41.169833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:41.169833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:41.169833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:41.169833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:41.169833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:41.169833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:41.169833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:41.169833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:41.170758 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:41.170758 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:41.170758 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:41.170758 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:41.170758 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 346/700] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:41.176282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877053e0-5cfb-4d17-b6bd-20484126125a None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:41.289520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877053e0-5cfb-4d17-b6bd-20484126125a None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:41.325235 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41695b84-6c2f-4f1d-85a4-be94569977f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:41.325899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41695b84-6c2f-4f1d-85a4-be94569977f9 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:41.326220 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41695b84-6c2f-4f1d-85a4-be94569977f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:41.326461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41695b84-6c2f-4f1d-85a4-be94569977f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:41.327217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41695b84-6c2f-4f1d-85a4-be94569977f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:41.327527 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41695b84-6c2f-4f1d-85a4-be94569977f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:41.328963 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41695b84-6c2f-4f1d-85a4-be94569977f9 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:41.342905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 355/701] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:41.348319 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2b2fe-9ad3-40dc-88f6-3c800f93fbea None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:41.370537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:41.461661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2b2fe-9ad3-40dc-88f6-3c800f93fbea None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:41.499965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224851db-2f72-4942-88bf-45eec7b6ee38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:41.500764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224851db-2f72-4942-88bf-45eec7b6ee38 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:41.501051 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224851db-2f72-4942-88bf-45eec7b6ee38 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:41.501332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224851db-2f72-4942-88bf-45eec7b6ee38 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:41.510916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224851db-2f72-4942-88bf-45eec7b6ee38 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:41.512489 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224851db-2f72-4942-88bf-45eec7b6ee38 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:41.527549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-224851db-2f72-4942-88bf-45eec7b6ee38 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 12:19:41.527549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:41.527549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:41.527549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:41.527549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:41.527549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:41.527549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:41.527549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:41.527549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:41.527549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:41.527549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:41.527549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:41.527549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:41.527549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:41.527549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:41.527549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:41.528541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:41.528541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:41.528541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:41.528541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:41.528541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:41.528541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:41.528541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:41.528541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:41.528541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:41.528541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:41.528541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:41.528541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:41.528541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:41.528541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:41.528541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:41.528541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:41.528541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:41.528541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:41.529484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:41.529484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:41.529484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:41.529484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:41.529484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:41.529484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:41.529484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:41.529484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:41.529484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 12:19:41.529484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:41.529484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 347/702] 10.222.0.25 () {56 vars in 1093 bytes} [Mon May 23 12:19:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:41.534656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41695b84-6c2f-4f1d-85a4-be94569977f9 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:41.614132 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:41.671914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41695b84-6c2f-4f1d-85a4-be94569977f9 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:41.721169 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a03f4-d1d6-4682-90d1-73bb25cf12ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:41.721850 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a03f4-d1d6-4682-90d1-73bb25cf12ba None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:41.722138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a03f4-d1d6-4682-90d1-73bb25cf12ba None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:41.722415 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a03f4-d1d6-4682-90d1-73bb25cf12ba None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:41.723300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a03f4-d1d6-4682-90d1-73bb25cf12ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:41.723612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a03f4-d1d6-4682-90d1-73bb25cf12ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:41.725573 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a03f4-d1d6-4682-90d1-73bb25cf12ba None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:41.748188 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 356/703] 10.222.0.25 () {56 vars in 1133 bytes} [Mon May 23 12:19:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:41.753629 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224851db-2f72-4942-88bf-45eec7b6ee38 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:41.872414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:41.897881 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224851db-2f72-4942-88bf-45eec7b6ee38 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:41.932877 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b48ea-591f-4255-b8b3-81f4f3956ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:41.933537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b48ea-591f-4255-b8b3-81f4f3956ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:41.933822 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b48ea-591f-4255-b8b3-81f4f3956ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:41.934100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b48ea-591f-4255-b8b3-81f4f3956ca0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:41.985865 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c61681-f326-47e5-a8b5-3eafd8e656fb None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:41.986890 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c61681-f326-47e5-a8b5-3eafd8e656fb None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:41.987449 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c61681-f326-47e5-a8b5-3eafd8e656fb None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:41.989271 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 357/704] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:19:41.995398 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a7a3e-c07b-4656-9180-63deb39177b4 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:41.995925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a7a3e-c07b-4656-9180-63deb39177b4 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:41.996498 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a7a3e-c07b-4656-9180-63deb39177b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:42.008181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b48ea-591f-4255-b8b3-81f4f3956ca0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:42.009794 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b48ea-591f-4255-b8b3-81f4f3956ca0 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:42.015204 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-662a7a3e-c07b-4656-9180-63deb39177b4 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:42.016596 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-662a7a3e-c07b-4656-9180-63deb39177b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:42.114586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:42.122597 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 358/705] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:42.145100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 348/706] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:19:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:19:42.151443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a7a3e-c07b-4656-9180-63deb39177b4 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:42.157420 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b48ea-591f-4255-b8b3-81f4f3956ca0 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:42.280070 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:42.282942 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b48ea-591f-4255-b8b3-81f4f3956ca0 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:42.326490 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9ae10-3803-4459-81ab-6e74fc1932e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:42.327673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9ae10-3803-4459-81ab-6e74fc1932e6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:42.328247 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9ae10-3803-4459-81ab-6e74fc1932e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:42.328756 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9ae10-3803-4459-81ab-6e74fc1932e6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:42.329614 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9ae10-3803-4459-81ab-6e74fc1932e6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:42.331249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9ae10-3803-4459-81ab-6e74fc1932e6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:42.354551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a7a3e-c07b-4656-9180-63deb39177b4 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:42.358468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-07f9ae10-3803-4459-81ab-6e74fc1932e6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 12:19:42.358468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:42.358468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:19:42.358468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:19:42.358468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:19:42.358468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:19:42.358468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:19:42.358468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:19:42.358468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 12:19:42.358468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:42.358468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:19:42.358468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:42.358468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:42.358468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:42.358468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:42.358468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:42.359428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:42.359428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:42.359428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:42.359428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:42.359428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:42.359428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:42.359428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:42.359428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:19:42.359428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:19:42.359428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:19:42.359428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:19:42.359428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:42.359428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:42.359428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:42.359428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:42.359428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:42.360259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:42.360259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:42.360259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:42.360259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:42.360259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:42.360259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:42.360259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:42.360259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:42.360259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:42.360259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:42.360259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:42.360259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:19:42.360259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:19:42.360259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 12:19:42.360259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:42.364492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 349/707] 10.222.0.25 () {56 vars in 1129 bytes} [Mon May 23 12:19:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:42.371247 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9ae10-3803-4459-81ab-6e74fc1932e6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:42.411286 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ebe8d-3a4f-4107-91ec-73f8171b6b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:42.412583 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ebe8d-3a4f-4107-91ec-73f8171b6b26 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:42.412897 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ebe8d-3a4f-4107-91ec-73f8171b6b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:42.413183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ebe8d-3a4f-4107-91ec-73f8171b6b26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:42.424808 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:42.433132 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ebe8d-3a4f-4107-91ec-73f8171b6b26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:42.434635 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ebe8d-3a4f-4107-91ec-73f8171b6b26 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:42.464270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-856ebe8d-3a4f-4107-91ec-73f8171b6b26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:42.464270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:42.464270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:42.464270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:42.464270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:42.464270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:42.464270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:42.464270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:42.464270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:42.464270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:42.464270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:42.464270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:42.464270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:42.464270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:42.464270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:42.465242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:42.465242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:42.465242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:42.465242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:42.465242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:42.465242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:42.465242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:42.465242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:42.465242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:42.465242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:42.465242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:42.465242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:42.465242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:42.465242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:42.465242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:42.465242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:42.465242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:42.466140 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:42.466140 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:42.466140 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:42.466140 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:42.475285 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 359/708] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:42.480606 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ebe8d-3a4f-4107-91ec-73f8171b6b26 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:42.491283 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9ae10-3803-4459-81ab-6e74fc1932e6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:42.529640 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5625f0-6a61-47fa-ad7b-0ce17aa11bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:42.531398 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5625f0-6a61-47fa-ad7b-0ce17aa11bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:42.532370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5625f0-6a61-47fa-ad7b-0ce17aa11bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:42.533531 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5625f0-6a61-47fa-ad7b-0ce17aa11bb4 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:42.535131 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5625f0-6a61-47fa-ad7b-0ce17aa11bb4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:42.535816 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5625f0-6a61-47fa-ad7b-0ce17aa11bb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:42.539092 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5625f0-6a61-47fa-ad7b-0ce17aa11bb4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:42.548099 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 350/709] 10.222.0.25 () {56 vars in 1124 bytes} [Mon May 23 12:19:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:42.555299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5625f0-6a61-47fa-ad7b-0ce17aa11bb4 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:42.690394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5625f0-6a61-47fa-ad7b-0ce17aa11bb4 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:42.694492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:42.699250 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:42.700389 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ebe8d-3a4f-4107-91ec-73f8171b6b26 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:42.744337 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6cddd-0f10-49d7-a88e-d8ec007eef68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:42.745001 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6cddd-0f10-49d7-a88e-d8ec007eef68 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:42.745284 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6cddd-0f10-49d7-a88e-d8ec007eef68 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:42.745559 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6cddd-0f10-49d7-a88e-d8ec007eef68 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:42.745825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ba255-9767-4397-a7a3-221041b5278f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:42.746289 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6cddd-0f10-49d7-a88e-d8ec007eef68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:42.746568 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ba255-9767-4397-a7a3-221041b5278f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:42.746673 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6cddd-0f10-49d7-a88e-d8ec007eef68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:42.746843 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ba255-9767-4397-a7a3-221041b5278f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:42.747114 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ba255-9767-4397-a7a3-221041b5278f None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:42.747824 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ba255-9767-4397-a7a3-221041b5278f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:42.747959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6cddd-0f10-49d7-a88e-d8ec007eef68 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:42.748119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ba255-9767-4397-a7a3-221041b5278f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:42.749490 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ba255-9767-4397-a7a3-221041b5278f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:42.761045 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 360/710] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:42.764529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 351/711] 10.222.0.25 () {56 vars in 1124 bytes} [Mon May 23 12:19:42 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:42.777700 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6cddd-0f10-49d7-a88e-d8ec007eef68 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:42.899339 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6cddd-0f10-49d7-a88e-d8ec007eef68 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:42.936235 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9c56f-59b0-4972-a4f2-c5a39252338a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:42.937041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9c56f-59b0-4972-a4f2-c5a39252338a None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:42.937329 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9c56f-59b0-4972-a4f2-c5a39252338a None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:42.937607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9c56f-59b0-4972-a4f2-c5a39252338a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:42.945913 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9c56f-59b0-4972-a4f2-c5a39252338a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:42.947420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9c56f-59b0-4972-a4f2-c5a39252338a None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:42.963882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-a4d9c56f-59b0-4972-a4f2-c5a39252338a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:42.963882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:42.963882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:42.963882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:42.963882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:42.963882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:42.963882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:42.963882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:42.963882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:42.963882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:42.963882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:42.963882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:42.963882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:42.963882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:42.963882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:42.964830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:42.964830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:42.964830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:42.964830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:42.964830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:42.964830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:42.964830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:42.964830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:42.964830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:42.964830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:42.964830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:42.964830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:42.964830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:42.964830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:42.964830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:42.964830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:42.964830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:42.965718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:42.965718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:42.965718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:42.965718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:42.965718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:42.965718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:42.965718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:42.965718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:42.965718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 361/712] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:42.972699 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ba255-9767-4397-a7a3-221041b5278f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:43.252540 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ba255-9767-4397-a7a3-221041b5278f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:43.280787 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bff05d-167a-4f6b-96b9-ee63828dfa88 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:43.281296 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bff05d-167a-4f6b-96b9-ee63828dfa88 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:43.281373 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bff05d-167a-4f6b-96b9-ee63828dfa88 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:43.283211 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 362/713] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:43.287802 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949b1cf-a0da-401f-a44f-c3f24bbbaeac None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:43.288097 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949b1cf-a0da-401f-a44f-c3f24bbbaeac None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:43.288486 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949b1cf-a0da-401f-a44f-c3f24bbbaeac None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:43.289739 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 363/714] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:19:43.290813 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605acdc-b83f-47cd-9b3e-6f33606db5d6 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:43.291102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605acdc-b83f-47cd-9b3e-6f33606db5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:43.291381 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605acdc-b83f-47cd-9b3e-6f33606db5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:43.298380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e51bfe-4288-49f9-a263-369085c3ed64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:43.299082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e51bfe-4288-49f9-a263-369085c3ed64 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:43.299369 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e51bfe-4288-49f9-a263-369085c3ed64 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:43.299651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e51bfe-4288-49f9-a263-369085c3ed64 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:43.300439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e51bfe-4288-49f9-a263-369085c3ed64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:43.300749 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e51bfe-4288-49f9-a263-369085c3ed64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:43.302197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e51bfe-4288-49f9-a263-369085c3ed64 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:43.316704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 352/715] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:43.318949 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e19e6-e33a-4fa7-9343-1e1eb880b9d2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:43.319241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e19e6-e33a-4fa7-9343-1e1eb880b9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:43.319519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e19e6-e33a-4fa7-9343-1e1eb880b9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:43.323539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-e605acdc-b83f-47cd-9b3e-6f33606db5d6 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:43.326245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e605acdc-b83f-47cd-9b3e-6f33606db5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:43.337994 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f78e19e6-e33a-4fa7-9343-1e1eb880b9d2 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:43.339557 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f78e19e6-e33a-4fa7-9343-1e1eb880b9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:43.346900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:43.372469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:43.419189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 364/716] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:43.420480 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605acdc-b83f-47cd-9b3e-6f33606db5d6 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:43.444151 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 353/717] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:43.451952 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e19e6-e33a-4fa7-9343-1e1eb880b9d2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:43.537267 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605acdc-b83f-47cd-9b3e-6f33606db5d6 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:43.559243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e19e6-e33a-4fa7-9343-1e1eb880b9d2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:43.574075 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5448a1-e5bd-4115-a76b-72c3651cdab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:43.574767 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5448a1-e5bd-4115-a76b-72c3651cdab1 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:43.575054 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5448a1-e5bd-4115-a76b-72c3651cdab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:43.575335 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5448a1-e5bd-4115-a76b-72c3651cdab1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:43.576163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5448a1-e5bd-4115-a76b-72c3651cdab1 None admin] RBAC: Adding query filter params (role.id=3ae7c5e54e084ac4a1f94da93a667583, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=d49997b9108145b78eb4db1d8823bf4d) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:43.576478 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5448a1-e5bd-4115-a76b-72c3651cdab1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:43.577916 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5448a1-e5bd-4115-a76b-72c3651cdab1 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:43.584515 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 365/718] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:19:43 2022] GET /identity/v3/role_assignments?user.id=d49997b9108145b78eb4db1d8823bf4d&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=3ae7c5e54e084ac4a1f94da93a667583 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:43.584980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5448a1-e5bd-4115-a76b-72c3651cdab1 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:43.601030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3af81-5a5a-433c-a36f-05fa054c27b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:43.602317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3af81-5a5a-433c-a36f-05fa054c27b7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:43.602542 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:43.603034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3af81-5a5a-433c-a36f-05fa054c27b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:43.603539 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3af81-5a5a-433c-a36f-05fa054c27b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:43.616366 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3af81-5a5a-433c-a36f-05fa054c27b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:43.624842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-29b3af81-5a5a-433c-a36f-05fa054c27b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:43.624842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:43.624842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:43.624842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:43.624842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:43.624842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:43.624842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:43.624842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:43.624842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:43.624842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:43.624842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:43.624842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:43.624842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:43.624842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:43.624842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:43.624842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:43.625845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:43.625845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:43.625845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:43.625845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:43.625845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:43.625845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:43.625845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:43.625845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:43.625845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:43.625845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:43.625845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:43.625845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:43.625845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:43.625845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:43.625845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:43.625845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:43.626694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:43.626694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:43.626694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:43.626694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:43.626694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:43.626694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:43.626694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:43.626694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:43.626694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:43.626694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:43.626694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:43.626694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:43.634070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 354/719] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:19:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:43.635688 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3af81-5a5a-433c-a36f-05fa054c27b7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:43.660885 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:43.696354 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5448a1-e5bd-4115-a76b-72c3651cdab1 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:43.735168 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f827968-5183-4f4c-bb76-1880b04ef7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:43.735990 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f827968-5183-4f4c-bb76-1880b04ef7ab None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:43.736279 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f827968-5183-4f4c-bb76-1880b04ef7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:43.736561 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f827968-5183-4f4c-bb76-1880b04ef7ab None admin] PATH_INFO: `/v3/services/network` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:43.737366 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f827968-5183-4f4c-bb76-1880b04ef7ab None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:43.738847 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f827968-5183-4f4c-bb76-1880b04ef7ab None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:43.754392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-5f827968-5183-4f4c-bb76-1880b04ef7ab None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 12:19:43.754392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:43.754392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:19:43.754392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:19:43.754392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:19:43.754392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:19:43.754392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:19:43.754392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:19:43.754392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 12:19:43.754392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:43.754392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:19:43.754392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:43.754392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:43.754392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:43.754392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:43.754392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:43.754392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:43.755534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:43.755534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:43.755534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:43.755534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:43.755534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:43.755534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:43.755534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:19:43.755534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:19:43.755534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:19:43.755534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:19:43.755534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:43.755534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:43.755534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:43.755534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:43.755534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:43.755534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:43.757510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:43.757510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:43.757510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:43.757510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:43.757510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:43.757510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:43.757510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:43.757510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:43.757510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:43.757510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:43.757510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:19:43.757510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:19:43.757510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 12:19:43.757510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:43.757510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 366/720] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:43 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:43.762685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f827968-5183-4f4c-bb76-1880b04ef7ab None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:43.768600 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3af81-5a5a-433c-a36f-05fa054c27b7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:43.806751 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283826b-d990-4d4c-b45e-e49be250f509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:43.807389 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283826b-d990-4d4c-b45e-e49be250f509 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:43.807674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283826b-d990-4d4c-b45e-e49be250f509 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:43.808001 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283826b-d990-4d4c-b45e-e49be250f509 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:43.808824 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283826b-d990-4d4c-b45e-e49be250f509 None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:43.809136 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283826b-d990-4d4c-b45e-e49be250f509 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:43.810696 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283826b-d990-4d4c-b45e-e49be250f509 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:43.823808 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 355/721] 10.222.0.25 () {56 vars in 1103 bytes} [Mon May 23 12:19:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:43.826722 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283826b-d990-4d4c-b45e-e49be250f509 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:43.869154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:43.894179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f827968-5183-4f4c-bb76-1880b04ef7ab None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:43.932307 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58f8cf-08d7-4d29-b888-ce1cdd40e9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:43.932679 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58f8cf-08d7-4d29-b888-ce1cdd40e9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:43.932975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58f8cf-08d7-4d29-b888-ce1cdd40e9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:43.933260 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58f8cf-08d7-4d29-b888-ce1cdd40e9e2 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:43.933987 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58f8cf-08d7-4d29-b888-ce1cdd40e9e2 None admin] RBAC: Adding query filter params (name=network) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:43.934299 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58f8cf-08d7-4d29-b888-ce1cdd40e9e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:43.936018 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58f8cf-08d7-4d29-b888-ce1cdd40e9e2 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:43.941681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 367/722] 10.222.0.25 () {56 vars in 1112 bytes} [Mon May 23 12:19:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:43.942344 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:43.955700 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58f8cf-08d7-4d29-b888-ce1cdd40e9e2 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:43.964719 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283826b-d990-4d4c-b45e-e49be250f509 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:44.007077 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67580d4-12d3-49a7-b5d3-77b10c4b1cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:44.008316 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67580d4-12d3-49a7-b5d3-77b10c4b1cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:44.008722 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67580d4-12d3-49a7-b5d3-77b10c4b1cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:44.009022 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67580d4-12d3-49a7-b5d3-77b10c4b1cc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:44.022113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67580d4-12d3-49a7-b5d3-77b10c4b1cc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:44.024114 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67580d4-12d3-49a7-b5d3-77b10c4b1cc7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:44.045637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-a67580d4-12d3-49a7-b5d3-77b10c4b1cc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:44.045637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:44.045637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:44.045637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:44.045637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:44.045637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:44.045637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:44.045637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:44.045637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:44.045637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:44.045637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:44.045637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:44.045637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:44.045637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:44.045637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:44.046605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:44.046605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:44.046605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:44.046605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:44.046605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:44.046605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:44.046605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:44.046605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:44.046605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:44.046605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:44.046605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:44.046605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:44.046605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:44.046605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:44.046605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:44.046605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:44.046605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:44.047478 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:44.047478 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:44.047478 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:44.047478 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:44.054975 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 356/723] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:44.054975 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67580d4-12d3-49a7-b5d3-77b10c4b1cc7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:44.110220 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58f8cf-08d7-4d29-b888-ce1cdd40e9e2 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:44.185724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f025c-f8a6-4a85-a675-5a55af0463a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:44.185724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f025c-f8a6-4a85-a675-5a55af0463a2 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:44.185724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f025c-f8a6-4a85-a675-5a55af0463a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:44.185724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f025c-f8a6-4a85-a675-5a55af0463a2 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:44.186202 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f025c-f8a6-4a85-a675-5a55af0463a2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:44.186202 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f025c-f8a6-4a85-a675-5a55af0463a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:44.188268 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f025c-f8a6-4a85-a675-5a55af0463a2 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:44.207223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 368/724] 10.222.0.25 () {56 vars in 1112 bytes} [Mon May 23 12:19:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:44.234343 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67580d4-12d3-49a7-b5d3-77b10c4b1cc7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:44.273471 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba64035-6fda-4d88-807b-871582a72f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:44.274576 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba64035-6fda-4d88-807b-871582a72f6d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:44.275081 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba64035-6fda-4d88-807b-871582a72f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:44.275561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba64035-6fda-4d88-807b-871582a72f6d None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:44.276502 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba64035-6fda-4d88-807b-871582a72f6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:44.277011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba64035-6fda-4d88-807b-871582a72f6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:44.278634 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba64035-6fda-4d88-807b-871582a72f6d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:44.280422 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:44.297109 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 357/725] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:44.298494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f025c-f8a6-4a85-a675-5a55af0463a2 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:44.313158 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:44.325852 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129d05e-7a15-4adc-8134-0e3e8beced28 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:44.326204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129d05e-7a15-4adc-8134-0e3e8beced28 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:44.326424 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129d05e-7a15-4adc-8134-0e3e8beced28 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:44.328065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 358/726] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:44.340328 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f4b64-15b7-48bb-97ad-bd65efacfed6 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:44.340643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f4b64-15b7-48bb-97ad-bd65efacfed6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:44.340894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f4b64-15b7-48bb-97ad-bd65efacfed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:44.375784 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-788f4b64-15b7-48bb-97ad-bd65efacfed6 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:44.376940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-788f4b64-15b7-48bb-97ad-bd65efacfed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:44.439187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f025c-f8a6-4a85-a675-5a55af0463a2 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:44.479381 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b217d6d-96c8-4577-b9c7-6214686215ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:44.480206 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b217d6d-96c8-4577-b9c7-6214686215ae None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:44.480494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b217d6d-96c8-4577-b9c7-6214686215ae None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:44.480774 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b217d6d-96c8-4577-b9c7-6214686215ae None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:44.490936 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b217d6d-96c8-4577-b9c7-6214686215ae None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:44.492680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b217d6d-96c8-4577-b9c7-6214686215ae None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:44.511226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-6b217d6d-96c8-4577-b9c7-6214686215ae None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:19:44.511226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:44.511226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:44.511226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:44.511226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:44.511226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:44.511226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:44.511226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:44.511226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:44.511226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:44.511226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:44.511226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:44.511226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:44.511226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:44.511226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:44.511226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:44.512226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:44.512226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:44.512226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:44.512226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:44.512226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:44.512226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:44.512226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:44.512226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:44.512226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:44.512226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:44.512226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:44.512226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:44.512226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:44.512226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:44.512226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:44.512226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:44.512226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:44.512226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:44.513181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:44.513181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:44.513181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:44.513181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:44.513181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:44.513181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:44.513181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:44.513181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:44.513181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:19:44.513181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:44.513731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 359/727] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:44.517056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 369/728] 10.222.0.25 () {56 vars in 1117 bytes} [Mon May 23 12:19:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:44.518350 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f4b64-15b7-48bb-97ad-bd65efacfed6 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:44.542353 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b217d6d-96c8-4577-b9c7-6214686215ae None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:44.633372 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f4b64-15b7-48bb-97ad-bd65efacfed6 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:44.662296 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:44.671679 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325f26a-5ef1-43b7-946e-92356dc7697f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:44.672728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325f26a-5ef1-43b7-946e-92356dc7697f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:44.673027 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325f26a-5ef1-43b7-946e-92356dc7697f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:44.673315 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325f26a-5ef1-43b7-946e-92356dc7697f None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:44.674176 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325f26a-5ef1-43b7-946e-92356dc7697f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:44.674686 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325f26a-5ef1-43b7-946e-92356dc7697f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:44.676524 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325f26a-5ef1-43b7-946e-92356dc7697f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:44.701182 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 360/729] 10.222.0.25 () {56 vars in 1149 bytes} [Mon May 23 12:19:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:44.701816 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:44.703029 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325f26a-5ef1-43b7-946e-92356dc7697f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:44.811188 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325f26a-5ef1-43b7-946e-92356dc7697f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:44.845400 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b217d6d-96c8-4577-b9c7-6214686215ae None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:44.867687 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742128a-2037-45bf-abf6-80eb094a34ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:44.868348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742128a-2037-45bf-abf6-80eb094a34ac None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:44.868635 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742128a-2037-45bf-abf6-80eb094a34ac None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:44.868912 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742128a-2037-45bf-abf6-80eb094a34ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:44.917988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424e44f-bdaa-4c38-aff9-b65fedbef694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:44.918736 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424e44f-bdaa-4c38-aff9-b65fedbef694 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:44.919024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424e44f-bdaa-4c38-aff9-b65fedbef694 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:44.919307 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424e44f-bdaa-4c38-aff9-b65fedbef694 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:44.936603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424e44f-bdaa-4c38-aff9-b65fedbef694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:44.956424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-a424e44f-bdaa-4c38-aff9-b65fedbef694 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:19:44.956424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:44.956424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:44.956424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:44.956424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:44.956424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:44.956424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:44.956424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:44.956424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:44.956424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:44.956424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:44.956424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:44.956424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:44.956424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:44.956424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:44.956424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:44.957461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:44.957461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:44.957461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:44.957461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:44.957461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:44.957461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:44.957461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:44.957461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:44.957461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:44.957461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:44.957461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:44.957461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:44.957461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:44.957461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:44.957461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:44.957461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:44.958312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:44.958312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:44.958312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:44.958312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:44.958312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:44.958312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:44.958312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:44.958312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:44.958312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:44.958312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:44.958312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:19:44.958312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:44.958312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 370/730] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:19:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:44.967437 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424e44f-bdaa-4c38-aff9-b65fedbef694 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:44.968197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:44.975134 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742128a-2037-45bf-abf6-80eb094a34ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:44.977452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742128a-2037-45bf-abf6-80eb094a34ac None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:45.092496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 361/731] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:19:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:19:45.093742 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742128a-2037-45bf-abf6-80eb094a34ac None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:45.255500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424e44f-bdaa-4c38-aff9-b65fedbef694 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:45.266991 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:45.305773 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742128a-2037-45bf-abf6-80eb094a34ac None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:45.322880 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:45.335824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eefa9f-2551-4a9b-9cdf-f1dda4f09fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:45.336506 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eefa9f-2551-4a9b-9cdf-f1dda4f09fec None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:45.336793 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eefa9f-2551-4a9b-9cdf-f1dda4f09fec None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:45.337073 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eefa9f-2551-4a9b-9cdf-f1dda4f09fec None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:45.337826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eefa9f-2551-4a9b-9cdf-f1dda4f09fec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:45.338138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eefa9f-2551-4a9b-9cdf-f1dda4f09fec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:45.339540 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eefa9f-2551-4a9b-9cdf-f1dda4f09fec None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:45.364173 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 371/732] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:19:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:45.367338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eefa9f-2551-4a9b-9cdf-f1dda4f09fec None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:45.380324 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b2f9f-c470-4e36-81f8-fa54a9ea5f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:45.381164 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b2f9f-c470-4e36-81f8-fa54a9ea5f03 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:45.381450 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b2f9f-c470-4e36-81f8-fa54a9ea5f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:45.381732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b2f9f-c470-4e36-81f8-fa54a9ea5f03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:45.402139 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b2f9f-c470-4e36-81f8-fa54a9ea5f03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:45.403649 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b2f9f-c470-4e36-81f8-fa54a9ea5f03 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:45.437394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-cb4b2f9f-c470-4e36-81f8-fa54a9ea5f03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:45.437394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:45.437394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:45.437394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:45.437394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:45.437394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:45.437394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:45.437394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:45.437394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:45.437394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:45.437394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:45.437394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:45.437394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:45.437394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:45.437394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:45.438399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:45.438399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:45.438399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:45.438399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:45.438399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:45.438399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:45.438399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:45.438399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:45.438399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:45.438399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:45.438399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:45.438399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:45.438399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:45.438399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:45.438399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:45.438399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:45.438399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:45.440243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:45.440243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:45.440243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:45.440243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:45.443253 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 362/733] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:45.445202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7af81-3804-4a9a-810f-0010e2fde219 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:45.445495 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7af81-3804-4a9a-810f-0010e2fde219 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:45.445774 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7af81-3804-4a9a-810f-0010e2fde219 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:45.453247 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 363/734] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:45.453247 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7af81-3804-4a9a-810f-0010e2fde219 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:45.541316 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eefa9f-2551-4a9b-9cdf-f1dda4f09fec None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:45.558804 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7af81-3804-4a9a-810f-0010e2fde219 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:45.578914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192a4d0-9e2d-42f7-b457-6052e7d77c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:45.580118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a4d0-9e2d-42f7-b457-6052e7d77c3f None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:45.580632 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a4d0-9e2d-42f7-b457-6052e7d77c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:45.581202 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a4d0-9e2d-42f7-b457-6052e7d77c3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:45.593638 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192a4d0-9e2d-42f7-b457-6052e7d77c3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:45.594738 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e230c3-df35-42ab-a057-07b8f3353a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:45.595426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e230c3-df35-42ab-a057-07b8f3353a7e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:45.595718 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e230c3-df35-42ab-a057-07b8f3353a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:45.596003 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e230c3-df35-42ab-a057-07b8f3353a7e None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:45.596566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192a4d0-9e2d-42f7-b457-6052e7d77c3f None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:45.596826 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e230c3-df35-42ab-a057-07b8f3353a7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:45.597140 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e230c3-df35-42ab-a057-07b8f3353a7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:45.598864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e230c3-df35-42ab-a057-07b8f3353a7e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:45.601279 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:45.618560 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 364/735] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:45.620003 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffc6b6-aa0d-4d30-a0a7-1c3a0a58f208 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:45.620307 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffc6b6-aa0d-4d30-a0a7-1c3a0a58f208 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:45.620592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffc6b6-aa0d-4d30-a0a7-1c3a0a58f208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:45.621747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-9192a4d0-9e2d-42f7-b457-6052e7d77c3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:45.621747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:45.621747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:45.621747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:45.621747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:45.621747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:45.621747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:45.621747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:45.621747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:45.621747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:45.621747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:45.621747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:45.621747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:45.621747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:45.621747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:45.622633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:45.622633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:45.622633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:45.622633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:45.622633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:45.622633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:45.622633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:45.622633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:45.622633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:45.622633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:45.622633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:45.622633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:45.622633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:45.622633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:45.622633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:45.622633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:45.622633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:45.623527 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:45.623527 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:45.623527 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:45.623527 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:45.625855 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 372/736] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:45.630440 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192a4d0-9e2d-42f7-b457-6052e7d77c3f None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:45.644560 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-fdffc6b6-aa0d-4d30-a0a7-1c3a0a58f208 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:45.645769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fdffc6b6-aa0d-4d30-a0a7-1c3a0a58f208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:45.702993 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:45.722534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 365/737] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:45.722534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffc6b6-aa0d-4d30-a0a7-1c3a0a58f208 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:45.771353 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192a4d0-9e2d-42f7-b457-6052e7d77c3f None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:45.812691 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc080a79-f4fc-4fe4-886f-7f9111b440a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:45.813519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc080a79-f4fc-4fe4-886f-7f9111b440a5 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:45.813804 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc080a79-f4fc-4fe4-886f-7f9111b440a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:45.814082 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc080a79-f4fc-4fe4-886f-7f9111b440a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:45.822581 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc080a79-f4fc-4fe4-886f-7f9111b440a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:45.824065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc080a79-f4fc-4fe4-886f-7f9111b440a5 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:45.843249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-dc080a79-f4fc-4fe4-886f-7f9111b440a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:45.843249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:45.843249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:45.843249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:45.843249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:45.843249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:45.843249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:45.843249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:45.843249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:45.843249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:45.843249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:45.843249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:45.843249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:45.843249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:45.843249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:45.844223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:45.844223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:45.844223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:45.844223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:45.844223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:45.844223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:45.844223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:45.844223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:45.844223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:45.844223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:45.844223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:45.844223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:45.844223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:45.844223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:45.844223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:45.844223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:45.844223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:45.845805 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:45.845805 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:45.845805 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:45.845805 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:45.845805 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:45.845805 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:45.845805 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:45.845805 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:45.849948 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 373/738] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:45.851029 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc080a79-f4fc-4fe4-886f-7f9111b440a5 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:45.859625 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffc6b6-aa0d-4d30-a0a7-1c3a0a58f208 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:45.892132 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:45.907128 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b19239-38ad-45fc-a6c7-569ec31ea72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:45.908496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b19239-38ad-45fc-a6c7-569ec31ea72c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:45.909274 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b19239-38ad-45fc-a6c7-569ec31ea72c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:45.909762 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b19239-38ad-45fc-a6c7-569ec31ea72c None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:45.910891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b19239-38ad-45fc-a6c7-569ec31ea72c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:45.911721 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b19239-38ad-45fc-a6c7-569ec31ea72c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:45.913310 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b19239-38ad-45fc-a6c7-569ec31ea72c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:45.933746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 366/739] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:45.933746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b19239-38ad-45fc-a6c7-569ec31ea72c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:45.977336 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc080a79-f4fc-4fe4-886f-7f9111b440a5 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:45.986874 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:46.017253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721abb7d-6983-4236-8b06-628d645511a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:46.018439 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721abb7d-6983-4236-8b06-628d645511a5 None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:46.019011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721abb7d-6983-4236-8b06-628d645511a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:46.019494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721abb7d-6983-4236-8b06-628d645511a5 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:46.020529 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721abb7d-6983-4236-8b06-628d645511a5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:46.022419 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721abb7d-6983-4236-8b06-628d645511a5 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:46.049596 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 374/740] 10.222.0.25 () {60 vars in 1141 bytes} [Mon May 23 12:19:45 2022] POST /identity/v3/services => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:19:46.049596 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721abb7d-6983-4236-8b06-628d645511a5 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:46.053286 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b19239-38ad-45fc-a6c7-569ec31ea72c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:46.171295 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af220c6b-fdd0-43dc-813c-01193c31056c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:46.171972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af220c6b-fdd0-43dc-813c-01193c31056c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:46.172369 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af220c6b-fdd0-43dc-813c-01193c31056c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:46.172651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af220c6b-fdd0-43dc-813c-01193c31056c None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:46.173577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af220c6b-fdd0-43dc-813c-01193c31056c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:46.173899 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af220c6b-fdd0-43dc-813c-01193c31056c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:46.175558 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af220c6b-fdd0-43dc-813c-01193c31056c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:46.183927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721abb7d-6983-4236-8b06-628d645511a5 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:46.198734 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 367/741] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:46.200291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b244531-7c5e-4f7c-b34a-514a52ce7e64 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:46.200579 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b244531-7c5e-4f7c-b34a-514a52ce7e64 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:46.200958 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b244531-7c5e-4f7c-b34a-514a52ce7e64 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:46.202742 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 368/742] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:46.203505 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b244531-7c5e-4f7c-b34a-514a52ce7e64 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:46.225146 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc46ab0-642a-4a6f-879d-d6bd0912b95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:46.226018 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc46ab0-642a-4a6f-879d-d6bd0912b95b None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:46.226312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc46ab0-642a-4a6f-879d-d6bd0912b95b None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:46.226614 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc46ab0-642a-4a6f-879d-d6bd0912b95b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:46.235701 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc46ab0-642a-4a6f-879d-d6bd0912b95b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:46.237167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc46ab0-642a-4a6f-879d-d6bd0912b95b None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:46.253797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-ebc46ab0-642a-4a6f-879d-d6bd0912b95b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 12:19:46.253797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:46.253797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:46.253797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:46.253797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:46.253797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:46.253797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:46.253797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:46.253797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:46.253797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:46.253797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:46.253797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:46.253797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:46.253797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:46.253797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:46.253797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:46.255024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:46.255024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:46.255024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:46.255024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:46.255024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:46.255024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:46.255024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:46.255024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:46.255024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:46.255024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:46.255024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:46.255024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:46.255024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:46.255024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:46.255024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:46.255024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:46.255024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:46.255024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:46.256560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:46.256560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:46.256560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:46.256560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:46.256560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:46.256560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:46.256560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:46.256560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:46.256560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 12:19:46.256560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:46.256560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 375/743] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:19:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:46.257476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5de90d-9376-4754-8eaa-b087688de992 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:46.257701 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5de90d-9376-4754-8eaa-b087688de992 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:46.257989 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5de90d-9376-4754-8eaa-b087688de992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:46.261762 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:46.276800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-ef5de90d-9376-4754-8eaa-b087688de992 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:46.278025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ef5de90d-9376-4754-8eaa-b087688de992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:46.294565 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:46.339484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b244531-7c5e-4f7c-b34a-514a52ce7e64 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:46.364120 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 376/744] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:46.365211 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5de90d-9376-4754-8eaa-b087688de992 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:46.389270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be0aa8-1536-4f1b-bea2-c1d346a4889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:46.390740 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be0aa8-1536-4f1b-bea2-c1d346a4889e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:46.391339 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be0aa8-1536-4f1b-bea2-c1d346a4889e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:46.391916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be0aa8-1536-4f1b-bea2-c1d346a4889e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:46.392931 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be0aa8-1536-4f1b-bea2-c1d346a4889e None admin] RBAC: Adding query filter params (role.id=e344e91a09be4d10834ea5f942345beb, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=eb30fc9bc5a04139b2a364ff03f4ad60) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:46.393556 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be0aa8-1536-4f1b-bea2-c1d346a4889e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:46.396019 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be0aa8-1536-4f1b-bea2-c1d346a4889e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:46.405038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 369/745] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:19:46 2022] GET /identity/v3/role_assignments?user.id=eb30fc9bc5a04139b2a364ff03f4ad60&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=e344e91a09be4d10834ea5f942345beb => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:46.409643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be0aa8-1536-4f1b-bea2-c1d346a4889e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:46.491801 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5de90d-9376-4754-8eaa-b087688de992 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:46.534442 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80993e6f-7b36-4176-b861-c2ad6ee2e758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:46.535197 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80993e6f-7b36-4176-b861-c2ad6ee2e758 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:46.535488 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80993e6f-7b36-4176-b861-c2ad6ee2e758 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:46.535770 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80993e6f-7b36-4176-b861-c2ad6ee2e758 None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:46.536717 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80993e6f-7b36-4176-b861-c2ad6ee2e758 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:46.537034 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80993e6f-7b36-4176-b861-c2ad6ee2e758 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:46.538585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80993e6f-7b36-4176-b861-c2ad6ee2e758 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:46.562585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 377/746] 10.222.0.25 () {56 vars in 1135 bytes} [Mon May 23 12:19:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:46.569049 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80993e6f-7b36-4176-b861-c2ad6ee2e758 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:46.575269 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be0aa8-1536-4f1b-bea2-c1d346a4889e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:46.579716 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:46.586475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:46.671052 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa822a-f0a8-40fa-9eea-59d8f68486a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:46.671052 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa822a-f0a8-40fa-9eea-59d8f68486a5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:46.671052 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa822a-f0a8-40fa-9eea-59d8f68486a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:46.671052 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa822a-f0a8-40fa-9eea-59d8f68486a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:46.695653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa822a-f0a8-40fa-9eea-59d8f68486a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:46.707652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-74fa822a-f0a8-40fa-9eea-59d8f68486a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:19:46.707652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:46.707652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:46.707652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:46.707652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:46.707652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:46.707652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:46.707652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:46.707652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:46.707652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:46.707652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:46.707652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:46.707652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:46.707652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:46.707652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:46.707652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:46.709181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:46.709181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:46.709181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:46.709181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:46.709181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:46.709181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:46.709181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:46.709181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:46.709181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:46.709181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:46.709181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:46.709181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:46.709181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:46.709181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:46.709181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:46.709181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:46.710452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:46.710452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:46.710452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:46.710452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:46.710452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:46.710452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:46.710452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:46.710452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:46.710452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:46.710452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:46.710452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:19:46.710452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:46.710452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 370/747] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:19:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:46.716303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa822a-f0a8-40fa-9eea-59d8f68486a5 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:46.749558 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80993e6f-7b36-4176-b861-c2ad6ee2e758 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:46.815598 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a456cd-ff5e-4fc9-8169-be0613bfa694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:46.816321 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a456cd-ff5e-4fc9-8169-be0613bfa694 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:46.816608 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a456cd-ff5e-4fc9-8169-be0613bfa694 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:46.817500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a456cd-ff5e-4fc9-8169-be0613bfa694 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:46.876333 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa822a-f0a8-40fa-9eea-59d8f68486a5 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:46.908017 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a456cd-ff5e-4fc9-8169-be0613bfa694 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:46.909483 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a456cd-ff5e-4fc9-8169-be0613bfa694 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:46.912180 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b403b-0fb8-4907-8258-70dd02cb71ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:46.912850 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b403b-0fb8-4907-8258-70dd02cb71ff None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:46.913135 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b403b-0fb8-4907-8258-70dd02cb71ff None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:46.913411 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b403b-0fb8-4907-8258-70dd02cb71ff None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:46.914162 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b403b-0fb8-4907-8258-70dd02cb71ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:46.914467 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b403b-0fb8-4907-8258-70dd02cb71ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:46.915869 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b403b-0fb8-4907-8258-70dd02cb71ff None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:46.919881 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:46.924806 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 371/748] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:19:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:46.926341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741dd46-7099-47e0-9f3a-dded73aeb53e None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:46.926776 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741dd46-7099-47e0-9f3a-dded73aeb53e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:46.927099 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741dd46-7099-47e0-9f3a-dded73aeb53e None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:46.928680 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 372/749] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:46.930206 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741dd46-7099-47e0-9f3a-dded73aeb53e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:46.959242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:47.025075 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 378/750] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:19:46 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 12:19:47.026466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b3adb-00d6-4c92-8b60-9d9f9c3e6a6f None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:47.026775 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b3adb-00d6-4c92-8b60-9d9f9c3e6a6f None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:47.027053 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b3adb-00d6-4c92-8b60-9d9f9c3e6a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:47.045227 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-2d3b3adb-00d6-4c92-8b60-9d9f9c3e6a6f None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:47.046494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-2d3b3adb-00d6-4c92-8b60-9d9f9c3e6a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:47.051773 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741dd46-7099-47e0-9f3a-dded73aeb53e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:47.088393 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b982d9-8359-45c8-8937-2d155fbbab64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:47.089193 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b982d9-8359-45c8-8937-2d155fbbab64 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:47.089479 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b982d9-8359-45c8-8937-2d155fbbab64 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:47.089757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b982d9-8359-45c8-8937-2d155fbbab64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:47.102347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b982d9-8359-45c8-8937-2d155fbbab64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:47.104028 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b982d9-8359-45c8-8937-2d155fbbab64 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:47.118487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 379/751] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:47 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 12:19:47.127258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b3adb-00d6-4c92-8b60-9d9f9c3e6a6f None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:47.128725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-a7b982d9-8359-45c8-8937-2d155fbbab64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:47.128725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:47.128725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:47.128725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:47.128725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:47.128725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:47.128725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:47.128725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:47.128725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:47.128725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:47.128725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:47.128725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:47.128725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:47.128725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:47.128725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:47.131241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:47.131241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:47.131241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:47.131241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:47.131241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:47.131241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:47.131241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:47.131241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:47.131241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:47.131241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:47.131241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:47.131241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:47.131241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:47.131241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:47.131241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:47.131241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:47.131241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:47.132508 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:47.132508 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:47.132508 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:47.132508 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:47.132508 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 373/752] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:47.139509 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b982d9-8359-45c8-8937-2d155fbbab64 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:47.184187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:47.229528 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:47.254211 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b982d9-8359-45c8-8937-2d155fbbab64 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:47.255273 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b3adb-00d6-4c92-8b60-9d9f9c3e6a6f None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:47.291672 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79ff9a-b5bb-4e98-bb51-188d54d7b425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:47.292262 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79ff9a-b5bb-4e98-bb51-188d54d7b425 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:47.292552 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79ff9a-b5bb-4e98-bb51-188d54d7b425 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:47.292663 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43c019-2679-44ef-a8d2-3959d3006235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:47.292825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79ff9a-b5bb-4e98-bb51-188d54d7b425 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:47.293559 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79ff9a-b5bb-4e98-bb51-188d54d7b425 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:47.293869 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79ff9a-b5bb-4e98-bb51-188d54d7b425 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:47.294093 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43c019-2679-44ef-a8d2-3959d3006235 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:47.294572 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43c019-2679-44ef-a8d2-3959d3006235 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:47.294987 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43c019-2679-44ef-a8d2-3959d3006235 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:47.295275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79ff9a-b5bb-4e98-bb51-188d54d7b425 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:47.307022 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e43c019-2679-44ef-a8d2-3959d3006235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:47.308742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e43c019-2679-44ef-a8d2-3959d3006235 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:47.314215 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 374/753] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:47.315121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79ff9a-b5bb-4e98-bb51-188d54d7b425 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:47.328556 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-7e43c019-2679-44ef-a8d2-3959d3006235 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:47.328556 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:47.328556 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:47.328556 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:47.328556 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:47.328556 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:47.328556 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:47.328556 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:47.328556 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:47.328556 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:47.328556 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:47.328556 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:47.328556 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:47.328556 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:47.328556 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:47.329685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:47.329685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:47.329685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:47.329685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:47.329685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:47.329685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:47.329685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:47.329685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:47.329685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:47.329685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:47.329685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:47.329685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:47.329685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:47.329685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:47.329685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:47.329685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:47.329685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:47.330701 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:47.330701 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:47.330701 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:47.330701 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:47.332585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 380/754] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:47.334111 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43c019-2679-44ef-a8d2-3959d3006235 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:47.429763 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79ff9a-b5bb-4e98-bb51-188d54d7b425 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:47.437272 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:47.449258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43c019-2679-44ef-a8d2-3959d3006235 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:47.471305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc5d26-7a9b-45e3-9f18-587ad972f5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:47.471989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc5d26-7a9b-45e3-9f18-587ad972f5e4 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:47.472275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc5d26-7a9b-45e3-9f18-587ad972f5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:47.472553 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc5d26-7a9b-45e3-9f18-587ad972f5e4 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:47.473299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc5d26-7a9b-45e3-9f18-587ad972f5e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:47.475495 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc5d26-7a9b-45e3-9f18-587ad972f5e4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:47.487984 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:47.494549 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7e191-745f-466a-882d-51705d537032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:47.495582 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7e191-745f-466a-882d-51705d537032 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:47.496659 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7e191-745f-466a-882d-51705d537032 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:47.497210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7e191-745f-466a-882d-51705d537032 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:47.506589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 375/755] 10.222.0.25 () {60 vars in 1141 bytes} [Mon May 23 12:19:47 2022] POST /identity/v3/services => generated 240 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:19:47.507615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc5d26-7a9b-45e3-9f18-587ad972f5e4 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:47.524093 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7e191-745f-466a-882d-51705d537032 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:47.525589 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7e191-745f-466a-882d-51705d537032 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:47.560126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-34c7e191-745f-466a-882d-51705d537032 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 12:19:47.560126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:47.560126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:47.560126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:47.560126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:47.560126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:47.560126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:47.560126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:47.560126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:47.560126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:47.560126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:47.560126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:47.560126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:47.560126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:47.560126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:47.560126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:47.561076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:47.561076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:47.561076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:47.561076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:47.561076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:47.561076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:47.561076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:47.561076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:47.561076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:47.561076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:47.561076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:47.561076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:47.561076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:47.561076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:47.561076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:47.561076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:47.561076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:47.561076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:47.562117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:47.562117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:47.562117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:47.562117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:47.562117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:47.562117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:47.562117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:47.562117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:47.562117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 12:19:47.562117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:47.562117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 381/756] 10.222.0.25 () {56 vars in 1093 bytes} [Mon May 23 12:19:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:47.571940 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7e191-745f-466a-882d-51705d537032 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:47.719492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc5d26-7a9b-45e3-9f18-587ad972f5e4 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:47.753239 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7e191-745f-466a-882d-51705d537032 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:47.768715 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a85b81-13a4-4c89-99f6-05080b46d0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:47.769384 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a85b81-13a4-4c89-99f6-05080b46d0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:47.769669 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a85b81-13a4-4c89-99f6-05080b46d0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:47.769943 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a85b81-13a4-4c89-99f6-05080b46d0b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:47.770869 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a85b81-13a4-4c89-99f6-05080b46d0b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:47.771289 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a85b81-13a4-4c89-99f6-05080b46d0b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:47.772807 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a85b81-13a4-4c89-99f6-05080b46d0b2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:47.793330 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432108f8-acc4-446d-8a04-f85bf6fe0f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:47.793720 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 376/757] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:47.794627 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432108f8-acc4-446d-8a04-f85bf6fe0f34 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:47.795117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432108f8-acc4-446d-8a04-f85bf6fe0f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:47.795591 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432108f8-acc4-446d-8a04-f85bf6fe0f34 None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:47.796714 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432108f8-acc4-446d-8a04-f85bf6fe0f34 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:47.797228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432108f8-acc4-446d-8a04-f85bf6fe0f34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:47.798921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432108f8-acc4-446d-8a04-f85bf6fe0f34 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:47.799045 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a85b81-13a4-4c89-99f6-05080b46d0b2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:47.822870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 382/758] 10.222.0.25 () {56 vars in 1133 bytes} [Mon May 23 12:19:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:47.828545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432108f8-acc4-446d-8a04-f85bf6fe0f34 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:47.844467 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:47.876814 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:47.927389 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a85b81-13a4-4c89-99f6-05080b46d0b2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:47.960376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432108f8-acc4-446d-8a04-f85bf6fe0f34 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:47.967381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5469e2-dd13-4a13-94a8-336c6e8970d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:47.968230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5469e2-dd13-4a13-94a8-336c6e8970d5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:47.968560 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5469e2-dd13-4a13-94a8-336c6e8970d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:47.968843 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5469e2-dd13-4a13-94a8-336c6e8970d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:47.976211 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5469e2-dd13-4a13-94a8-336c6e8970d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:47.977767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5469e2-dd13-4a13-94a8-336c6e8970d5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:48.000642 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83eaefe-cb4f-48ff-8f60-5e81f90bded8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:48.001801 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83eaefe-cb4f-48ff-8f60-5e81f90bded8 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:48.002315 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83eaefe-cb4f-48ff-8f60-5e81f90bded8 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:48.002827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83eaefe-cb4f-48ff-8f60-5e81f90bded8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:48.008277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-4d5469e2-dd13-4a13-94a8-336c6e8970d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:48.008277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:48.008277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:48.008277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:48.008277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:48.008277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:48.008277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:48.008277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:48.008277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:48.008277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:48.008277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:48.008277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:48.008277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:48.008277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:48.008277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:48.009207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:48.009207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:48.009207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:48.009207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:48.009207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:48.009207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:48.009207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:48.009207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:48.009207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:48.009207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:48.009207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:48.009207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:48.009207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:48.009207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:48.009207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:48.009207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:48.009207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:48.011141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:48.011141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:48.011141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:48.011141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:48.011141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:48.011141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:48.011141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:48.011141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:48.011141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 377/759] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:48.015295 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5469e2-dd13-4a13-94a8-336c6e8970d5 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:48.022047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83eaefe-cb4f-48ff-8f60-5e81f90bded8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:48.023871 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83eaefe-cb4f-48ff-8f60-5e81f90bded8 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:48.044926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-d83eaefe-cb4f-48ff-8f60-5e81f90bded8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:48.044926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:48.044926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:48.044926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:48.044926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:48.044926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:48.044926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:48.044926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:48.044926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:48.044926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:48.044926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:48.044926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:48.044926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:48.044926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:48.044926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:48.045898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:48.045898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:48.045898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:48.045898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:48.045898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:48.045898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:48.045898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:48.045898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:48.045898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:48.045898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:48.045898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:48.045898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:48.045898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:48.045898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:48.045898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:48.045898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:48.045898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:48.046832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:48.046832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:48.046832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:48.046832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:48.054141 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 383/760] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:48.055897 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83eaefe-cb4f-48ff-8f60-5e81f90bded8 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:48.119682 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:48.179393 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83eaefe-cb4f-48ff-8f60-5e81f90bded8 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:48.205940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5469e2-dd13-4a13-94a8-336c6e8970d5 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:48.220919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57eb050-732b-43bf-aac1-4b2edb2da5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:48.222048 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eb050-732b-43bf-aac1-4b2edb2da5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:48.222603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eb050-732b-43bf-aac1-4b2edb2da5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:48.223135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eb050-732b-43bf-aac1-4b2edb2da5a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:48.224694 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57eb050-732b-43bf-aac1-4b2edb2da5a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:48.225248 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57eb050-732b-43bf-aac1-4b2edb2da5a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:48.226880 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57eb050-732b-43bf-aac1-4b2edb2da5a0 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:48.242880 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:48.244659 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 384/761] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:48.245982 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57eb050-732b-43bf-aac1-4b2edb2da5a0 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:48.285588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9ea0b-1ae3-45b9-9b2d-5857e06bf125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:48.286280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9ea0b-1ae3-45b9-9b2d-5857e06bf125 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:48.286650 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9ea0b-1ae3-45b9-9b2d-5857e06bf125 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:48.287577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9ea0b-1ae3-45b9-9b2d-5857e06bf125 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:48.288394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9ea0b-1ae3-45b9-9b2d-5857e06bf125 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:48.288764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9ea0b-1ae3-45b9-9b2d-5857e06bf125 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:48.290242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9ea0b-1ae3-45b9-9b2d-5857e06bf125 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:48.307745 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 378/762] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:48.317517 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9ea0b-1ae3-45b9-9b2d-5857e06bf125 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:48.431679 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57eb050-732b-43bf-aac1-4b2edb2da5a0 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:48.467232 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:48.482809 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244213ea-e38c-4808-a64c-6804ecf386b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:48.483621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244213ea-e38c-4808-a64c-6804ecf386b0 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:48.483911 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244213ea-e38c-4808-a64c-6804ecf386b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:48.484195 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244213ea-e38c-4808-a64c-6804ecf386b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:48.492412 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244213ea-e38c-4808-a64c-6804ecf386b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:48.493896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244213ea-e38c-4808-a64c-6804ecf386b0 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:48.511603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-244213ea-e38c-4808-a64c-6804ecf386b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:48.511603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:48.511603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:48.511603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:48.511603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:48.511603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:48.511603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:48.511603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:48.511603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:48.511603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:48.511603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:48.511603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:48.511603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:48.511603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:48.511603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:48.512553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:48.512553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:48.512553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:48.512553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:48.512553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:48.512553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:48.512553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:48.512553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:48.512553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:48.512553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:48.512553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:48.512553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:48.512553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:48.512553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:48.512553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:48.512553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:48.512553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:48.513443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:48.513443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:48.513443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:48.513443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:48.513443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:48.513443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:48.513443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:48.513443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:48.517686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 385/763] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:48.518975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244213ea-e38c-4808-a64c-6804ecf386b0 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:48.548562 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9ea0b-1ae3-45b9-9b2d-5857e06bf125 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:48.639447 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244213ea-e38c-4808-a64c-6804ecf386b0 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:48.684773 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29902b1-1803-46bd-8e09-c81de2b0fe03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:48.685387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29902b1-1803-46bd-8e09-c81de2b0fe03 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:48.685678 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29902b1-1803-46bd-8e09-c81de2b0fe03 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:48.685960 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29902b1-1803-46bd-8e09-c81de2b0fe03 None admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:48.687032 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29902b1-1803-46bd-8e09-c81de2b0fe03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:48.687363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29902b1-1803-46bd-8e09-c81de2b0fe03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:48.688873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29902b1-1803-46bd-8e09-c81de2b0fe03 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:48.706632 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 386/764] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:48.709665 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29902b1-1803-46bd-8e09-c81de2b0fe03 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:48.715942 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c03495-2309-4399-8068-829e9f89f948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:48.716709 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c03495-2309-4399-8068-829e9f89f948 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:48.717075 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c03495-2309-4399-8068-829e9f89f948 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:48.717358 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c03495-2309-4399-8068-829e9f89f948 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:48.718231 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c03495-2309-4399-8068-829e9f89f948 None admin] RBAC: Adding query filter params (role.id=3ae7c5e54e084ac4a1f94da93a667583, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=03ca1edc22174d258ddeda25407ee6ed) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:48.718567 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c03495-2309-4399-8068-829e9f89f948 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:48.720053 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c03495-2309-4399-8068-829e9f89f948 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:48.744651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 379/765] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:19:48 2022] GET /identity/v3/role_assignments?user.id=03ca1edc22174d258ddeda25407ee6ed&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=3ae7c5e54e084ac4a1f94da93a667583 => generated 259 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:48.766913 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:48.887491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f157a-23ad-42c1-9b34-4125764b636a None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:48.887491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f157a-23ad-42c1-9b34-4125764b636a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:48.887491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f157a-23ad-42c1-9b34-4125764b636a None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:48.887491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 380/766] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:19:48.894163 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e006f2d-a470-408c-af33-fd645fbcf727 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:48.894479 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e006f2d-a470-408c-af33-fd645fbcf727 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:48.894741 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e006f2d-a470-408c-af33-fd645fbcf727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:48.932616 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7e006f2d-a470-408c-af33-fd645fbcf727 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:48.934344 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7e006f2d-a470-408c-af33-fd645fbcf727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:48.971631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29902b1-1803-46bd-8e09-c81de2b0fe03 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:49.015054 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:49.017932 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 381/767] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:19:49.018841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad843d6-ef29-4df8-b60e-e0baa84bec31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:49.019428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac6da5-b328-49b9-a488-c1048b4e8f93 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:49.019721 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac6da5-b328-49b9-a488-c1048b4e8f93 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:49.019834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad843d6-ef29-4df8-b60e-e0baa84bec31 None admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:49.020003 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac6da5-b328-49b9-a488-c1048b4e8f93 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:49.020096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad843d6-ef29-4df8-b60e-e0baa84bec31 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:49.020281 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad843d6-ef29-4df8-b60e-e0baa84bec31 None admin] PATH_INFO: `/v3/projects/402397b981be4f0c9e778a2771c41937/users/d49997b9108145b78eb4db1d8823bf4d/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:49.022166 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 382/768] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:49.023044 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad843d6-ef29-4df8-b60e-e0baa84bec31 None admin] RBAC: Authorizing `identity:create_grant(project_id=402397b981be4f0c9e778a2771c41937, user_id=d49997b9108145b78eb4db1d8823bf4d, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:49.024493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad843d6-ef29-4df8-b60e-e0baa84bec31 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:49.035736 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc730db2-6d48-45b7-ab7b-6ce7c8f0f615 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:49.036072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc730db2-6d48-45b7-ab7b-6ce7c8f0f615 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:49.036315 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc730db2-6d48-45b7-ab7b-6ce7c8f0f615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:49.046607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 387/769] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:19:48 2022] PUT /identity/v3/projects/402397b981be4f0c9e778a2771c41937/users/d49997b9108145b78eb4db1d8823bf4d/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:19:49.047927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad843d6-ef29-4df8-b60e-e0baa84bec31 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:49.074542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-dc730db2-6d48-45b7-ab7b-6ce7c8f0f615 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:49.078463 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-dc730db2-6d48-45b7-ab7b-6ce7c8f0f615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:49.214296 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 383/770] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:19:49.237952 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc730db2-6d48-45b7-ab7b-6ce7c8f0f615 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:49.254302 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:49.264835 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad843d6-ef29-4df8-b60e-e0baa84bec31 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:49.302312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0126f81-46eb-4b72-9a4a-51426de3b370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:49.303270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0126f81-46eb-4b72-9a4a-51426de3b370 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:49.303559 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0126f81-46eb-4b72-9a4a-51426de3b370 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:49.303836 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0126f81-46eb-4b72-9a4a-51426de3b370 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:49.314894 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0126f81-46eb-4b72-9a4a-51426de3b370 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:49.323121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-d0126f81-46eb-4b72-9a4a-51426de3b370 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:49.323121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:49.323121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:49.323121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:49.323121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:49.323121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:49.323121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:49.323121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:49.323121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:49.323121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:49.323121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:49.323121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:49.323121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:49.323121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:49.323121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:49.323121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:49.324217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:49.324217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:49.324217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:49.324217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:49.324217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:49.324217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:49.324217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:49.324217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:49.324217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:49.324217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:49.324217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:49.324217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:49.324217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:49.324217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:49.324217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:49.324217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:49.325221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:49.325221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:49.325221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:49.325221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:49.325221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:49.325221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:49.325221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:49.325221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:49.325221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:49.325221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:49.325221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:49.325221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:49.325221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 388/771] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:19:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:49.332849 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0126f81-46eb-4b72-9a4a-51426de3b370 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:49.382916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:49.387067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc730db2-6d48-45b7-ab7b-6ce7c8f0f615 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:49.428770 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65b144-c967-4a09-afba-0dba028a2266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:49.429954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65b144-c967-4a09-afba-0dba028a2266 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:49.430558 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65b144-c967-4a09-afba-0dba028a2266 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:49.430978 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65b144-c967-4a09-afba-0dba028a2266 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:49.431803 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65b144-c967-4a09-afba-0dba028a2266 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:49.433653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65b144-c967-4a09-afba-0dba028a2266 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:49.455638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-5f65b144-c967-4a09-afba-0dba028a2266 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 12:19:49.455638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:49.455638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:19:49.455638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:19:49.455638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:19:49.455638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:19:49.455638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:19:49.455638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:19:49.455638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 12:19:49.455638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:49.455638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:19:49.455638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:49.455638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:49.455638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:49.455638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:49.455638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:49.456820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:49.456820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:49.456820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:49.456820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:49.456820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:49.456820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:49.456820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:49.456820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:19:49.456820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:19:49.456820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:19:49.456820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:19:49.456820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:49.456820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:49.456820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:49.456820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:49.456820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:49.457810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:49.457810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:49.457810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:49.457810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:49.457810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:49.457810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:49.457810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:49.457810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:49.457810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:49.457810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:49.457810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:49.457810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:19:49.457810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:19:49.457810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 12:19:49.457810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:49.464147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 384/772] 10.222.0.25 () {56 vars in 1129 bytes} [Mon May 23 12:19:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:49.475537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65b144-c967-4a09-afba-0dba028a2266 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:49.509666 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0126f81-46eb-4b72-9a4a-51426de3b370 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:49.550099 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289c548-98dc-4e12-a4fd-c8878569fa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:49.550970 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289c548-98dc-4e12-a4fd-c8878569fa05 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:49.552580 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289c548-98dc-4e12-a4fd-c8878569fa05 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:49.553145 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289c548-98dc-4e12-a4fd-c8878569fa05 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:49.555263 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289c548-98dc-4e12-a4fd-c8878569fa05 None admin] RBAC: Adding query filter params (name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:49.556448 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289c548-98dc-4e12-a4fd-c8878569fa05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:49.558617 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289c548-98dc-4e12-a4fd-c8878569fa05 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:49.578661 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 389/773] 10.222.0.25 () {56 vars in 1103 bytes} [Mon May 23 12:19:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:49.584874 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289c548-98dc-4e12-a4fd-c8878569fa05 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:49.643874 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:49.700595 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65b144-c967-4a09-afba-0dba028a2266 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:49.765010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289c548-98dc-4e12-a4fd-c8878569fa05 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:49.766041 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cd91d-b752-407e-846f-f0bc0f0d3321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:49.767313 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cd91d-b752-407e-846f-f0bc0f0d3321 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:49.767822 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cd91d-b752-407e-846f-f0bc0f0d3321 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:49.768318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cd91d-b752-407e-846f-f0bc0f0d3321 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:49.769251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cd91d-b752-407e-846f-f0bc0f0d3321 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:49.769814 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cd91d-b752-407e-846f-f0bc0f0d3321 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:49.772041 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cd91d-b752-407e-846f-f0bc0f0d3321 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:49.782987 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 385/774] 10.222.0.25 () {56 vars in 1124 bytes} [Mon May 23 12:19:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:49.789917 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cd91d-b752-407e-846f-f0bc0f0d3321 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:49.812031 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aae854-9349-4873-99a2-aeb9a220fd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:49.812843 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aae854-9349-4873-99a2-aeb9a220fd36 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:49.813130 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aae854-9349-4873-99a2-aeb9a220fd36 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:49.813404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aae854-9349-4873-99a2-aeb9a220fd36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:49.829975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aae854-9349-4873-99a2-aeb9a220fd36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:49.831504 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aae854-9349-4873-99a2-aeb9a220fd36 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:49.850956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-a1aae854-9349-4873-99a2-aeb9a220fd36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:49.850956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:49.850956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:49.850956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:49.850956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:49.850956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:49.850956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:49.850956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:49.850956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:49.850956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:49.850956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:49.850956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:49.850956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:49.850956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:49.850956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:49.851964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:49.851964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:49.851964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:49.851964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:49.851964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:49.851964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:49.851964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:49.851964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:49.851964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:49.851964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:49.851964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:49.851964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:49.851964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:49.851964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:49.851964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:49.851964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:49.851964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:49.852850 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:49.852850 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:49.852850 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:49.852850 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:49.852850 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 390/775] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:49.860078 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aae854-9349-4873-99a2-aeb9a220fd36 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:49.883943 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:49.998988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:50.016311 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aae854-9349-4873-99a2-aeb9a220fd36 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:50.072274 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cd91d-b752-407e-846f-f0bc0f0d3321 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:50.085148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea304c9-9e7b-4a0d-bc64-a55ad2d30649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:50.085944 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea304c9-9e7b-4a0d-bc64-a55ad2d30649 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:50.086309 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea304c9-9e7b-4a0d-bc64-a55ad2d30649 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:50.086750 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea304c9-9e7b-4a0d-bc64-a55ad2d30649 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:50.087619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea304c9-9e7b-4a0d-bc64-a55ad2d30649 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:50.087940 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea304c9-9e7b-4a0d-bc64-a55ad2d30649 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:50.089411 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea304c9-9e7b-4a0d-bc64-a55ad2d30649 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:50.104983 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 391/776] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:50.111973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea304c9-9e7b-4a0d-bc64-a55ad2d30649 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:50.153699 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b0711-3570-45a9-934c-a51fdc37db65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:50.154374 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b0711-3570-45a9-934c-a51fdc37db65 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:50.154694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b0711-3570-45a9-934c-a51fdc37db65 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:50.154969 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b0711-3570-45a9-934c-a51fdc37db65 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:50.155684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b0711-3570-45a9-934c-a51fdc37db65 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:50.155987 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b0711-3570-45a9-934c-a51fdc37db65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:50.157388 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b0711-3570-45a9-934c-a51fdc37db65 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:50.171995 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 386/777] 10.222.0.25 () {56 vars in 1124 bytes} [Mon May 23 12:19:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:50.178153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b0711-3570-45a9-934c-a51fdc37db65 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:50.298484 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea304c9-9e7b-4a0d-bc64-a55ad2d30649 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:50.342203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62278874-b201-4e4a-aa0d-755caf52cfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:50.343416 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62278874-b201-4e4a-aa0d-755caf52cfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:50.343931 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62278874-b201-4e4a-aa0d-755caf52cfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:50.344435 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62278874-b201-4e4a-aa0d-755caf52cfc2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:50.347032 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:50.355641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62278874-b201-4e4a-aa0d-755caf52cfc2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:50.357705 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62278874-b201-4e4a-aa0d-755caf52cfc2 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:50.361541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:50.373619 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b0711-3570-45a9-934c-a51fdc37db65 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:50.377192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-62278874-b201-4e4a-aa0d-755caf52cfc2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:19:50.377192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:50.377192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:50.377192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:50.377192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:50.377192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:50.377192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:50.377192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:50.377192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:50.377192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:50.377192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:50.377192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:50.377192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:50.377192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:50.377192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:50.377192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:50.378148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:50.378148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:50.378148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:50.378148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:50.378148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:50.378148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:50.378148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:50.378148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:50.378148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:50.378148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:50.378148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:50.378148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:50.378148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:50.378148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:50.378148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:50.378148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:50.378148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:50.378148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:50.379696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:50.379696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:50.379696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:50.379696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:50.379696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:50.379696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:50.379696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:50.379696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:50.379696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:19:50.379696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:50.379696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 392/778] 10.222.0.25 () {56 vars in 1117 bytes} [Mon May 23 12:19:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:50.380392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabd29f-4c15-4cfe-9b35-602afbccce0f None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:50.380745 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabd29f-4c15-4cfe-9b35-602afbccce0f None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:50.380841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabd29f-4c15-4cfe-9b35-602afbccce0f None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:50.386236 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 393/779] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:50.386236 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabd29f-4c15-4cfe-9b35-602afbccce0f None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:50.420140 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ef97c-cf72-4a8c-b1f7-e2af8c5e7239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:50.420811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ef97c-cf72-4a8c-b1f7-e2af8c5e7239 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:50.421097 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ef97c-cf72-4a8c-b1f7-e2af8c5e7239 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:50.421380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ef97c-cf72-4a8c-b1f7-e2af8c5e7239 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:50.422181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ef97c-cf72-4a8c-b1f7-e2af8c5e7239 None admin] RBAC: Adding query filter params (interface=public, service_id=3aad966fe0b543ef8c34e0a7aace26be, region_id=RegionOne) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:50.422525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ef97c-cf72-4a8c-b1f7-e2af8c5e7239 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:50.424051 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ef97c-cf72-4a8c-b1f7-e2af8c5e7239 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:50.432431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 387/780] 10.222.0.25 () {56 vars in 1251 bytes} [Mon May 23 12:19:50 2022] GET /identity/v3/endpoints?service_id=3aad966fe0b543ef8c34e0a7aace26be&interface=public®ion_id=RegionOne => generated 194 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:50.433846 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2865442-f7ef-491f-a49e-aba47558e679 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:50.434139 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2865442-f7ef-491f-a49e-aba47558e679 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:50.434423 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2865442-f7ef-491f-a49e-aba47558e679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:50.451885 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a2865442-f7ef-491f-a49e-aba47558e679 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:50.453132 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a2865442-f7ef-491f-a49e-aba47558e679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:50.504848 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabd29f-4c15-4cfe-9b35-602afbccce0f None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:50.526532 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 388/781] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:19:50.527424 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2865442-f7ef-491f-a49e-aba47558e679 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:50.550647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb7e7c-a3ce-4d34-8a87-e003ee202957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:50.550647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb7e7c-a3ce-4d34-8a87-e003ee202957 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:50.550647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb7e7c-a3ce-4d34-8a87-e003ee202957 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:50.550647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb7e7c-a3ce-4d34-8a87-e003ee202957 None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:50.551392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb7e7c-a3ce-4d34-8a87-e003ee202957 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:50.551392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb7e7c-a3ce-4d34-8a87-e003ee202957 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:50.551392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb7e7c-a3ce-4d34-8a87-e003ee202957 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:50.566469 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 394/782] 10.222.0.25 () {56 vars in 1149 bytes} [Mon May 23 12:19:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:50.567372 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb7e7c-a3ce-4d34-8a87-e003ee202957 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:50.622946 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:50.624493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:50.637430 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2865442-f7ef-491f-a49e-aba47558e679 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:50.677403 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c3b97-7f20-43f1-9a09-93d6d767f212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:50.678164 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c3b97-7f20-43f1-9a09-93d6d767f212 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:50.678459 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c3b97-7f20-43f1-9a09-93d6d767f212 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:50.678799 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c3b97-7f20-43f1-9a09-93d6d767f212 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:50.679739 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb7e7c-a3ce-4d34-8a87-e003ee202957 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:50.679949 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c3b97-7f20-43f1-9a09-93d6d767f212 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:50.681370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c3b97-7f20-43f1-9a09-93d6d767f212 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:50.694529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 389/783] 10.222.0.25 () {56 vars in 1087 bytes} [Mon May 23 12:19:50 2022] GET /identity/v3/services => generated 772 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:50.694529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c3b97-7f20-43f1-9a09-93d6d767f212 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:50.755825 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aaeeba-60bf-4e19-ac3f-489b9409f00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:50.756902 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aaeeba-60bf-4e19-ac3f-489b9409f00a None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:50.757447 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aaeeba-60bf-4e19-ac3f-489b9409f00a None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:50.757874 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aaeeba-60bf-4e19-ac3f-489b9409f00a None admin] PATH_INFO: `/v3/services/network` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:50.758741 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aaeeba-60bf-4e19-ac3f-489b9409f00a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:50.760283 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aaeeba-60bf-4e19-ac3f-489b9409f00a None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:50.785324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-26aaeeba-60bf-4e19-ac3f-489b9409f00a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 12:19:50.785324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:50.785324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:19:50.785324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:19:50.785324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:19:50.785324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:19:50.785324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:19:50.785324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:19:50.785324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 12:19:50.785324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:50.785324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:19:50.785324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:50.785324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:50.785324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:50.785324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:50.785324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:50.785324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:50.794912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:50.794912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:50.794912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:50.794912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:50.794912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:50.794912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:50.794912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:19:50.794912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:19:50.794912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:19:50.794912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:19:50.794912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:50.794912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:50.794912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:50.794912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:50.794912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:50.794912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:50.795927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:50.795927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:50.795927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:50.795927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:50.795927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:50.795927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:50.795927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:50.795927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:50.795927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:50.795927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:50.795927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:19:50.795927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:19:50.795927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 12:19:50.795927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:50.798412 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 395/784] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:50 2022] GET /identity/v3/services/network => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:50.804524 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aaeeba-60bf-4e19-ac3f-489b9409f00a None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:50.809362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c3b97-7f20-43f1-9a09-93d6d767f212 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:50.854531 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a2642-2c7d-4a07-b83f-630111ffb820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:50.854531 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a2642-2c7d-4a07-b83f-630111ffb820 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:50.854531 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a2642-2c7d-4a07-b83f-630111ffb820 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:50.854531 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a2642-2c7d-4a07-b83f-630111ffb820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:50.866343 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a2642-2c7d-4a07-b83f-630111ffb820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:50.868172 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a2642-2c7d-4a07-b83f-630111ffb820 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:50.886911 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:50.898034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-3e4a2642-2c7d-4a07-b83f-630111ffb820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:50.898034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:50.898034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:50.898034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:50.898034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:50.898034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:50.898034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:50.898034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:50.898034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:50.898034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:50.898034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:50.898034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:50.898034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:50.898034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:50.898034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:50.899020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:50.899020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:50.899020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:50.899020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:50.899020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:50.899020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:50.899020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:50.899020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:50.899020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:50.899020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:50.899020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:50.899020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:50.899020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:50.899020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:50.899020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:50.899020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:50.899020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:50.899906 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:50.899906 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:50.899906 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:50.899906 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:50.916586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 390/785] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:50.921933 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a2642-2c7d-4a07-b83f-630111ffb820 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:51.014160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aaeeba-60bf-4e19-ac3f-489b9409f00a None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:51.034900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:51.055446 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a2642-2c7d-4a07-b83f-630111ffb820 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:51.064672 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c794b-f04b-4d1b-916f-d98dc025a8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:51.065359 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c794b-f04b-4d1b-916f-d98dc025a8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:51.065758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c794b-f04b-4d1b-916f-d98dc025a8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:51.066043 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c794b-f04b-4d1b-916f-d98dc025a8f5 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:51.066793 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c794b-f04b-4d1b-916f-d98dc025a8f5 None admin] RBAC: Adding query filter params (name=network) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:51.067108 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c794b-f04b-4d1b-916f-d98dc025a8f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:51.068702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c794b-f04b-4d1b-916f-d98dc025a8f5 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:51.074776 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 396/786] 10.222.0.25 () {56 vars in 1112 bytes} [Mon May 23 12:19:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:51.079882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c794b-f04b-4d1b-916f-d98dc025a8f5 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:51.102283 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4acc6-f19a-431d-9d94-358c7e1634e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:51.102995 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4acc6-f19a-431d-9d94-358c7e1634e0 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:51.103286 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4acc6-f19a-431d-9d94-358c7e1634e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:51.104008 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4acc6-f19a-431d-9d94-358c7e1634e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:51.105040 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4acc6-f19a-431d-9d94-358c7e1634e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:51.105357 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4acc6-f19a-431d-9d94-358c7e1634e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:51.109216 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4acc6-f19a-431d-9d94-358c7e1634e0 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:51.127757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 391/787] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:51.134114 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4acc6-f19a-431d-9d94-358c7e1634e0 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:51.269574 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:51.283248 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c794b-f04b-4d1b-916f-d98dc025a8f5 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:51.375453 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4acc6-f19a-431d-9d94-358c7e1634e0 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:51.383581 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57967ebe-5723-4725-9cb4-e81a84ce6ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:51.384737 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57967ebe-5723-4725-9cb4-e81a84ce6ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:51.385237 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57967ebe-5723-4725-9cb4-e81a84ce6ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:51.385732 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57967ebe-5723-4725-9cb4-e81a84ce6ea9 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:51.390559 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57967ebe-5723-4725-9cb4-e81a84ce6ea9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:51.391168 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57967ebe-5723-4725-9cb4-e81a84ce6ea9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:51.392739 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57967ebe-5723-4725-9cb4-e81a84ce6ea9 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:51.405835 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 397/788] 10.222.0.25 () {56 vars in 1112 bytes} [Mon May 23 12:19:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:51.410551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57967ebe-5723-4725-9cb4-e81a84ce6ea9 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:51.439755 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8facd64-6582-44fe-912c-ba5f5dfe804f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:51.440878 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8facd64-6582-44fe-912c-ba5f5dfe804f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:51.441274 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8facd64-6582-44fe-912c-ba5f5dfe804f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:51.441673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8facd64-6582-44fe-912c-ba5f5dfe804f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:51.450954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8facd64-6582-44fe-912c-ba5f5dfe804f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:51.452730 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8facd64-6582-44fe-912c-ba5f5dfe804f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:51.466735 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:51.469121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-f8facd64-6582-44fe-912c-ba5f5dfe804f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:51.469121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:51.469121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:51.469121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:51.469121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:51.469121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:51.469121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:51.469121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:51.469121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:51.469121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:51.469121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:51.469121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:51.469121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:51.469121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:51.469121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:51.469982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:51.469982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:51.469982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:51.469982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:51.469982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:51.469982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:51.469982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:51.469982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:51.469982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:51.469982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:51.469982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:51.469982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:51.469982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:51.469982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:51.469982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:51.469982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:51.469982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:51.471112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:51.471112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:51.471112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:51.471112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:51.471112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:51.471112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:51.471112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:51.471112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:51.471112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 392/789] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:51.472823 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ce9f9-7ca8-457f-8b65-616f9bf0a4de None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:51.472823 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ce9f9-7ca8-457f-8b65-616f9bf0a4de None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:51.472949 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ce9f9-7ca8-457f-8b65-616f9bf0a4de None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:51.478640 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 393/790] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:51.479545 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ce9f9-7ca8-457f-8b65-616f9bf0a4de None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:51.542704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57967ebe-5723-4725-9cb4-e81a84ce6ea9 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:51.590042 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2078b92-7035-4e1b-85c8-b9aa8e492fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:51.591540 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2078b92-7035-4e1b-85c8-b9aa8e492fbf None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:51.592279 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2078b92-7035-4e1b-85c8-b9aa8e492fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:51.593313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2078b92-7035-4e1b-85c8-b9aa8e492fbf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:51.594634 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2078b92-7035-4e1b-85c8-b9aa8e492fbf None admin] RBAC: Adding query filter params (interface=public, service_id=ffd0a725637e4983b912e9588d71c754, region_id=RegionOne) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:51.595426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2078b92-7035-4e1b-85c8-b9aa8e492fbf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:51.597805 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2078b92-7035-4e1b-85c8-b9aa8e492fbf None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:51.604539 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ce9f9-7ca8-457f-8b65-616f9bf0a4de None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:51.610775 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 398/791] 10.222.0.25 () {56 vars in 1251 bytes} [Mon May 23 12:19:51 2022] GET /identity/v3/endpoints?service_id=ffd0a725637e4983b912e9588d71c754&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:51.612490 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e48ba1-25f2-4904-b3e7-b08e561259d4 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:51.612978 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e48ba1-25f2-4904-b3e7-b08e561259d4 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:51.613452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e48ba1-25f2-4904-b3e7-b08e561259d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:51.635113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:51.636005 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-90e48ba1-25f2-4904-b3e7-b08e561259d4 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:51.637233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-90e48ba1-25f2-4904-b3e7-b08e561259d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:51.656962 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c73248-701a-413f-adab-744b2695a496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:51.658371 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c73248-701a-413f-adab-744b2695a496 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:51.659126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c73248-701a-413f-adab-744b2695a496 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:51.659595 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c73248-701a-413f-adab-744b2695a496 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:51.660803 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c73248-701a-413f-adab-744b2695a496 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:51.661658 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c73248-701a-413f-adab-744b2695a496 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:51.663402 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c73248-701a-413f-adab-744b2695a496 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:51.680565 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 394/792] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:51.681793 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c73248-701a-413f-adab-744b2695a496 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:51.725101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 399/793] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:19:51.725940 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e48ba1-25f2-4904-b3e7-b08e561259d4 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:51.775934 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:51.806018 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c73248-701a-413f-adab-744b2695a496 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:51.844870 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5e965-7e3d-42f5-8a49-151806a5b629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:51.845554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5e965-7e3d-42f5-8a49-151806a5b629 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:51.845826 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5e965-7e3d-42f5-8a49-151806a5b629 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:51.846093 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5e965-7e3d-42f5-8a49-151806a5b629 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:51.846823 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5e965-7e3d-42f5-8a49-151806a5b629 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:51.848305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5e965-7e3d-42f5-8a49-151806a5b629 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:51.851788 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e48ba1-25f2-4904-b3e7-b08e561259d4 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:51.854326 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 395/794] 10.222.0.25 () {56 vars in 1087 bytes} [Mon May 23 12:19:51 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:51.860377 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53117e08-1573-4f87-8a5d-231ec9794f02 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:51.860717 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53117e08-1573-4f87-8a5d-231ec9794f02 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:51.860936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53117e08-1573-4f87-8a5d-231ec9794f02 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:51.863609 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 396/795] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:51.864506 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53117e08-1573-4f87-8a5d-231ec9794f02 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:51.901608 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab3cde-b506-460f-8446-7d07b19c0a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:51.902480 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab3cde-b506-460f-8446-7d07b19c0a05 None admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:51.902862 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab3cde-b506-460f-8446-7d07b19c0a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:51.903094 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab3cde-b506-460f-8446-7d07b19c0a05 None admin] PATH_INFO: `/v3/projects/402397b981be4f0c9e778a2771c41937/users/eb30fc9bc5a04139b2a364ff03f4ad60/roles/e344e91a09be4d10834ea5f942345beb` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:51.926603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab3cde-b506-460f-8446-7d07b19c0a05 None admin] RBAC: Authorizing `identity:create_grant(project_id=402397b981be4f0c9e778a2771c41937, user_id=eb30fc9bc5a04139b2a364ff03f4ad60, role_id=e344e91a09be4d10834ea5f942345beb)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:51.928210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab3cde-b506-460f-8446-7d07b19c0a05 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:51.937284 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:51.954668 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 400/796] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:19:51 2022] PUT /identity/v3/projects/402397b981be4f0c9e778a2771c41937/users/eb30fc9bc5a04139b2a364ff03f4ad60/roles/e344e91a09be4d10834ea5f942345beb => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:19:51.954668 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67e9d3-ef76-435d-86d5-55771ac7a092 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:51.954668 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67e9d3-ef76-435d-86d5-55771ac7a092 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:51.954668 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67e9d3-ef76-435d-86d5-55771ac7a092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:51.979360 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-ea67e9d3-ef76-435d-86d5-55771ac7a092 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:51.982228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ea67e9d3-ef76-435d-86d5-55771ac7a092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:52.073749 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53117e08-1573-4f87-8a5d-231ec9794f02 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:52.108838 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 401/797] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:19:52.125530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc2285-0e62-4c23-aeb9-98d4178d3d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:52.126691 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc2285-0e62-4c23-aeb9-98d4178d3d2a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:52.127075 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc2285-0e62-4c23-aeb9-98d4178d3d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:52.127357 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc2285-0e62-4c23-aeb9-98d4178d3d2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:52.135912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67e9d3-ef76-435d-86d5-55771ac7a092 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:52.142971 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc2285-0e62-4c23-aeb9-98d4178d3d2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:52.151522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-c8cc2285-0e62-4c23-aeb9-98d4178d3d2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:19:52.151522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:52.151522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:52.151522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:52.151522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:52.151522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:52.151522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:52.151522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:52.151522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:52.151522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:52.151522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:52.151522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:52.151522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:52.151522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:52.151522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:52.151522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:52.152564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:52.152564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:52.152564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:52.152564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:52.152564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:52.152564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:52.152564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:52.152564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:52.152564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:52.152564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:52.152564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:52.152564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:52.152564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:52.152564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:52.152564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:52.152564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:52.153414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:52.153414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:52.153414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:52.153414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:52.153414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:52.153414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:52.153414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:52.153414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:52.153414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:52.153414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:52.153414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:19:52.153414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:52.153414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 397/798] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:19:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:52.157971 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:52.160479 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc2285-0e62-4c23-aeb9-98d4178d3d2a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:52.298370 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67e9d3-ef76-435d-86d5-55771ac7a092 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:52.343370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc2285-0e62-4c23-aeb9-98d4178d3d2a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:52.353650 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:52.384581 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22bde6-8377-4086-9ef7-ac794820fc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:52.385515 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22bde6-8377-4086-9ef7-ac794820fc27 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:52.385954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22bde6-8377-4086-9ef7-ac794820fc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:52.386688 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22bde6-8377-4086-9ef7-ac794820fc27 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:52.387624 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22bde6-8377-4086-9ef7-ac794820fc27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:52.388114 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22bde6-8377-4086-9ef7-ac794820fc27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:52.389692 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22bde6-8377-4086-9ef7-ac794820fc27 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:52.396340 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf43af-3c89-459b-b1f8-69a98dd56851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:52.396894 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf43af-3c89-459b-b1f8-69a98dd56851 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:52.397186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf43af-3c89-459b-b1f8-69a98dd56851 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:52.397462 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf43af-3c89-459b-b1f8-69a98dd56851 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:52.402415 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 398/799] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:19:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:52.410671 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22bde6-8377-4086-9ef7-ac794820fc27 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:52.439289 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf43af-3c89-459b-b1f8-69a98dd56851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:52.447006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-bdaf43af-3c89-459b-b1f8-69a98dd56851 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:19:52.447006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:52.447006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:52.447006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:52.447006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:52.447006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:52.447006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:52.447006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:52.447006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:52.447006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:52.447006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:52.447006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:52.447006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:52.447006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:52.447006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:52.447006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:52.447981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:52.447981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:52.447981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:52.447981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:52.447981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:52.447981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:52.447981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:52.447981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:52.447981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:52.447981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:52.447981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:52.447981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:52.447981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:52.447981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:52.447981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:52.447981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:52.448921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:52.448921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:52.448921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:52.448921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:52.448921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:52.448921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:52.448921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:52.448921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:52.448921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:52.448921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:52.448921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:19:52.448921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:52.455885 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 402/800] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:19:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:52.456815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf43af-3c89-459b-b1f8-69a98dd56851 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:52.519362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22bde6-8377-4086-9ef7-ac794820fc27 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:52.574839 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f5acd-c6cb-429e-b6e0-65b1b0e839d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:52.575771 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f5acd-c6cb-429e-b6e0-65b1b0e839d5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:52.576058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f5acd-c6cb-429e-b6e0-65b1b0e839d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:52.576334 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f5acd-c6cb-429e-b6e0-65b1b0e839d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:52.595140 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f5acd-c6cb-429e-b6e0-65b1b0e839d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:52.596940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f5acd-c6cb-429e-b6e0-65b1b0e839d5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:52.626820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-7a3f5acd-c6cb-429e-b6e0-65b1b0e839d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:52.626820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:52.626820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:52.626820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:52.626820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:52.626820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:52.626820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:52.626820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:52.626820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:52.626820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:52.626820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:52.626820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:52.626820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:52.626820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:52.626820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:52.627768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:52.627768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:52.627768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:52.627768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:52.627768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:52.627768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:52.627768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:52.627768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:52.627768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:52.627768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:52.627768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:52.627768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:52.627768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:52.627768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:52.627768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:52.627768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:52.627768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:52.628668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:52.628668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:52.628668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:52.628668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:52.628668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 399/801] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:52.634200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f5acd-c6cb-429e-b6e0-65b1b0e839d5 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:52.666343 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:52.673597 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:52.714870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf43af-3c89-459b-b1f8-69a98dd56851 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:52.784058 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096b386-1e72-4d6a-ac0e-e00bccf60446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:52.784744 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096b386-1e72-4d6a-ac0e-e00bccf60446 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:52.785029 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096b386-1e72-4d6a-ac0e-e00bccf60446 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:52.785307 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096b386-1e72-4d6a-ac0e-e00bccf60446 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:52.786066 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096b386-1e72-4d6a-ac0e-e00bccf60446 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:52.786534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096b386-1e72-4d6a-ac0e-e00bccf60446 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:52.789391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096b386-1e72-4d6a-ac0e-e00bccf60446 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:52.806040 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 403/802] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:19:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:52.811724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096b386-1e72-4d6a-ac0e-e00bccf60446 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:52.820204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f5acd-c6cb-429e-b6e0-65b1b0e839d5 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:52.882932 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecd9cf-b661-4a7e-89d9-c5966ee0d0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:52.883706 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecd9cf-b661-4a7e-89d9-c5966ee0d0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:52.883907 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecd9cf-b661-4a7e-89d9-c5966ee0d0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:52.884158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecd9cf-b661-4a7e-89d9-c5966ee0d0a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:52.884894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecd9cf-b661-4a7e-89d9-c5966ee0d0a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:52.885203 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecd9cf-b661-4a7e-89d9-c5966ee0d0a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:52.886627 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecd9cf-b661-4a7e-89d9-c5966ee0d0a1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:52.917709 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 400/803] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:52.936000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecd9cf-b661-4a7e-89d9-c5966ee0d0a1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:53.014260 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096b386-1e72-4d6a-ac0e-e00bccf60446 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:53.055975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98af86-c0d8-4910-90e3-89226f43c965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:53.056780 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98af86-c0d8-4910-90e3-89226f43c965 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:53.057068 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98af86-c0d8-4910-90e3-89226f43c965 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:53.057349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98af86-c0d8-4910-90e3-89226f43c965 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:53.069274 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:53.072352 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98af86-c0d8-4910-90e3-89226f43c965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:53.074092 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98af86-c0d8-4910-90e3-89226f43c965 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:53.107035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-7f98af86-c0d8-4910-90e3-89226f43c965 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:53.107035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:53.107035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:53.107035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:53.107035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:53.107035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:53.107035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:53.107035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:53.107035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:53.107035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:53.107035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:53.107035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:53.107035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:53.107035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:53.107035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:53.108074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:53.108074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:53.108074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:53.108074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:53.108074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:53.108074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:53.108074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:53.108074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:53.108074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:53.108074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:53.108074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:53.108074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:53.108074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:53.108074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:53.108074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:53.108074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:53.108074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:53.109043 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:53.109043 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:53.109043 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:53.109043 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:53.111363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 404/804] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:53.117124 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:53.118357 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98af86-c0d8-4910-90e3-89226f43c965 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:53.146314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecd9cf-b661-4a7e-89d9-c5966ee0d0a1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:53.193834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f03c59-8ae0-4b65-b77e-b2147ee9c814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:53.194725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f03c59-8ae0-4b65-b77e-b2147ee9c814 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:53.195007 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f03c59-8ae0-4b65-b77e-b2147ee9c814 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:53.195375 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f03c59-8ae0-4b65-b77e-b2147ee9c814 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:53.209927 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f03c59-8ae0-4b65-b77e-b2147ee9c814 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:53.211435 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f03c59-8ae0-4b65-b77e-b2147ee9c814 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:53.239896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98af86-c0d8-4910-90e3-89226f43c965 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:53.243868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-c0f03c59-8ae0-4b65-b77e-b2147ee9c814 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 12:19:53.243868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:53.243868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:53.243868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:53.243868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:53.243868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:53.243868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:53.243868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:53.243868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:53.243868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:53.243868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:53.243868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:53.243868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:53.243868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:53.243868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:53.243868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:53.245141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:53.245141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:53.245141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:53.245141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:53.245141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:53.245141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:53.245141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:53.245141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:53.245141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:53.245141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:53.245141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:53.245141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:53.245141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:53.245141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:53.245141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:53.245141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:53.245141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:53.245141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:53.246100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:53.246100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:53.246100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:53.246100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:53.246100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:53.246100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:53.246100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:53.246100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:53.246100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 12:19:53.246100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:53.246100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 401/805] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:19:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:53.250708 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f03c59-8ae0-4b65-b77e-b2147ee9c814 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:53.291342 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17e6df-fcfe-4e22-8101-bddcd064da9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:53.292448 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17e6df-fcfe-4e22-8101-bddcd064da9c None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:53.292968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17e6df-fcfe-4e22-8101-bddcd064da9c None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:53.293488 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17e6df-fcfe-4e22-8101-bddcd064da9c None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:53.294487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17e6df-fcfe-4e22-8101-bddcd064da9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:53.295056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17e6df-fcfe-4e22-8101-bddcd064da9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:53.296730 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17e6df-fcfe-4e22-8101-bddcd064da9c None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:53.323173 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 405/806] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:53.330008 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17e6df-fcfe-4e22-8101-bddcd064da9c None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:53.397291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f03c59-8ae0-4b65-b77e-b2147ee9c814 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:53.405100 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:53.445295 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d74fbc-fcce-4180-b604-1f4fde68a0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:53.445897 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d74fbc-fcce-4180-b604-1f4fde68a0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:53.446180 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d74fbc-fcce-4180-b604-1f4fde68a0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:53.446455 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d74fbc-fcce-4180-b604-1f4fde68a0f5 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:53.447697 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d74fbc-fcce-4180-b604-1f4fde68a0f5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:53.447697 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d74fbc-fcce-4180-b604-1f4fde68a0f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:53.449133 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d74fbc-fcce-4180-b604-1f4fde68a0f5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:53.461925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17e6df-fcfe-4e22-8101-bddcd064da9c None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:53.472977 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:53.494428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 402/807] 10.222.0.25 () {56 vars in 1135 bytes} [Mon May 23 12:19:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:53.506525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d74fbc-fcce-4180-b604-1f4fde68a0f5 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:53.514053 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae33380-3881-49d6-b28c-adbc8db765c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:53.516280 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae33380-3881-49d6-b28c-adbc8db765c4 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:53.516570 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae33380-3881-49d6-b28c-adbc8db765c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:53.516847 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae33380-3881-49d6-b28c-adbc8db765c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:53.531185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae33380-3881-49d6-b28c-adbc8db765c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:53.532649 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae33380-3881-49d6-b28c-adbc8db765c4 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:53.558004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-fae33380-3881-49d6-b28c-adbc8db765c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 12:19:53.558004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:53.558004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:53.558004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:53.558004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:53.558004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:53.558004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:53.558004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:53.558004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:53.558004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:53.558004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:53.558004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:53.558004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:53.558004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:53.558004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:53.558004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:53.559051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:53.559051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:53.559051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:53.559051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:53.559051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:53.559051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:53.559051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:53.559051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:53.559051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:53.559051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:53.559051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:53.559051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:53.559051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:53.559051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:53.559051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:53.559051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:53.559051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:53.559051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:53.560077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:53.560077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:53.560077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:53.560077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:53.560077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:53.560077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:53.560077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:53.560077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:53.560077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 12:19:53.560077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:53.570110 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 406/808] 10.222.0.25 () {56 vars in 1093 bytes} [Mon May 23 12:19:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:53.573738 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae33380-3881-49d6-b28c-adbc8db765c4 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:53.668466 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d74fbc-fcce-4180-b604-1f4fde68a0f5 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:53.706834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae33380-3881-49d6-b28c-adbc8db765c4 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:53.714907 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f8a85-e66e-4f45-9d46-cf42c8270457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:53.715704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f8a85-e66e-4f45-9d46-cf42c8270457 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:53.715989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f8a85-e66e-4f45-9d46-cf42c8270457 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:53.716266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f8a85-e66e-4f45-9d46-cf42c8270457 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:53.723507 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:53.732514 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f8a85-e66e-4f45-9d46-cf42c8270457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:53.734889 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f8a85-e66e-4f45-9d46-cf42c8270457 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:53.748292 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dfd90-3c32-4a27-8d43-67057ba4aeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:53.749060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dfd90-3c32-4a27-8d43-67057ba4aeb7 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:53.749421 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dfd90-3c32-4a27-8d43-67057ba4aeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:53.749773 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dfd90-3c32-4a27-8d43-67057ba4aeb7 None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:53.750712 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245dfd90-3c32-4a27-8d43-67057ba4aeb7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:53.751098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245dfd90-3c32-4a27-8d43-67057ba4aeb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:53.752615 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245dfd90-3c32-4a27-8d43-67057ba4aeb7 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:53.757538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-a51f8a85-e66e-4f45-9d46-cf42c8270457 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:53.757538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:53.757538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:53.757538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:53.757538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:53.757538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:53.757538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:53.757538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:53.757538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:53.757538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:53.757538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:53.757538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:53.757538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:53.757538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:53.757538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:53.759158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:53.759158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:53.759158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:53.759158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:53.759158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:53.759158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:53.759158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:53.759158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:53.759158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:53.759158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:53.759158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:53.759158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:53.759158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:53.759158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:53.759158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:53.759158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:53.759158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:53.760380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:53.760380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:53.760380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:53.760380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:53.760380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 403/809] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:53.761023 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e0ddf-3c3a-4714-8ce5-9fff03f107ad None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:53.761023 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e0ddf-3c3a-4714-8ce5-9fff03f107ad None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:53.761023 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e0ddf-3c3a-4714-8ce5-9fff03f107ad None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:53.766525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 404/810] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:53.766734 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e0ddf-3c3a-4714-8ce5-9fff03f107ad None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:53.789579 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 407/811] 10.222.0.25 () {56 vars in 1133 bytes} [Mon May 23 12:19:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:53.791092 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b70117-ce20-43a3-83c2-f35097224cb6 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:53.791391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b70117-ce20-43a3-83c2-f35097224cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:53.791671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b70117-ce20-43a3-83c2-f35097224cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:53.810064 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-b0b70117-ce20-43a3-83c2-f35097224cb6 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:53.811391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-b0b70117-ce20-43a3-83c2-f35097224cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:53.834900 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:53.906241 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 408/812] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:19:53.907173 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b70117-ce20-43a3-83c2-f35097224cb6 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:53.919254 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e0ddf-3c3a-4714-8ce5-9fff03f107ad None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:53.970527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd16b5-0634-49b8-a41c-ccdd0205185d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:53.971188 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd16b5-0634-49b8-a41c-ccdd0205185d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:53.971656 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd16b5-0634-49b8-a41c-ccdd0205185d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:53.971943 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd16b5-0634-49b8-a41c-ccdd0205185d None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:53.972679 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd16b5-0634-49b8-a41c-ccdd0205185d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:53.972989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd16b5-0634-49b8-a41c-ccdd0205185d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:53.975232 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd16b5-0634-49b8-a41c-ccdd0205185d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:53.993091 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 405/813] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:53.994076 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd16b5-0634-49b8-a41c-ccdd0205185d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:54.038057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:54.043740 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b70117-ce20-43a3-83c2-f35097224cb6 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:54.098529 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012b864-4663-41b1-bd59-819c1d1b66f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:54.098529 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012b864-4663-41b1-bd59-819c1d1b66f2 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:54.098529 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012b864-4663-41b1-bd59-819c1d1b66f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:54.099757 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012b864-4663-41b1-bd59-819c1d1b66f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:54.113961 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd16b5-0634-49b8-a41c-ccdd0205185d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:54.134691 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:54.178298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18210146-6ad3-41c2-b613-404ba4a657a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:54.179196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18210146-6ad3-41c2-b613-404ba4a657a2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:54.179644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18210146-6ad3-41c2-b613-404ba4a657a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:54.180051 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18210146-6ad3-41c2-b613-404ba4a657a2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:54.180728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18210146-6ad3-41c2-b613-404ba4a657a2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:54.185587 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18210146-6ad3-41c2-b613-404ba4a657a2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:54.200146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-18210146-6ad3-41c2-b613-404ba4a657a2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 12:19:54.200146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:54.200146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:19:54.200146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:19:54.200146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:19:54.200146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:19:54.200146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:19:54.200146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:19:54.200146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 12:19:54.200146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:54.200146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:19:54.200146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:54.200146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:54.200146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:54.200146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:54.200146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:54.202102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:54.202102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:54.202102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:54.202102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:54.202102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:54.202102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:54.202102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:54.202102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:19:54.202102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:19:54.202102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:19:54.202102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:19:54.202102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:54.202102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:54.202102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:54.202102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:54.202102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:54.203834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:54.203834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:54.203834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:54.203834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:54.203834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:54.203834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:54.203834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:54.203834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:54.203834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:54.203834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:54.203834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:54.203834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:19:54.203834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:19:54.203834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 12:19:54.203834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:54.206691 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 406/814] 10.222.0.25 () {56 vars in 1129 bytes} [Mon May 23 12:19:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:54.207574 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18210146-6ad3-41c2-b613-404ba4a657a2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:54.226266 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012b864-4663-41b1-bd59-819c1d1b66f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:54.229355 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012b864-4663-41b1-bd59-819c1d1b66f2 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:54.347304 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:54.356554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18210146-6ad3-41c2-b613-404ba4a657a2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:54.357198 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 409/815] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:19:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:19:54.358326 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012b864-4663-41b1-bd59-819c1d1b66f2 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:54.399373 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ffd6b-dd81-4e56-a199-2bec156d29ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:54.400537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ffd6b-dd81-4e56-a199-2bec156d29ca None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:54.401047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ffd6b-dd81-4e56-a199-2bec156d29ca None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:54.401537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ffd6b-dd81-4e56-a199-2bec156d29ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:54.409028 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ffd6b-dd81-4e56-a199-2bec156d29ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:54.410799 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ffd6b-dd81-4e56-a199-2bec156d29ca None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:54.425842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-ca8ffd6b-dd81-4e56-a199-2bec156d29ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:54.425842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:54.425842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:54.425842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:54.425842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:54.425842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:54.425842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:54.425842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:54.425842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:54.425842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:54.425842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:54.425842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:54.425842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:54.425842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:54.425842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:54.426767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:54.426767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:54.426767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:54.426767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:54.426767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:54.426767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:54.426767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:54.426767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:54.426767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:54.426767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:54.426767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:54.426767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:54.426767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:54.426767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:54.426767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:54.426767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:54.426767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:54.427706 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:54.427706 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:54.427706 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:54.427706 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:54.427706 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:54.427706 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:54.427706 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:54.427706 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:54.429824 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 407/816] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:54.431015 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ffd6b-dd81-4e56-a199-2bec156d29ca None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:54.464012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:54.483626 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012b864-4663-41b1-bd59-819c1d1b66f2 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:54.525558 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b2b11-d148-43e5-a8d7-660506b13b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:54.526220 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b2b11-d148-43e5-a8d7-660506b13b04 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:54.526521 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b2b11-d148-43e5-a8d7-660506b13b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:54.526821 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b2b11-d148-43e5-a8d7-660506b13b04 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:54.527528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b2b11-d148-43e5-a8d7-660506b13b04 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:54.527837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b2b11-d148-43e5-a8d7-660506b13b04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:54.529205 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b2b11-d148-43e5-a8d7-660506b13b04 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:54.533702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 410/817] 10.222.0.25 () {56 vars in 1124 bytes} [Mon May 23 12:19:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:54.534317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b2b11-d148-43e5-a8d7-660506b13b04 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:54.539317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ffd6b-dd81-4e56-a199-2bec156d29ca None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:54.573109 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b6b49-eaba-4b22-988e-d4341b75986e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:54.573938 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b6b49-eaba-4b22-988e-d4341b75986e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:54.574229 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b6b49-eaba-4b22-988e-d4341b75986e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:54.574496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b6b49-eaba-4b22-988e-d4341b75986e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:54.585815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b6b49-eaba-4b22-988e-d4341b75986e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:54.587299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b6b49-eaba-4b22-988e-d4341b75986e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:54.596292 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:54.605586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-df3b6b49-eaba-4b22-988e-d4341b75986e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:54.605586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:54.605586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:54.605586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:54.605586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:54.605586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:54.605586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:54.605586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:54.605586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:54.605586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:54.605586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:54.605586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:54.605586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:54.605586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:54.605586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:54.607037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:54.607037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:54.607037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:54.607037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:54.607037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:54.607037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:54.607037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:54.607037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:54.607037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:54.607037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:54.607037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:54.607037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:54.607037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:54.607037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:54.607037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:54.607037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:54.607037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:54.607933 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:54.607933 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:54.607933 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:54.607933 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:54.607933 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 408/818] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:54.608563 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537a765-2f2e-4719-9725-662973691e99 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:54.608563 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537a765-2f2e-4719-9725-662973691e99 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:54.608824 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537a765-2f2e-4719-9725-662973691e99 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:54.610060 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 409/819] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:54.611145 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71671e-3340-4676-a112-de9762019748 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:54.611570 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71671e-3340-4676-a112-de9762019748 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:54.611684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71671e-3340-4676-a112-de9762019748 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:54.612991 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 410/820] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:54.613554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71671e-3340-4676-a112-de9762019748 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:54.640129 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b2b11-d148-43e5-a8d7-660506b13b04 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:54.674116 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59ccc9-84d9-40f6-9e17-84a658f56e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:54.674789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59ccc9-84d9-40f6-9e17-84a658f56e3f None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:54.675066 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59ccc9-84d9-40f6-9e17-84a658f56e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:54.675335 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59ccc9-84d9-40f6-9e17-84a658f56e3f None admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:54.676103 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59ccc9-84d9-40f6-9e17-84a658f56e3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:54.676407 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59ccc9-84d9-40f6-9e17-84a658f56e3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:54.678459 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59ccc9-84d9-40f6-9e17-84a658f56e3f None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:54.689422 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 411/821] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:54.690202 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59ccc9-84d9-40f6-9e17-84a658f56e3f None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:54.704574 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:54.722203 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71671e-3340-4676-a112-de9762019748 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:54.755921 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ffacc-ede2-46f0-9cf7-890d5ee604ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:54.756514 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ffacc-ede2-46f0-9cf7-890d5ee604ea None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:54.756801 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ffacc-ede2-46f0-9cf7-890d5ee604ea None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:54.757080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ffacc-ede2-46f0-9cf7-890d5ee604ea None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:54.757785 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ffacc-ede2-46f0-9cf7-890d5ee604ea None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:54.758092 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ffacc-ede2-46f0-9cf7-890d5ee604ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:54.759508 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ffacc-ede2-46f0-9cf7-890d5ee604ea None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:54.764195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 411/822] 10.222.0.25 () {56 vars in 1124 bytes} [Mon May 23 12:19:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:54.765356 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7edcbd-3b83-466b-a100-2162fc5dd98a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:54.765650 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7edcbd-3b83-466b-a100-2162fc5dd98a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:54.765932 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7edcbd-3b83-466b-a100-2162fc5dd98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:54.782244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9c7edcbd-3b83-466b-a100-2162fc5dd98a None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:54.783459 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9c7edcbd-3b83-466b-a100-2162fc5dd98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:54.792337 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59ccc9-84d9-40f6-9e17-84a658f56e3f None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:54.815084 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:54.827868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb17ebc-84a0-4431-9663-76202bce7a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:54.828538 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb17ebc-84a0-4431-9663-76202bce7a10 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:54.828819 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb17ebc-84a0-4431-9663-76202bce7a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:54.829093 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb17ebc-84a0-4431-9663-76202bce7a10 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:54.829813 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb17ebc-84a0-4431-9663-76202bce7a10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:54.830120 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb17ebc-84a0-4431-9663-76202bce7a10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:54.831530 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb17ebc-84a0-4431-9663-76202bce7a10 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:54.844072 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 412/823] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:54.845099 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622fac0-57b5-4bc4-bef6-fd0d10020aac None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:54.845387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622fac0-57b5-4bc4-bef6-fd0d10020aac None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:54.845660 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622fac0-57b5-4bc4-bef6-fd0d10020aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:54.850207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 412/824] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:19:54.851049 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7edcbd-3b83-466b-a100-2162fc5dd98a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:54.866307 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-4622fac0-57b5-4bc4-bef6-fd0d10020aac None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:54.868040 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-4622fac0-57b5-4bc4-bef6-fd0d10020aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:54.931465 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:54.934433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 413/825] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:19:54.935268 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622fac0-57b5-4bc4-bef6-fd0d10020aac None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:54.969704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7edcbd-3b83-466b-a100-2162fc5dd98a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:55.003612 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e76cde-1c28-408f-bbb7-b8a33ea36160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:55.004490 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e76cde-1c28-408f-bbb7-b8a33ea36160 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:55.004769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e76cde-1c28-408f-bbb7-b8a33ea36160 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:55.005041 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e76cde-1c28-408f-bbb7-b8a33ea36160 None admin] PATH_INFO: `/v3/projects/402397b981be4f0c9e778a2771c41937/users/03ca1edc22174d258ddeda25407ee6ed/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:55.007096 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e76cde-1c28-408f-bbb7-b8a33ea36160 None admin] RBAC: Authorizing `identity:create_grant(project_id=402397b981be4f0c9e778a2771c41937, user_id=03ca1edc22174d258ddeda25407ee6ed, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:55.008476 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e76cde-1c28-408f-bbb7-b8a33ea36160 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:55.021338 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 413/826] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:19:54 2022] PUT /identity/v3/projects/402397b981be4f0c9e778a2771c41937/users/03ca1edc22174d258ddeda25407ee6ed/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:19:55.022139 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e76cde-1c28-408f-bbb7-b8a33ea36160 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:55.033673 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622fac0-57b5-4bc4-bef6-fd0d10020aac None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:55.050957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:55.078844 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a051bca-f4da-4677-bb86-5e4f84b257a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:55.079939 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a051bca-f4da-4677-bb86-5e4f84b257a5 None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:55.079939 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a051bca-f4da-4677-bb86-5e4f84b257a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:55.080159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a051bca-f4da-4677-bb86-5e4f84b257a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:55.080801 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a051bca-f4da-4677-bb86-5e4f84b257a5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:55.082260 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a051bca-f4da-4677-bb86-5e4f84b257a5 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:55.118535 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 414/827] 10.222.0.25 () {60 vars in 1144 bytes} [Mon May 23 12:19:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:19:55.118535 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a051bca-f4da-4677-bb86-5e4f84b257a5 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:55.160597 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e76cde-1c28-408f-bbb7-b8a33ea36160 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:55.211460 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bf549-6b34-4521-a4b0-bc52ac1c54ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:55.212266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bf549-6b34-4521-a4b0-bc52ac1c54ac None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:55.212551 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bf549-6b34-4521-a4b0-bc52ac1c54ac None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:55.212880 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bf549-6b34-4521-a4b0-bc52ac1c54ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:55.215322 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:55.222564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5bf549-6b34-4521-a4b0-bc52ac1c54ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:55.225798 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5bf549-6b34-4521-a4b0-bc52ac1c54ac None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:55.244673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-0c5bf549-6b34-4521-a4b0-bc52ac1c54ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:55.244673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:55.244673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:55.244673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:55.244673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:55.244673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:55.244673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:55.244673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:55.244673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:55.244673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:55.244673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:55.244673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:55.244673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:55.244673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:55.244673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:55.245642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:55.245642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:55.245642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:55.245642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:55.245642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:55.245642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:55.245642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:55.245642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:55.245642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:55.245642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:55.245642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:55.245642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:55.245642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:55.245642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:55.245642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:55.245642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:55.245642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:55.246610 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:55.246610 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:55.246610 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:55.246610 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:55.246610 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:55.246610 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:55.246610 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:55.246610 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:55.246610 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 414/828] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:55.247114 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bf549-6b34-4521-a4b0-bc52ac1c54ac None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:55.276859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a051bca-f4da-4677-bb86-5e4f84b257a5 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:55.340973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2b3d1-3af5-409a-b825-b9e0e592a45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:55.342131 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2b3d1-3af5-409a-b825-b9e0e592a45c None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:55.342424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2b3d1-3af5-409a-b825-b9e0e592a45c None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:55.342739 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2b3d1-3af5-409a-b825-b9e0e592a45c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:55.355958 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2b3d1-3af5-409a-b825-b9e0e592a45c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:55.364893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-e9c2b3d1-3af5-409a-b825-b9e0e592a45c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:55.364893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:55.364893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:55.364893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:55.364893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:55.364893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:55.364893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:55.364893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:55.364893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:55.364893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:55.364893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:55.364893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:55.364893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:55.364893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:55.364893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:55.364893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:55.365840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:55.365840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:55.365840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:55.365840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:55.365840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:55.365840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:55.365840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:55.365840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:55.365840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:55.365840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:55.365840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:55.365840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:55.365840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:55.365840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:55.365840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:55.365840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:55.367128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:55.367128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:55.367128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:55.367128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:55.367128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:55.367128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:55.367128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:55.367128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:55.367128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:55.367128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:55.367128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:19:55.367128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:55.367128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 415/829] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:19:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:55.368039 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2b3d1-3af5-409a-b825-b9e0e592a45c None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:55.386403 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bf549-6b34-4521-a4b0-bc52ac1c54ac None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:55.404689 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:55.434718 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c193f7-56e8-4e5f-b364-48ce3023ad47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:55.436015 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c193f7-56e8-4e5f-b364-48ce3023ad47 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:55.436604 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c193f7-56e8-4e5f-b364-48ce3023ad47 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:55.437347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c193f7-56e8-4e5f-b364-48ce3023ad47 None admin] PATH_INFO: `/v3/services/network` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:55.438453 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c193f7-56e8-4e5f-b364-48ce3023ad47 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:55.440638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c193f7-56e8-4e5f-b364-48ce3023ad47 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:55.456088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-c6c193f7-56e8-4e5f-b364-48ce3023ad47 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 12:19:55.456088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:55.456088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:19:55.456088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:19:55.456088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:19:55.456088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:19:55.456088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:19:55.456088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:19:55.456088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 12:19:55.456088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:55.456088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:19:55.456088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:55.456088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:55.456088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:55.456088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:55.456088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:55.456088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:55.457431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:55.457431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:55.457431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:55.457431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:55.457431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:55.457431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:55.457431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:19:55.457431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:19:55.457431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:19:55.457431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:19:55.457431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:55.457431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:55.457431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:55.457431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:55.457431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:55.457431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:55.458585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:55.458585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:55.458585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:55.458585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:55.458585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:55.458585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:55.458585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:55.458585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:55.458585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:55.458585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:55.458585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:19:55.458585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:19:55.458585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 12:19:55.458585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:55.461726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 415/830] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:55 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:55.467106 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c193f7-56e8-4e5f-b364-48ce3023ad47 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:55.500862 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2b3d1-3af5-409a-b825-b9e0e592a45c None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:55.529517 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:55.546604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a739c4c-751c-4248-aff8-c3d19955c468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:55.547134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a739c4c-751c-4248-aff8-c3d19955c468 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:55.547427 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a739c4c-751c-4248-aff8-c3d19955c468 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:55.547707 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a739c4c-751c-4248-aff8-c3d19955c468 None admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:55.548506 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a739c4c-751c-4248-aff8-c3d19955c468 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:55.548821 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a739c4c-751c-4248-aff8-c3d19955c468 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:55.550281 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a739c4c-751c-4248-aff8-c3d19955c468 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:55.570421 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 416/831] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:55.571398 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a739c4c-751c-4248-aff8-c3d19955c468 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:55.585894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c193f7-56e8-4e5f-b364-48ce3023ad47 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:55.625711 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1d3b9-0818-45f1-9d33-53f36cef1710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:55.626791 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1d3b9-0818-45f1-9d33-53f36cef1710 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:55.627351 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1d3b9-0818-45f1-9d33-53f36cef1710 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:55.627827 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1d3b9-0818-45f1-9d33-53f36cef1710 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:55.628780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1d3b9-0818-45f1-9d33-53f36cef1710 None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:55.629289 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1d3b9-0818-45f1-9d33-53f36cef1710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:55.631701 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1d3b9-0818-45f1-9d33-53f36cef1710 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:55.643623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 416/832] 10.222.0.25 () {56 vars in 1103 bytes} [Mon May 23 12:19:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:55.645001 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1d3b9-0818-45f1-9d33-53f36cef1710 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:55.668408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:55.679084 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a739c4c-751c-4248-aff8-c3d19955c468 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:55.717419 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44645825-8e1b-42f8-b647-8631d428ffc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:55.718287 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44645825-8e1b-42f8-b647-8631d428ffc4 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:55.718724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44645825-8e1b-42f8-b647-8631d428ffc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:55.719106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44645825-8e1b-42f8-b647-8631d428ffc4 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:55.719928 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44645825-8e1b-42f8-b647-8631d428ffc4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:55.720341 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44645825-8e1b-42f8-b647-8631d428ffc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:55.721819 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44645825-8e1b-42f8-b647-8631d428ffc4 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:55.731471 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 417/833] 10.222.0.25 () {56 vars in 1112 bytes} [Mon May 23 12:19:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:55.731471 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44645825-8e1b-42f8-b647-8631d428ffc4 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:55.767869 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1d3b9-0818-45f1-9d33-53f36cef1710 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:55.793845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:55.816189 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956592ff-2b41-4a80-8797-e44c48333183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:55.816858 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956592ff-2b41-4a80-8797-e44c48333183 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:55.817145 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956592ff-2b41-4a80-8797-e44c48333183 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:55.817484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956592ff-2b41-4a80-8797-e44c48333183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:55.819430 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956592ff-2b41-4a80-8797-e44c48333183 None admin] RBAC: Adding query filter params (role.id=3ae7c5e54e084ac4a1f94da93a667583, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=d49997b9108145b78eb4db1d8823bf4d) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:55.819746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956592ff-2b41-4a80-8797-e44c48333183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:55.821656 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956592ff-2b41-4a80-8797-e44c48333183 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:55.834537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 417/834] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:19:55 2022] GET /identity/v3/role_assignments?user.id=d49997b9108145b78eb4db1d8823bf4d&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=3ae7c5e54e084ac4a1f94da93a667583 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:55.834537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956592ff-2b41-4a80-8797-e44c48333183 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:55.868623 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44645825-8e1b-42f8-b647-8631d428ffc4 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:55.956209 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956592ff-2b41-4a80-8797-e44c48333183 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:55.957547 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c4adb-869a-4596-be6f-9c3ee66c3a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:55.958693 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c4adb-869a-4596-be6f-9c3ee66c3a58 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:55.959189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c4adb-869a-4596-be6f-9c3ee66c3a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:55.959704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c4adb-869a-4596-be6f-9c3ee66c3a58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:55.985995 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c4adb-869a-4596-be6f-9c3ee66c3a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:55.987863 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c4adb-869a-4596-be6f-9c3ee66c3a58 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:55.996984 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6a2ef-9179-4a06-ab56-bcbcc931795a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:55.997657 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6a2ef-9179-4a06-ab56-bcbcc931795a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:55.997946 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6a2ef-9179-4a06-ab56-bcbcc931795a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:55.998225 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6a2ef-9179-4a06-ab56-bcbcc931795a None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:55.998969 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6a2ef-9179-4a06-ab56-bcbcc931795a None admin] RBAC: Adding query filter params (type=network) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:55.999279 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6a2ef-9179-4a06-ab56-bcbcc931795a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:56.000677 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6a2ef-9179-4a06-ab56-bcbcc931795a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:56.007455 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 418/835] 10.222.0.25 () {56 vars in 1112 bytes} [Mon May 23 12:19:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:56.013734 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6a2ef-9179-4a06-ab56-bcbcc931795a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:56.026262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-b91c4adb-869a-4596-be6f-9c3ee66c3a58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:56.026262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:56.026262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:56.026262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:56.026262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:56.026262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:56.026262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:56.026262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:56.026262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:56.026262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:56.026262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:56.026262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:56.026262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:56.026262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:56.026262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:56.027253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:56.027253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:56.027253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:56.027253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:56.027253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:56.027253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:56.027253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:56.027253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:56.027253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:56.027253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:56.027253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:56.027253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:56.027253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:56.027253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:56.027253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:56.027253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:56.027253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:56.028172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:56.028172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:56.028172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:56.028172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:56.034458 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 418/836] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:56.035803 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c4adb-869a-4596-be6f-9c3ee66c3a58 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:56.049566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:56.074990 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:56.140701 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6a2ef-9179-4a06-ab56-bcbcc931795a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:56.182075 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7701f-1a88-439f-947b-35d45ea24916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:56.183213 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7701f-1a88-439f-947b-35d45ea24916 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:56.183722 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7701f-1a88-439f-947b-35d45ea24916 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:56.184205 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7701f-1a88-439f-947b-35d45ea24916 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:56.185804 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7701f-1a88-439f-947b-35d45ea24916 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:56.187805 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7701f-1a88-439f-947b-35d45ea24916 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:56.221332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 419/837] 10.222.0.25 () {60 vars in 1144 bytes} [Mon May 23 12:19:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:19:56.247804 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c4adb-869a-4596-be6f-9c3ee66c3a58 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:56.310299 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f87c71-c8ad-45b7-a3b8-962f2f92cf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:56.311410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87c71-c8ad-45b7-a3b8-962f2f92cf55 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:56.311957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87c71-c8ad-45b7-a3b8-962f2f92cf55 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:56.312478 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87c71-c8ad-45b7-a3b8-962f2f92cf55 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:56.313430 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f87c71-c8ad-45b7-a3b8-962f2f92cf55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:56.313943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f87c71-c8ad-45b7-a3b8-962f2f92cf55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:56.315626 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f87c71-c8ad-45b7-a3b8-962f2f92cf55 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:56.331264 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 419/838] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:56.336731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7701f-1a88-439f-947b-35d45ea24916 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:56.455584 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7701f-1a88-439f-947b-35d45ea24916 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:56.458538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:56.497087 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd676c4-04f0-4a9c-9b0b-872f956dde27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:56.497900 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd676c4-04f0-4a9c-9b0b-872f956dde27 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:56.498183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd676c4-04f0-4a9c-9b0b-872f956dde27 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:56.498454 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd676c4-04f0-4a9c-9b0b-872f956dde27 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:56.506346 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd676c4-04f0-4a9c-9b0b-872f956dde27 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:56.507848 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd676c4-04f0-4a9c-9b0b-872f956dde27 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:56.523292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-7cd676c4-04f0-4a9c-9b0b-872f956dde27 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:19:56.523292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:56.523292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:56.523292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:56.523292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:56.523292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:56.523292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:56.523292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:56.523292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:56.523292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:56.523292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:56.523292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:56.523292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:56.523292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:56.523292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:56.523292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:56.524238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:56.524238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:56.524238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:56.524238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:56.524238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:56.524238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:56.524238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:56.524238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:56.524238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:56.524238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:56.524238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:56.524238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:56.524238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:56.524238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:56.524238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:56.524238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:56.524238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:56.524238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:56.525174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:56.525174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:56.525174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:56.525174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:56.525174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:56.525174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:56.525174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:56.525174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:56.525174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:19:56.525174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:56.525174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 420/839] 10.222.0.25 () {56 vars in 1117 bytes} [Mon May 23 12:19:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:56.532359 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f87c71-c8ad-45b7-a3b8-962f2f92cf55 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:56.603803 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:56.649222 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f87c71-c8ad-45b7-a3b8-962f2f92cf55 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:56.691952 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ba8ef-1b93-4b42-ad27-eea2805459e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:56.692671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ba8ef-1b93-4b42-ad27-eea2805459e0 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:56.692992 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ba8ef-1b93-4b42-ad27-eea2805459e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:56.693248 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ba8ef-1b93-4b42-ad27-eea2805459e0 None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:56.694098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ba8ef-1b93-4b42-ad27-eea2805459e0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:56.694418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ba8ef-1b93-4b42-ad27-eea2805459e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:56.695966 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ba8ef-1b93-4b42-ad27-eea2805459e0 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:56.714925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 420/840] 10.222.0.25 () {56 vars in 1149 bytes} [Mon May 23 12:19:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:56.720981 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd676c4-04f0-4a9c-9b0b-872f956dde27 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:56.832686 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd676c4-04f0-4a9c-9b0b-872f956dde27 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:56.869223 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de354be-c0a0-43d7-aacd-b7d29f8e63ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:56.869798 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de354be-c0a0-43d7-aacd-b7d29f8e63ca None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:56.870085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de354be-c0a0-43d7-aacd-b7d29f8e63ca None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:56.870364 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de354be-c0a0-43d7-aacd-b7d29f8e63ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:56.903430 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:56.941614 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de354be-c0a0-43d7-aacd-b7d29f8e63ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:56.943656 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de354be-c0a0-43d7-aacd-b7d29f8e63ca None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:57.045385 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 421/841] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:19:56 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:19:57.051484 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ba8ef-1b93-4b42-ad27-eea2805459e0 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:57.160923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ba8ef-1b93-4b42-ad27-eea2805459e0 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:57.191061 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:57.201265 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5e0eb-2217-469f-8c0b-ac5a5ee96efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:57.202071 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5e0eb-2217-469f-8c0b-ac5a5ee96efc None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:57.202761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5e0eb-2217-469f-8c0b-ac5a5ee96efc None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:57.203049 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5e0eb-2217-469f-8c0b-ac5a5ee96efc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:57.214572 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5e0eb-2217-469f-8c0b-ac5a5ee96efc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:57.216040 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5e0eb-2217-469f-8c0b-ac5a5ee96efc None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:57.234253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-c4f5e0eb-2217-469f-8c0b-ac5a5ee96efc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:57.234253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:57.234253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:57.234253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:57.234253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:57.234253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:57.234253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:57.234253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:57.234253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:57.234253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:57.234253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:57.234253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:57.234253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:57.234253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:57.234253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:57.235209 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:57.235209 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:57.235209 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:57.235209 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:57.235209 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:57.235209 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:57.235209 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:57.235209 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:57.235209 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:57.235209 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:57.235209 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:57.235209 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:57.235209 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:57.235209 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:57.235209 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:57.235209 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:57.235209 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:57.236088 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:57.236088 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:57.236088 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:57.236088 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:57.238215 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 421/842] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:57.249761 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de354be-c0a0-43d7-aacd-b7d29f8e63ca None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:57.337821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:57.378395 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de354be-c0a0-43d7-aacd-b7d29f8e63ca None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:57.384169 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f0454-f533-4118-9df9-bf274a4be6f0 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:57.388584 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f0454-f533-4118-9df9-bf274a4be6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:57.388584 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f0454-f533-4118-9df9-bf274a4be6f0 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:57.388584 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 422/843] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:19:57.391805 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc946b73-bbab-41a3-9c86-c7ad14c94e7b None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:57.392095 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc946b73-bbab-41a3-9c86-c7ad14c94e7b None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:57.392376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc946b73-bbab-41a3-9c86-c7ad14c94e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:57.413817 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-cc946b73-bbab-41a3-9c86-c7ad14c94e7b None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:57.415948 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-cc946b73-bbab-41a3-9c86-c7ad14c94e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:57.432266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb73b1b-ece2-4822-80d7-8f68ad77c8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:57.433442 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb73b1b-ece2-4822-80d7-8f68ad77c8ae None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:57.433957 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb73b1b-ece2-4822-80d7-8f68ad77c8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:57.434468 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb73b1b-ece2-4822-80d7-8f68ad77c8ae None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:57.435561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb73b1b-ece2-4822-80d7-8f68ad77c8ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:57.436186 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb73b1b-ece2-4822-80d7-8f68ad77c8ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:57.437926 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb73b1b-ece2-4822-80d7-8f68ad77c8ae None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:57.460432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 422/844] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:57.466250 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb73b1b-ece2-4822-80d7-8f68ad77c8ae None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:57.502700 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 423/845] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:19:57.522882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc946b73-bbab-41a3-9c86-c7ad14c94e7b None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:57.629369 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb73b1b-ece2-4822-80d7-8f68ad77c8ae None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:57.630849 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc946b73-bbab-41a3-9c86-c7ad14c94e7b None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:57.632436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:57.668225 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:57.670725 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d26bc-4a41-4df5-a949-c85686a20439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:57.672127 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d26bc-4a41-4df5-a949-c85686a20439 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:57.672588 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d26bc-4a41-4df5-a949-c85686a20439 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:57.672826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d26bc-4a41-4df5-a949-c85686a20439 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:57.681955 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e95268-84a7-4d0c-9382-76f2610f13f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:57.683149 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e95268-84a7-4d0c-9382-76f2610f13f1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:57.683657 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e95268-84a7-4d0c-9382-76f2610f13f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:57.684135 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e95268-84a7-4d0c-9382-76f2610f13f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:57.688567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d26bc-4a41-4df5-a949-c85686a20439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:19:57.692087 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e95268-84a7-4d0c-9382-76f2610f13f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:57.694375 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e95268-84a7-4d0c-9382-76f2610f13f1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:57.699023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-9e1d26bc-4a41-4df5-a949-c85686a20439 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:19:57.699023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:57.699023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:57.699023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:57.699023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:57.699023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:57.699023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:57.699023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:57.699023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:57.699023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:57.699023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:57.699023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:57.699023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:19:57.699023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:19:57.699023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:19:57.699023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:19:57.699968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:19:57.699968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:19:57.699968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:19:57.699968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:19:57.699968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:57.699968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:57.699968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:57.699968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:57.699968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:57.699968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:57.699968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:57.699968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:57.699968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:57.699968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:57.699968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:57.699968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:57.701013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:57.701013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:57.701013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:57.701013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:57.701013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:19:57.701013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:19:57.701013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:19:57.701013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:19:57.701013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:19:57.701013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:19:57.701013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:19:57.701013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:57.701658 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 424/846] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:19:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:57.702849 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bb5f6-6593-437e-8ae6-59f27f149de2 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:57.703305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bb5f6-6593-437e-8ae6-59f27f149de2 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:57.703594 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bb5f6-6593-437e-8ae6-59f27f149de2 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:57.709801 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 425/847] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:57.710664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bb5f6-6593-437e-8ae6-59f27f149de2 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:57.719421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-73e95268-84a7-4d0c-9382-76f2610f13f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:57.719421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:57.719421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:57.719421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:57.719421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:57.719421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:57.719421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:57.719421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:57.719421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:57.719421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:57.719421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:57.719421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:57.719421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:57.719421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:57.719421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:57.720939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:57.720939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:57.720939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:57.720939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:57.720939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:57.720939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:57.720939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:57.720939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:57.720939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:57.720939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:57.720939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:57.720939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:57.720939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:57.720939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:57.720939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:57.720939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:57.720939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:57.722940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:57.722940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:57.722940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:57.722940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:57.722940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:57.722940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:57.722940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:57.722940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:57.729945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 423/848] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:19:57.731464 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf04162-136a-4444-918e-bc14a09d00b0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:57.732078 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf04162-136a-4444-918e-bc14a09d00b0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:57.732447 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf04162-136a-4444-918e-bc14a09d00b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:57.749629 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-caf04162-136a-4444-918e-bc14a09d00b0 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:57.750961 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-caf04162-136a-4444-918e-bc14a09d00b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:57.831193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bb5f6-6593-437e-8ae6-59f27f149de2 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:57.850639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 424/849] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:19:57.851844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf04162-136a-4444-918e-bc14a09d00b0 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:57.889143 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ffd92-766d-453e-8306-6e100610ea0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:57.890269 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ffd92-766d-453e-8306-6e100610ea0b None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:57.890823 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ffd92-766d-453e-8306-6e100610ea0b None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:57.891301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ffd92-766d-453e-8306-6e100610ea0b None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:57.892244 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ffd92-766d-453e-8306-6e100610ea0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:57.892876 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ffd92-766d-453e-8306-6e100610ea0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:57.894612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ffd92-766d-453e-8306-6e100610ea0b None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:57.908891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 426/850] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:19:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:57.914638 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ffd92-766d-453e-8306-6e100610ea0b None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:57.941382 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:57.982938 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf04162-136a-4444-918e-bc14a09d00b0 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:57.998638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:58.021985 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433ed70-e3d1-46fa-b219-1306c28a47ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:58.022757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433ed70-e3d1-46fa-b219-1306c28a47ac None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:58.023061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433ed70-e3d1-46fa-b219-1306c28a47ac None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:58.023320 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433ed70-e3d1-46fa-b219-1306c28a47ac None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:58.024110 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433ed70-e3d1-46fa-b219-1306c28a47ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:58.024425 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433ed70-e3d1-46fa-b219-1306c28a47ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:58.025877 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433ed70-e3d1-46fa-b219-1306c28a47ac None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:58.026698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ffd92-766d-453e-8306-6e100610ea0b None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:58.043281 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 425/851] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:58.043281 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433ed70-e3d1-46fa-b219-1306c28a47ac None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:58.073955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e1f90-947c-4c7e-9f25-64e9f1d3da51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:58.075365 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e1f90-947c-4c7e-9f25-64e9f1d3da51 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:58.075666 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e1f90-947c-4c7e-9f25-64e9f1d3da51 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:58.075949 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e1f90-947c-4c7e-9f25-64e9f1d3da51 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:58.076620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e1f90-947c-4c7e-9f25-64e9f1d3da51 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:58.078038 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e1f90-947c-4c7e-9f25-64e9f1d3da51 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:58.090692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-0a9e1f90-947c-4c7e-9f25-64e9f1d3da51 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 12:19:58.090692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:58.090692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:19:58.090692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:19:58.090692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:19:58.090692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:19:58.090692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:19:58.090692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:19:58.090692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 12:19:58.090692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:58.090692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:19:58.090692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:58.090692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:58.090692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:58.090692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:58.090692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:58.090692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:58.091703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:58.091703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:58.091703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:58.091703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:58.091703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:58.091703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:58.091703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:19:58.091703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:19:58.091703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:19:58.091703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:19:58.091703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:58.091703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:58.091703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:58.091703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:58.091703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:58.091703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:58.092537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:58.092537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:58.092537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:58.092537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:58.092537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:58.092537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:58.092537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:58.092537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:58.092537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:58.092537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:58.092537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:19:58.092537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:19:58.092537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 12:19:58.092537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:58.092537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 427/852] 10.222.0.25 () {56 vars in 1114 bytes} [Mon May 23 12:19:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:58.093364 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e1f90-947c-4c7e-9f25-64e9f1d3da51 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:58.157526 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433ed70-e3d1-46fa-b219-1306c28a47ac None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:58.198369 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bf038-71f0-4ec8-9cc7-3cfbd9e638f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:58.199144 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bf038-71f0-4ec8-9cc7-3cfbd9e638f5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:58.199813 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bf038-71f0-4ec8-9cc7-3cfbd9e638f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:58.199813 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bf038-71f0-4ec8-9cc7-3cfbd9e638f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:58.200362 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:58.212195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bf038-71f0-4ec8-9cc7-3cfbd9e638f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:58.213553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e1f90-947c-4c7e-9f25-64e9f1d3da51 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:58.213676 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bf038-71f0-4ec8-9cc7-3cfbd9e638f5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:58.232492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-311bf038-71f0-4ec8-9cc7-3cfbd9e638f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:58.232492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:58.232492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:58.232492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:58.232492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:58.232492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:58.232492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:58.232492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:58.232492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:58.232492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:58.232492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:58.232492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:58.232492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:58.232492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:58.232492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:58.233593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:58.233593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:58.233593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:58.233593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:58.233593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:58.233593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:58.233593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:58.233593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:58.233593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:58.233593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:58.233593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:58.233593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:58.233593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:58.233593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:58.233593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:58.233593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:58.233593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:58.234491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:58.234491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:58.234491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:58.234491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:58.234491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 426/853] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:58.234491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bf038-71f0-4ec8-9cc7-3cfbd9e638f5 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:58.253774 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e6a4a-2d13-4358-b6a1-bdbf98de4a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:58.254435 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e6a4a-2d13-4358-b6a1-bdbf98de4a36 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:58.255320 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e6a4a-2d13-4358-b6a1-bdbf98de4a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:58.255543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e6a4a-2d13-4358-b6a1-bdbf98de4a36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:58.256390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e6a4a-2d13-4358-b6a1-bdbf98de4a36 None admin] RBAC: Adding query filter params (role.id=e344e91a09be4d10834ea5f942345beb, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=eb30fc9bc5a04139b2a364ff03f4ad60) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:58.256675 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e6a4a-2d13-4358-b6a1-bdbf98de4a36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:58.258117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e6a4a-2d13-4358-b6a1-bdbf98de4a36 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:58.264580 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 428/854] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:19:58 2022] GET /identity/v3/role_assignments?user.id=eb30fc9bc5a04139b2a364ff03f4ad60&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=e344e91a09be4d10834ea5f942345beb => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:58.268359 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:58.275562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e6a4a-2d13-4358-b6a1-bdbf98de4a36 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:58.368285 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bf038-71f0-4ec8-9cc7-3cfbd9e638f5 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:58.412473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8180fcc-ac2f-42fd-a028-8265953be231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:58.413379 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8180fcc-ac2f-42fd-a028-8265953be231 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:58.413736 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8180fcc-ac2f-42fd-a028-8265953be231 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:58.414126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8180fcc-ac2f-42fd-a028-8265953be231 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:58.415079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8180fcc-ac2f-42fd-a028-8265953be231 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:58.415469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8180fcc-ac2f-42fd-a028-8265953be231 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:58.417084 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8180fcc-ac2f-42fd-a028-8265953be231 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:58.428099 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 427/855] 10.222.0.25 () {56 vars in 1114 bytes} [Mon May 23 12:19:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:58.429443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e6a4a-2d13-4358-b6a1-bdbf98de4a36 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:58.430243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8180fcc-ac2f-42fd-a028-8265953be231 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:58.476394 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127452b-2505-4309-a95f-7ca7e45e3f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:58.477427 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127452b-2505-4309-a95f-7ca7e45e3f8b None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:58.477941 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127452b-2505-4309-a95f-7ca7e45e3f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:58.478427 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127452b-2505-4309-a95f-7ca7e45e3f8b None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:58.479419 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127452b-2505-4309-a95f-7ca7e45e3f8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:58.479934 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127452b-2505-4309-a95f-7ca7e45e3f8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:58.482373 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127452b-2505-4309-a95f-7ca7e45e3f8b None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:58.496231 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 429/856] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:58.504057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127452b-2505-4309-a95f-7ca7e45e3f8b None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:58.522453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:58.557688 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:58.569109 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8180fcc-ac2f-42fd-a028-8265953be231 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:58.612801 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257ed9a-c33e-4b47-bedc-91ee7b564906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:58.613503 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257ed9a-c33e-4b47-bedc-91ee7b564906 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:58.613796 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257ed9a-c33e-4b47-bedc-91ee7b564906 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:58.614772 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257ed9a-c33e-4b47-bedc-91ee7b564906 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:58.615427 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257ed9a-c33e-4b47-bedc-91ee7b564906 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:58.615739 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257ed9a-c33e-4b47-bedc-91ee7b564906 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:58.617301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257ed9a-c33e-4b47-bedc-91ee7b564906 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:58.622352 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 428/857] 10.222.0.25 () {56 vars in 1114 bytes} [Mon May 23 12:19:58 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:58.623511 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd3a87-cdb0-4ad0-8c05-1a83ab07acc4 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:58.623806 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd3a87-cdb0-4ad0-8c05-1a83ab07acc4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:58.624084 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd3a87-cdb0-4ad0-8c05-1a83ab07acc4 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:58.625470 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 429/858] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:19:58.630783 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452bb11-5276-44de-bf75-34e4081f7631 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:58.631075 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452bb11-5276-44de-bf75-34e4081f7631 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:58.631357 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452bb11-5276-44de-bf75-34e4081f7631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:58.649938 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9452bb11-5276-44de-bf75-34e4081f7631 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:19:58.650280 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127452b-2505-4309-a95f-7ca7e45e3f8b None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:58.651236 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9452bb11-5276-44de-bf75-34e4081f7631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:19:58.693803 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f4785-e2c9-42f0-9a6b-a3aaca7ae2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:58.694716 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f4785-e2c9-42f0-9a6b-a3aaca7ae2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:58.695063 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f4785-e2c9-42f0-9a6b-a3aaca7ae2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:58.695344 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f4785-e2c9-42f0-9a6b-a3aaca7ae2a9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:58.704175 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f4785-e2c9-42f0-9a6b-a3aaca7ae2a9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:58.705744 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f4785-e2c9-42f0-9a6b-a3aaca7ae2a9 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:58.722433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-2d1f4785-e2c9-42f0-9a6b-a3aaca7ae2a9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 12:19:58.722433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:58.722433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:58.722433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:58.722433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:58.722433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:58.722433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:58.722433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:58.722433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:58.722433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:58.722433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:58.722433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:58.722433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:19:58.722433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:19:58.722433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:19:58.722433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:19:58.723508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:58.723508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:58.723508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:19:58.723508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:58.723508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:19:58.723508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:19:58.723508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:58.723508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:58.723508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:58.723508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:58.723508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:58.723508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:58.723508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:58.723508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:58.723508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:58.723508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:58.723508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:58.723508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:58.724487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:58.724487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:58.724487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:19:58.724487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:19:58.724487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:19:58.724487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:19:58.724487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:19:58.724487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:19:58.724487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 12:19:58.724487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:58.724487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 430/859] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:19:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:58.729728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f4785-e2c9-42f0-9a6b-a3aaca7ae2a9 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:58.744890 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 430/860] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:19:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:19:58.767432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452bb11-5276-44de-bf75-34e4081f7631 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:58.833157 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:58.867024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:58.878306 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f4785-e2c9-42f0-9a6b-a3aaca7ae2a9 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:58.890410 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452bb11-5276-44de-bf75-34e4081f7631 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:58.917731 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09adf96b-b29c-42ee-9962-4d8cb8f48260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:58.918716 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adf96b-b29c-42ee-9962-4d8cb8f48260 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:58.919156 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adf96b-b29c-42ee-9962-4d8cb8f48260 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:58.919613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adf96b-b29c-42ee-9962-4d8cb8f48260 None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:58.920608 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09adf96b-b29c-42ee-9962-4d8cb8f48260 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:58.921112 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09adf96b-b29c-42ee-9962-4d8cb8f48260 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:58.922763 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09adf96b-b29c-42ee-9962-4d8cb8f48260 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:58.930013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642f050-8008-4283-a269-d59cfa808007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:58.930913 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642f050-8008-4283-a269-d59cfa808007 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:58.931268 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642f050-8008-4283-a269-d59cfa808007 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:58.931612 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642f050-8008-4283-a269-d59cfa808007 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:58.932540 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642f050-8008-4283-a269-d59cfa808007 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:58.934276 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642f050-8008-4283-a269-d59cfa808007 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:58.948197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-1642f050-8008-4283-a269-d59cfa808007 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 12:19:58.948197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:58.948197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:19:58.948197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:19:58.948197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:19:58.948197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:19:58.948197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:19:58.948197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:19:58.948197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 12:19:58.948197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:58.948197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:19:58.948197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:58.948197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:58.948197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:58.948197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:58.948197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:58.949661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:58.949661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:58.949661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:58.949661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:58.949661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:58.949661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:58.949661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:58.949661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:19:58.949661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:19:58.949661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:19:58.949661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:19:58.949661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:58.949661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:58.949661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:58.949661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:58.949661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:58.950704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:58.950704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:58.950704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:19:58.950704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:58.950704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:58.950704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:58.950704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:58.950704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:58.950704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:58.950704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:58.950704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:58.950704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:19:58.950704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:19:58.950704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 12:19:58.950704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:19:58.950704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 431/862] 10.222.0.25 () {56 vars in 1132 bytes} [Mon May 23 12:19:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:58.951557 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 431/862] 10.222.0.25 () {56 vars in 1135 bytes} [Mon May 23 12:19:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:58.952943 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642f050-8008-4283-a269-d59cfa808007 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:58.955669 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09adf96b-b29c-42ee-9962-4d8cb8f48260 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:59.061185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09adf96b-b29c-42ee-9962-4d8cb8f48260 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:59.065281 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642f050-8008-4283-a269-d59cfa808007 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:59.092937 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:59.101179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067e42f-c983-4009-9e32-03753dd1bab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:59.102150 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067e42f-c983-4009-9e32-03753dd1bab6 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:59.102775 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067e42f-c983-4009-9e32-03753dd1bab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:59.103372 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067e42f-c983-4009-9e32-03753dd1bab6 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:59.104293 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067e42f-c983-4009-9e32-03753dd1bab6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:59.104428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f3adc-732a-4aba-af87-756a1009e52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:59.104960 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067e42f-c983-4009-9e32-03753dd1bab6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:59.105067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f3adc-732a-4aba-af87-756a1009e52a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:59.105314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f3adc-732a-4aba-af87-756a1009e52a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:59.105594 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f3adc-732a-4aba-af87-756a1009e52a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:59.107451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067e42f-c983-4009-9e32-03753dd1bab6 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:59.112982 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 432/863] 10.222.0.25 () {56 vars in 1126 bytes} [Mon May 23 12:19:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:19:59.122688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067e42f-c983-4009-9e32-03753dd1bab6 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:59.128383 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:59.185389 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f3adc-732a-4aba-af87-756a1009e52a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:59.187196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f3adc-732a-4aba-af87-756a1009e52a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:59.232655 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067e42f-c983-4009-9e32-03753dd1bab6 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:59.270098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b5d85-d669-4508-855d-a7417ac69fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:59.271533 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b5d85-d669-4508-855d-a7417ac69fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:59.272077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b5d85-d669-4508-855d-a7417ac69fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:59.272500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b5d85-d669-4508-855d-a7417ac69fb5 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:59.273346 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b5d85-d669-4508-855d-a7417ac69fb5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:59.273799 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b5d85-d669-4508-855d-a7417ac69fb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:59.275559 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b5d85-d669-4508-855d-a7417ac69fb5 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:59.286958 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 433/864] 10.222.0.25 () {56 vars in 1126 bytes} [Mon May 23 12:19:59 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:59.295308 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 432/865] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:19:58 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:19:59.300906 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b5d85-d669-4508-855d-a7417ac69fb5 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:59.367870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:59.415826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b5d85-d669-4508-855d-a7417ac69fb5 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:59.454076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fcabd-e99c-445e-98b0-ae1b5c1e0185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:59.455257 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fcabd-e99c-445e-98b0-ae1b5c1e0185 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:59.455727 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fcabd-e99c-445e-98b0-ae1b5c1e0185 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:59.456181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fcabd-e99c-445e-98b0-ae1b5c1e0185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:59.468563 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fcabd-e99c-445e-98b0-ae1b5c1e0185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:59.470363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fcabd-e99c-445e-98b0-ae1b5c1e0185 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:59.490203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-eb2fcabd-e99c-445e-98b0-ae1b5c1e0185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:59.490203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:59.490203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:59.490203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:59.490203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:59.490203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:59.490203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:59.490203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:59.490203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:59.490203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:59.490203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:59.490203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:59.490203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:19:59.490203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:19:59.490203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:19:59.491155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:19:59.491155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:59.491155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:59.491155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:59.491155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:59.491155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:59.491155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:59.491155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:59.491155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:59.491155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:59.491155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:59.491155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:59.491155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:59.491155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:59.491155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:59.491155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:59.491155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:59.492037 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:19:59.492037 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:19:59.492037 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:19:59.492037 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:59.492916 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 434/866] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:59.498448 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f3adc-732a-4aba-af87-756a1009e52a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:59.553529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:59.607928 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f3adc-732a-4aba-af87-756a1009e52a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:59.644757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc366a6-628d-4172-b40f-f97f7c4a90a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:59.645576 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc366a6-628d-4172-b40f-f97f7c4a90a4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:59.645861 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc366a6-628d-4172-b40f-f97f7c4a90a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:59.646137 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc366a6-628d-4172-b40f-f97f7c4a90a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:59.646895 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc366a6-628d-4172-b40f-f97f7c4a90a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:19:59.647202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc366a6-628d-4172-b40f-f97f7c4a90a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:59.648591 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc366a6-628d-4172-b40f-f97f7c4a90a4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:59.661854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 433/867] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:19:59.667405 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fcabd-e99c-445e-98b0-ae1b5c1e0185 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:59.781800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fcabd-e99c-445e-98b0-ae1b5c1e0185 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:59.794349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:19:59.820896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4693b54-48bc-4cd7-aac3-d2458890254d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:19:59.821705 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4693b54-48bc-4cd7-aac3-d2458890254d None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:19:59.821993 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4693b54-48bc-4cd7-aac3-d2458890254d None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:19:59.822275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4693b54-48bc-4cd7-aac3-d2458890254d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:19:59.829575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4693b54-48bc-4cd7-aac3-d2458890254d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:19:59.831115 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4693b54-48bc-4cd7-aac3-d2458890254d None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:19:59.845531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-b4693b54-48bc-4cd7-aac3-d2458890254d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:59.845531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:19:59.845531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:19:59.845531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:19:59.845531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:19:59.845531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:19:59.845531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:19:59.845531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:19:59.845531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:19:59.845531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:19:59.845531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:19:59.845531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:19:59.845531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:19:59.845531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:19:59.845531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:19:59.846686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:19:59.846686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:19:59.846686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:19:59.846686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:19:59.846686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:19:59.846686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:19:59.846686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:19:59.846686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:19:59.846686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:19:59.846686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:19:59.846686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:19:59.846686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:19:59.846686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:19:59.846686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:19:59.846686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:19:59.846686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:19:59.846686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:19:59.847781 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:19:59.847781 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:19:59.847781 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:19:59.847781 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:19:59.847781 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:19:59.847781 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:19:59.847781 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:19:59.847781 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:19:59.850665 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 435/868] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:19:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:19:59.855584 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc366a6-628d-4172-b40f-f97f7c4a90a4 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:19:59.966651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc366a6-628d-4172-b40f-f97f7c4a90a4 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:19:59.976291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:00.002995 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96683d24-688e-4e70-a10f-bf216b380ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:00.003888 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96683d24-688e-4e70-a10f-bf216b380ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:00.004328 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96683d24-688e-4e70-a10f-bf216b380ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:00.004844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96683d24-688e-4e70-a10f-bf216b380ab1 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:00.005774 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96683d24-688e-4e70-a10f-bf216b380ab1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:00.006243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96683d24-688e-4e70-a10f-bf216b380ab1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:00.007871 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96683d24-688e-4e70-a10f-bf216b380ab1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:00.021207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 434/869] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:19:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:00.029572 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4693b54-48bc-4cd7-aac3-d2458890254d None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:00.145956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4693b54-48bc-4cd7-aac3-d2458890254d None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:00.181749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0439b3-112f-4972-b002-fe768f60521d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:00.182720 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0439b3-112f-4972-b002-fe768f60521d None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:00.183174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0439b3-112f-4972-b002-fe768f60521d None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:00.183622 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0439b3-112f-4972-b002-fe768f60521d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:00.184601 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0439b3-112f-4972-b002-fe768f60521d None admin] RBAC: Adding query filter params (role.id=3ae7c5e54e084ac4a1f94da93a667583, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=03ca1edc22174d258ddeda25407ee6ed) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:00.185073 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0439b3-112f-4972-b002-fe768f60521d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:00.186703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0439b3-112f-4972-b002-fe768f60521d None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:00.193514 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 436/870] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:20:00 2022] GET /identity/v3/role_assignments?user.id=03ca1edc22174d258ddeda25407ee6ed&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=3ae7c5e54e084ac4a1f94da93a667583 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:00.651450 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdd84f-c20e-46b6-ad1f-70ffb08c8eb1 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:00.651973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdd84f-c20e-46b6-ad1f-70ffb08c8eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:00.652050 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdd84f-c20e-46b6-ad1f-70ffb08c8eb1 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:00.653714 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 435/871] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:00.659012 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1429669-ba88-4908-a2a4-3cf8587f0697 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:00.659310 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1429669-ba88-4908-a2a4-3cf8587f0697 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:00.659595 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1429669-ba88-4908-a2a4-3cf8587f0697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:00.680604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-a1429669-ba88-4908-a2a4-3cf8587f0697 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:00.681798 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-a1429669-ba88-4908-a2a4-3cf8587f0697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:00.713109 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:00.758626 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 437/872] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:00.781174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdd84f-c20e-46b6-ad1f-70ffb08c8eb1 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:00.893048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdd84f-c20e-46b6-ad1f-70ffb08c8eb1 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:00.901575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa27d3-def9-4fcc-97cb-f9158dd51bf3 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:00.901813 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa27d3-def9-4fcc-97cb-f9158dd51bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:00.902080 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa27d3-def9-4fcc-97cb-f9158dd51bf3 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:00.904590 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 438/873] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:20:00.909160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617b462-7824-43a6-be7d-a256a96f0f3d None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:00.909458 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617b462-7824-43a6-be7d-a256a96f0f3d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:00.909738 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617b462-7824-43a6-be7d-a256a96f0f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:00.927827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-5617b462-7824-43a6-be7d-a256a96f0f3d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:00.929192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-5617b462-7824-43a6-be7d-a256a96f0f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:00.933941 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8870393-8362-4757-82f6-fbc904934d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:00.934804 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8870393-8362-4757-82f6-fbc904934d0b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:00.935094 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8870393-8362-4757-82f6-fbc904934d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:00.935372 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8870393-8362-4757-82f6-fbc904934d0b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:00.949849 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8870393-8362-4757-82f6-fbc904934d0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:20:00.961973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-e8870393-8362-4757-82f6-fbc904934d0b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:20:00.961973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:00.961973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:00.961973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:00.961973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:00.961973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:00.961973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:00.961973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:00.961973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:00.961973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:00.961973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:00.961973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:00.961973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:20:00.961973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:20:00.961973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:20:00.961973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:20:00.963013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:20:00.963013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:20:00.963013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:20:00.963013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:20:00.963013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:00.963013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:00.963013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:00.963013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:00.963013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:00.963013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:00.963013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:00.963013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:00.963013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:00.963013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:00.963013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:00.963013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:00.963834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:00.963834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:00.963834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:00.963834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:00.963834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:20:00.963834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:20:00.963834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:20:00.963834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:20:00.963834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:20:00.963834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:20:00.963834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:20:00.963834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:00.964466 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 436/874] 10.222.0.25 () {56 vars in 1120 bytes} [Mon May 23 12:20:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:00.971173 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8870393-8362-4757-82f6-fbc904934d0b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:01.006836 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 439/875] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:01.010600 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:01.028715 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617b462-7824-43a6-be7d-a256a96f0f3d None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:01.097266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8870393-8362-4757-82f6-fbc904934d0b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:01.141135 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5122d3-a406-40f9-97c5-2d824444d2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:01.142796 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5122d3-a406-40f9-97c5-2d824444d2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:01.143264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5122d3-a406-40f9-97c5-2d824444d2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:01.143983 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5122d3-a406-40f9-97c5-2d824444d2c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:01.145151 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5122d3-a406-40f9-97c5-2d824444d2c1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:01.145676 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5122d3-a406-40f9-97c5-2d824444d2c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:01.147880 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5122d3-a406-40f9-97c5-2d824444d2c1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:01.148465 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:01.155902 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617b462-7824-43a6-be7d-a256a96f0f3d None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:01.162486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 437/876] 10.222.0.25 () {56 vars in 1115 bytes} [Mon May 23 12:20:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:20:01.167922 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5122d3-a406-40f9-97c5-2d824444d2c1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:01.201910 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749b88e-dcc7-41fe-ae08-00518449d28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:01.202960 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749b88e-dcc7-41fe-ae08-00518449d28f None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:01.203704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749b88e-dcc7-41fe-ae08-00518449d28f None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:01.204252 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749b88e-dcc7-41fe-ae08-00518449d28f None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:01.205267 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749b88e-dcc7-41fe-ae08-00518449d28f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:01.207417 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749b88e-dcc7-41fe-ae08-00518449d28f None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:01.235059 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 440/877] 10.222.0.25 () {60 vars in 1141 bytes} [Mon May 23 12:20:01 2022] POST /identity/v3/services => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:20:01.282090 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:01.294613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5122d3-a406-40f9-97c5-2d824444d2c1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:01.340847 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893d654-9741-4f61-a3da-c13c1c90bb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:01.341655 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893d654-9741-4f61-a3da-c13c1c90bb47 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:01.341941 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893d654-9741-4f61-a3da-c13c1c90bb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:01.342216 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893d654-9741-4f61-a3da-c13c1c90bb47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:01.355027 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893d654-9741-4f61-a3da-c13c1c90bb47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:01.356788 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893d654-9741-4f61-a3da-c13c1c90bb47 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:01.376693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-1893d654-9741-4f61-a3da-c13c1c90bb47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:01.376693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:01.376693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:01.376693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:01.376693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:01.376693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:01.376693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:01.376693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:01.376693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:01.376693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:01.376693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:01.376693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:01.376693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:20:01.376693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:20:01.376693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:20:01.377646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:20:01.377646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:01.377646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:01.377646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:01.377646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:01.377646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:01.377646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:01.377646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:01.377646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:01.377646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:01.377646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:01.377646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:01.377646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:01.377646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:01.377646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:01.377646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:01.377646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:01.378555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:20:01.378555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:20:01.378555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:01.378555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:01.378555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 438/878] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:01.384234 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749b88e-dcc7-41fe-ae08-00518449d28f None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:01.502642 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749b88e-dcc7-41fe-ae08-00518449d28f None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:01.541845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245542f-5ee9-418f-8e9b-f3706da3679b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:01.542565 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245542f-5ee9-418f-8e9b-f3706da3679b None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:01.542856 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245542f-5ee9-418f-8e9b-f3706da3679b None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:01.543135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245542f-5ee9-418f-8e9b-f3706da3679b None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:01.543867 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245542f-5ee9-418f-8e9b-f3706da3679b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:01.544173 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245542f-5ee9-418f-8e9b-f3706da3679b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:01.545545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245542f-5ee9-418f-8e9b-f3706da3679b None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:01.558122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 441/879] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:01.563513 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893d654-9741-4f61-a3da-c13c1c90bb47 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:01.670066 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893d654-9741-4f61-a3da-c13c1c90bb47 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:01.710251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf24937-528a-4971-b464-a1948382f699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:01.711106 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf24937-528a-4971-b464-a1948382f699 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:01.711395 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf24937-528a-4971-b464-a1948382f699 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:01.711666 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf24937-528a-4971-b464-a1948382f699 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:01.719971 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf24937-528a-4971-b464-a1948382f699 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:01.721324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3fc48-0c78-4125-9f55-e690a5a7606a None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:01.721440 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf24937-528a-4971-b464-a1948382f699 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:01.721620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3fc48-0c78-4125-9f55-e690a5a7606a None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:01.721903 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3fc48-0c78-4125-9f55-e690a5a7606a None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:01.724115 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 442/880] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:01.725393 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:01.729163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547255f1-9ff3-404b-b00f-1f40c71f4adf None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:01.729455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547255f1-9ff3-404b-b00f-1f40c71f4adf None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:01.729738 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547255f1-9ff3-404b-b00f-1f40c71f4adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:01.740766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-3cf24937-528a-4971-b464-a1948382f699 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:20:01.740766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:01.740766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:01.740766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:01.740766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:01.740766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:01.740766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:01.740766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:01.740766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:01.740766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:01.740766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:01.740766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:01.740766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:20:01.740766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:20:01.740766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:20:01.740766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:20:01.741737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:01.741737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:01.741737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:20:01.741737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:20:01.741737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:20:01.741737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:20:01.741737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:01.741737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:01.741737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:01.741737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:01.741737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:01.741737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:01.741737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:01.741737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:01.741737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:01.741737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:01.741737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:01.741737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:01.742698 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:01.742698 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:01.742698 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:20:01.742698 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:20:01.742698 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:20:01.742698 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:20:01.742698 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:20:01.742698 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:20:01.742698 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:20:01.742698 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:01.742698 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 439/881] 10.222.0.25 () {56 vars in 1117 bytes} [Mon May 23 12:20:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:01.747456 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf24937-528a-4971-b464-a1948382f699 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:01.751580 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-547255f1-9ff3-404b-b00f-1f40c71f4adf None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:01.753099 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-547255f1-9ff3-404b-b00f-1f40c71f4adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:01.763978 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:01.831790 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 443/882] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:01 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:20:01.851257 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf24937-528a-4971-b464-a1948382f699 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:01.854840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547255f1-9ff3-404b-b00f-1f40c71f4adf None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:01.886467 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d811b-86ae-4b15-a387-9ebe9610871b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:01.887136 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d811b-86ae-4b15-a387-9ebe9610871b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:01.887422 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d811b-86ae-4b15-a387-9ebe9610871b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:01.887699 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d811b-86ae-4b15-a387-9ebe9610871b None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:01.888542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d811b-86ae-4b15-a387-9ebe9610871b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:01.888851 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d811b-86ae-4b15-a387-9ebe9610871b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:01.890292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d811b-86ae-4b15-a387-9ebe9610871b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:01.908930 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 440/883] 10.222.0.25 () {56 vars in 1149 bytes} [Mon May 23 12:20:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:01.914484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d811b-86ae-4b15-a387-9ebe9610871b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:01.968303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547255f1-9ff3-404b-b00f-1f40c71f4adf None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:01.972127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:02.012897 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d8e5c-45dc-43b4-b4f3-dab011e94e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:02.014302 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d8e5c-45dc-43b4-b4f3-dab011e94e22 None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:02.014808 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d8e5c-45dc-43b4-b4f3-dab011e94e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:02.015286 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d8e5c-45dc-43b4-b4f3-dab011e94e22 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:02.016204 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d8e5c-45dc-43b4-b4f3-dab011e94e22 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:02.018022 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d8e5c-45dc-43b4-b4f3-dab011e94e22 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:02.024174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d811b-86ae-4b15-a387-9ebe9610871b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:02.035483 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 444/884] 10.222.0.25 () {60 vars in 1141 bytes} [Mon May 23 12:20:01 2022] POST /identity/v3/services => generated 269 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:20:02.072398 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719357a-f090-4cdb-bd12-66ea0f47ccf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:02.073077 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719357a-f090-4cdb-bd12-66ea0f47ccf4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:02.073365 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719357a-f090-4cdb-bd12-66ea0f47ccf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:02.073641 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719357a-f090-4cdb-bd12-66ea0f47ccf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:02.159611 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719357a-f090-4cdb-bd12-66ea0f47ccf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:02.161664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719357a-f090-4cdb-bd12-66ea0f47ccf4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:02.222525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:02.271827 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 441/885] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:20:01 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 12:20:02.277308 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d8e5c-45dc-43b4-b4f3-dab011e94e22 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:02.282940 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:02.399615 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d8e5c-45dc-43b4-b4f3-dab011e94e22 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:02.438626 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52534310-1a2b-4677-8974-43bafbb66dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:02.439806 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52534310-1a2b-4677-8974-43bafbb66dce None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:02.440302 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52534310-1a2b-4677-8974-43bafbb66dce None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:02.440784 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52534310-1a2b-4677-8974-43bafbb66dce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:02.452973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52534310-1a2b-4677-8974-43bafbb66dce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:02.454743 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52534310-1a2b-4677-8974-43bafbb66dce None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:02.473178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-52534310-1a2b-4677-8974-43bafbb66dce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:02.473178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:02.473178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:02.473178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:02.473178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:02.473178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:02.473178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:02.473178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:02.473178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:02.473178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:02.473178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:02.473178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:02.473178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:20:02.473178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:20:02.473178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:20:02.474749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:20:02.474749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:02.474749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:02.474749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:02.474749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:02.474749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:02.474749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:02.474749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:02.474749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:02.474749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:02.474749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:02.474749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:02.474749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:02.474749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:02.474749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:02.474749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:02.474749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:02.475649 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:20:02.475649 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:20:02.475649 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:02.475649 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:02.477901 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 445/886] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:02.483339 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719357a-f090-4cdb-bd12-66ea0f47ccf4 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:02.542202 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6264f-b5d7-4e30-b675-6c0485c4056a None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:02.542942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6264f-b5d7-4e30-b675-6c0485c4056a None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:02.543432 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6264f-b5d7-4e30-b675-6c0485c4056a None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:02.545353 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 446/887] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:20:02.550095 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828805d-4ddf-4741-86c9-0ed954d9abd4 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:02.550383 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828805d-4ddf-4741-86c9-0ed954d9abd4 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:02.550695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828805d-4ddf-4741-86c9-0ed954d9abd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:02.568695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-9828805d-4ddf-4741-86c9-0ed954d9abd4 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:02.569882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-9828805d-4ddf-4741-86c9-0ed954d9abd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:02.596157 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719357a-f090-4cdb-bd12-66ea0f47ccf4 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:02.640383 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:02.645592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185517a-53f4-415d-af1e-917676e732e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:02.646286 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185517a-53f4-415d-af1e-917676e732e8 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:02.646601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185517a-53f4-415d-af1e-917676e732e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:02.646860 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185517a-53f4-415d-af1e-917676e732e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:02.647592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185517a-53f4-415d-af1e-917676e732e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:02.649544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185517a-53f4-415d-af1e-917676e732e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:02.649544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185517a-53f4-415d-af1e-917676e732e8 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:02.662543 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 442/888] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:02.667487 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185517a-53f4-415d-af1e-917676e732e8 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:02.674539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 447/889] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:20:02.689978 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:02.695230 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828805d-4ddf-4741-86c9-0ed954d9abd4 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:02.784095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185517a-53f4-415d-af1e-917676e732e8 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:02.811053 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828805d-4ddf-4741-86c9-0ed954d9abd4 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:02.820337 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17f296-b225-41b3-b4e7-78ae2e3dea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:02.821185 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17f296-b225-41b3-b4e7-78ae2e3dea7b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:02.821471 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17f296-b225-41b3-b4e7-78ae2e3dea7b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:02.821748 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17f296-b225-41b3-b4e7-78ae2e3dea7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:02.829306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17f296-b225-41b3-b4e7-78ae2e3dea7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:02.830832 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17f296-b225-41b3-b4e7-78ae2e3dea7b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:02.846181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-ca17f296-b225-41b3-b4e7-78ae2e3dea7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:20:02.846181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:02.846181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:02.846181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:02.846181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:02.846181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:02.846181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:02.846181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:02.846181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:02.846181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:02.846181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:02.846181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:02.846181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:20:02.846181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:20:02.846181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:20:02.847147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:20:02.847147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:02.847147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:02.847147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:02.847147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:02.847147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:02.847147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:02.847147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:02.847147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:02.847147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:02.847147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:02.847147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:02.847147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:02.847147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:02.847147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:02.847147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:02.847147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:02.848070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:20:02.848070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:20:02.848070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:20:02.848070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:20:02.848070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:20:02.848070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:20:02.848070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:20:02.848070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:02.848070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 443/890] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:20:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:02.854018 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17f296-b225-41b3-b4e7-78ae2e3dea7b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:02.868026 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dbe59-9d9e-49a4-9f72-fd9e322482e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:02.869429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dbe59-9d9e-49a4-9f72-fd9e322482e1 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:02.870023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dbe59-9d9e-49a4-9f72-fd9e322482e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:02.870671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dbe59-9d9e-49a4-9f72-fd9e322482e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:02.871763 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dbe59-9d9e-49a4-9f72-fd9e322482e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:02.873585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dbe59-9d9e-49a4-9f72-fd9e322482e1 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:02.888620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-6e0dbe59-9d9e-49a4-9f72-fd9e322482e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:20:02.888620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:02.888620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:20:02.888620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:20:02.888620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:20:02.888620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:20:02.888620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:20:02.888620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:02.888620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:20:02.888620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:02.888620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:20:02.888620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:02.888620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:02.888620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:02.888620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:02.888620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:02.888620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:02.889704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:02.889704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:02.889704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:02.889704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:02.889704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:02.889704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:02.889704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:20:02.889704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:20:02.889704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:20:02.889704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:20:02.889704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:02.889704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:02.889704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:02.889704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:02.889704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:02.889704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:02.890968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:02.890968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:02.890968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:02.890968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:02.890968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:02.890968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:02.890968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:02.890968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:02.890968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:02.890968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:02.890968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:20:02.890968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:02.890968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:20:02.890968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:02.893552 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 448/891] 10.222.0.25 () {56 vars in 1126 bytes} [Mon May 23 12:20:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:02.902007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dbe59-9d9e-49a4-9f72-fd9e322482e1 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:02.952077 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:02.967058 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:02.994350 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17f296-b225-41b3-b4e7-78ae2e3dea7b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:03.037441 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dbe59-9d9e-49a4-9f72-fd9e322482e1 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:03.039718 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183505c-108e-481f-9ed9-a571d05ef84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:03.040568 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183505c-108e-481f-9ed9-a571d05ef84a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:03.041010 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183505c-108e-481f-9ed9-a571d05ef84a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:03.041546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183505c-108e-481f-9ed9-a571d05ef84a None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:03.042525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183505c-108e-481f-9ed9-a571d05ef84a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:03.043035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183505c-108e-481f-9ed9-a571d05ef84a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:03.044662 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183505c-108e-481f-9ed9-a571d05ef84a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:03.058021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 444/892] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:20:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:20:03.064065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183505c-108e-481f-9ed9-a571d05ef84a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:03.088228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08cae1-e135-425a-bb5d-fa1c772206d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:03.089084 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08cae1-e135-425a-bb5d-fa1c772206d6 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:03.089433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08cae1-e135-425a-bb5d-fa1c772206d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:03.089909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08cae1-e135-425a-bb5d-fa1c772206d6 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:03.090990 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08cae1-e135-425a-bb5d-fa1c772206d6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:03.091689 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08cae1-e135-425a-bb5d-fa1c772206d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:03.094099 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08cae1-e135-425a-bb5d-fa1c772206d6 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:03.105200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 449/893] 10.222.0.25 () {56 vars in 1122 bytes} [Mon May 23 12:20:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:03.106247 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08cae1-e135-425a-bb5d-fa1c772206d6 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:03.194010 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183505c-108e-481f-9ed9-a571d05ef84a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:03.215500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08cae1-e135-425a-bb5d-fa1c772206d6 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:03.227912 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:03.231921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:03.234920 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb785e2-621e-47b6-9684-818587674cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:03.236152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb785e2-621e-47b6-9684-818587674cff None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:03.236637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb785e2-621e-47b6-9684-818587674cff None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:03.237287 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb785e2-621e-47b6-9684-818587674cff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:03.238450 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb785e2-621e-47b6-9684-818587674cff None admin] RBAC: Adding query filter params (role.id=66df182349134f17825bf29c92d8c87b, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=eb30fc9bc5a04139b2a364ff03f4ad60) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:03.239045 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb785e2-621e-47b6-9684-818587674cff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:03.240710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb785e2-621e-47b6-9684-818587674cff None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:03.247955 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 445/894] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:20:03 2022] GET /identity/v3/role_assignments?user.id=eb30fc9bc5a04139b2a364ff03f4ad60&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=66df182349134f17825bf29c92d8c87b => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:03.261532 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04376f84-0e9b-4518-b72d-3272ee4292b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:03.262239 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04376f84-0e9b-4518-b72d-3272ee4292b8 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:03.262621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04376f84-0e9b-4518-b72d-3272ee4292b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:03.262909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04376f84-0e9b-4518-b72d-3272ee4292b8 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:03.263705 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04376f84-0e9b-4518-b72d-3272ee4292b8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:03.264019 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04376f84-0e9b-4518-b72d-3272ee4292b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:03.265612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04376f84-0e9b-4518-b72d-3272ee4292b8 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:03.272826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 450/895] 10.222.0.25 () {56 vars in 1122 bytes} [Mon May 23 12:20:03 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:20:03.710597 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b26a92-9da7-4f04-8bcd-2d9978f6532d None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:03.711612 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b26a92-9da7-4f04-8bcd-2d9978f6532d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:03.712101 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b26a92-9da7-4f04-8bcd-2d9978f6532d None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:03.714053 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 446/896] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:03.719767 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d77d9a-493c-488e-a514-ce95565464fc None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:03.720202 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d77d9a-493c-488e-a514-ce95565464fc None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:03.720377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d77d9a-493c-488e-a514-ce95565464fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:03.737979 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-c9d77d9a-493c-488e-a514-ce95565464fc None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:03.740086 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-c9d77d9a-493c-488e-a514-ce95565464fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:03.822611 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 451/897] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:03.840421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b26a92-9da7-4f04-8bcd-2d9978f6532d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:03.947436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b26a92-9da7-4f04-8bcd-2d9978f6532d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:03.983087 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1955b8f-f9e4-4890-9188-8dd70c0f1165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:03.984212 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1955b8f-f9e4-4890-9188-8dd70c0f1165 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:03.984690 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1955b8f-f9e4-4890-9188-8dd70c0f1165 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:03.985177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1955b8f-f9e4-4890-9188-8dd70c0f1165 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:03.986024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1955b8f-f9e4-4890-9188-8dd70c0f1165 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:03.987651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1955b8f-f9e4-4890-9188-8dd70c0f1165 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:04.000434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-b1955b8f-f9e4-4890-9188-8dd70c0f1165 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 12:20:04.000434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:04.000434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:20:04.000434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:20:04.000434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:20:04.000434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:20:04.000434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:20:04.000434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:04.000434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 12:20:04.000434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:04.000434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:20:04.000434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:04.000434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:04.000434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:04.000434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:04.000434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:04.000434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:04.001474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:04.001474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:04.001474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:04.001474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:04.001474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:04.001474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:04.001474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:20:04.001474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:20:04.001474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:20:04.001474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:20:04.001474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:04.001474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:04.001474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:04.001474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:04.001474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:04.001474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:04.002305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:04.002305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:04.002305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:04.002305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:04.002305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:04.002305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:04.002305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:04.002305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:04.002305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:04.002305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:04.002305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:20:04.002305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:04.002305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 12:20:04.002305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:04.010408 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 447/898] 10.222.0.25 () {56 vars in 1114 bytes} [Mon May 23 12:20:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:04.012050 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d77d9a-493c-488e-a514-ce95565464fc None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:04.127194 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d77d9a-493c-488e-a514-ce95565464fc None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:04.138113 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:04.165949 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8e20d-cf89-486d-95eb-1f14ce6c04e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:04.167027 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8e20d-cf89-486d-95eb-1f14ce6c04e7 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:04.167512 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8e20d-cf89-486d-95eb-1f14ce6c04e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:04.167983 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8e20d-cf89-486d-95eb-1f14ce6c04e7 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:04.168902 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8e20d-cf89-486d-95eb-1f14ce6c04e7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:04.169430 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8e20d-cf89-486d-95eb-1f14ce6c04e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:04.171020 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8e20d-cf89-486d-95eb-1f14ce6c04e7 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:04.176059 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 452/899] 10.222.0.25 () {56 vars in 1114 bytes} [Mon May 23 12:20:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:20:04.182528 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1955b8f-f9e4-4890-9188-8dd70c0f1165 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:04.247669 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:04.289676 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1955b8f-f9e4-4890-9188-8dd70c0f1165 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:04.323222 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec0bc2-39f9-46eb-990f-4ed70c09f47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:04.323886 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec0bc2-39f9-46eb-990f-4ed70c09f47b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:04.324170 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec0bc2-39f9-46eb-990f-4ed70c09f47b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:04.324445 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec0bc2-39f9-46eb-990f-4ed70c09f47b None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:04.325142 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec0bc2-39f9-46eb-990f-4ed70c09f47b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:04.325445 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec0bc2-39f9-46eb-990f-4ed70c09f47b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:04.326853 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec0bc2-39f9-46eb-990f-4ed70c09f47b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:04.336608 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 448/900] 10.222.0.25 () {56 vars in 1114 bytes} [Mon May 23 12:20:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:04.337935 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8e20d-cf89-486d-95eb-1f14ce6c04e7 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:04.427386 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22941f5-ad73-4c5c-b9c6-acf03382bbca None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:04.427702 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22941f5-ad73-4c5c-b9c6-acf03382bbca None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:04.427942 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22941f5-ad73-4c5c-b9c6-acf03382bbca None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:04.429665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 449/901] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:04.438341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4e874-8bb1-45f8-8c05-368afdaea8b2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:04.438688 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4e874-8bb1-45f8-8c05-368afdaea8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:04.438935 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4e874-8bb1-45f8-8c05-368afdaea8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:04.446076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8e20d-cf89-486d-95eb-1f14ce6c04e7 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:04.455727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-26b4e874-8bb1-45f8-8c05-368afdaea8b2 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:04.456932 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-26b4e874-8bb1-45f8-8c05-368afdaea8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:04.493911 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf25eed-e980-45d4-af29-e99ef1d7f025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:04.495032 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf25eed-e980-45d4-af29-e99ef1d7f025 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:04.495680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf25eed-e980-45d4-af29-e99ef1d7f025 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:04.496177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf25eed-e980-45d4-af29-e99ef1d7f025 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:04.498493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf25eed-e980-45d4-af29-e99ef1d7f025 None admin] RBAC: Adding query filter params (interface=public, service_id=41c872352aa94b9ba30038e02d91e438, region_id=RegionOne) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:04.499069 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf25eed-e980-45d4-af29-e99ef1d7f025 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:04.500662 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf25eed-e980-45d4-af29-e99ef1d7f025 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:04.508687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 453/902] 10.222.0.25 () {56 vars in 1251 bytes} [Mon May 23 12:20:04 2022] GET /identity/v3/endpoints?service_id=41c872352aa94b9ba30038e02d91e438&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:04.514348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf25eed-e980-45d4-af29-e99ef1d7f025 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:04.538662 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 450/903] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:20:04.556005 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:04.557818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4e874-8bb1-45f8-8c05-368afdaea8b2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:04.619978 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:04.645692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf25eed-e980-45d4-af29-e99ef1d7f025 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:04.669400 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4e874-8bb1-45f8-8c05-368afdaea8b2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:04.691658 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795eaa47-ab8e-48f3-9585-b876b57dfa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:04.693249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795eaa47-ab8e-48f3-9585-b876b57dfa26 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:04.693755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795eaa47-ab8e-48f3-9585-b876b57dfa26 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:04.694480 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795eaa47-ab8e-48f3-9585-b876b57dfa26 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:04.695638 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795eaa47-ab8e-48f3-9585-b876b57dfa26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:04.697914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795eaa47-ab8e-48f3-9585-b876b57dfa26 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:04.705536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 454/904] 10.222.0.25 () {56 vars in 1087 bytes} [Mon May 23 12:20:04 2022] GET /identity/v3/services => generated 1268 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:20:04.714544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa83d2-ed1c-4439-8240-90697dc874f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:04.714544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa83d2-ed1c-4439-8240-90697dc874f1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:04.714544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa83d2-ed1c-4439-8240-90697dc874f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:04.714544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa83d2-ed1c-4439-8240-90697dc874f1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:04.715312 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa83d2-ed1c-4439-8240-90697dc874f1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:04.715312 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa83d2-ed1c-4439-8240-90697dc874f1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:04.727954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-09aa83d2-ed1c-4439-8240-90697dc874f1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 12:20:04.727954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:04.727954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:20:04.727954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:20:04.727954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:20:04.727954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:20:04.727954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:20:04.727954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:04.727954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 12:20:04.727954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:04.727954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:20:04.727954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:04.727954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:04.727954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:04.727954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:04.727954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:04.729000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:04.729000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:04.729000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:04.729000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:04.729000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:04.729000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:04.729000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:04.729000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:20:04.729000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:20:04.729000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:20:04.729000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:20:04.729000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:04.729000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:04.729000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:04.729000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:04.729000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:04.729825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:04.729825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:04.729825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:04.729825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:04.729825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:04.729825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:04.729825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:04.729825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:04.729825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:04.729825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:04.729825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:04.729825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:20:04.729825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:04.729825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 12:20:04.729825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:04.729825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 451/905] 10.222.0.25 () {56 vars in 1132 bytes} [Mon May 23 12:20:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:04.736307 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795eaa47-ab8e-48f3-9585-b876b57dfa26 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:04.853039 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795eaa47-ab8e-48f3-9585-b876b57dfa26 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:04.870908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:04.892242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5e174-6261-4e7d-afa8-4f3bc5761d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:04.892913 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5e174-6261-4e7d-afa8-4f3bc5761d58 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:04.893199 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5e174-6261-4e7d-afa8-4f3bc5761d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:04.893482 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5e174-6261-4e7d-afa8-4f3bc5761d58 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:04.894192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5e174-6261-4e7d-afa8-4f3bc5761d58 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:04.894511 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5e174-6261-4e7d-afa8-4f3bc5761d58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:04.896451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5e174-6261-4e7d-afa8-4f3bc5761d58 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:04.901678 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 455/906] 10.222.0.25 () {56 vars in 1126 bytes} [Mon May 23 12:20:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:04.907050 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa83d2-ed1c-4439-8240-90697dc874f1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:05.014094 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa83d2-ed1c-4439-8240-90697dc874f1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:05.032002 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:05.050913 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca86e72-2518-444d-9006-b5061ae32182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:05.052262 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca86e72-2518-444d-9006-b5061ae32182 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:05.052552 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca86e72-2518-444d-9006-b5061ae32182 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:05.052831 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca86e72-2518-444d-9006-b5061ae32182 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:05.053545 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca86e72-2518-444d-9006-b5061ae32182 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:05.053854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca86e72-2518-444d-9006-b5061ae32182 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:05.055271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca86e72-2518-444d-9006-b5061ae32182 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:05.060677 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 452/907] 10.222.0.25 () {56 vars in 1126 bytes} [Mon May 23 12:20:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:20:05.066327 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5e174-6261-4e7d-afa8-4f3bc5761d58 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:05.178173 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5e174-6261-4e7d-afa8-4f3bc5761d58 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:05.221114 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74237dea-87e6-4d39-81ce-00cbc575fff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:05.221793 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74237dea-87e6-4d39-81ce-00cbc575fff9 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:05.222079 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74237dea-87e6-4d39-81ce-00cbc575fff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:05.222359 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74237dea-87e6-4d39-81ce-00cbc575fff9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:05.223258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74237dea-87e6-4d39-81ce-00cbc575fff9 None admin] RBAC: Adding query filter params (interface=public, service_id=59cd2fa7b8af475abe9dacf79e43643f, region_id=RegionOne) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:05.224083 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74237dea-87e6-4d39-81ce-00cbc575fff9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:05.225511 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74237dea-87e6-4d39-81ce-00cbc575fff9 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:05.232616 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 456/908] 10.222.0.25 () {56 vars in 1251 bytes} [Mon May 23 12:20:05 2022] GET /identity/v3/endpoints?service_id=59cd2fa7b8af475abe9dacf79e43643f&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:05.238101 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca86e72-2518-444d-9006-b5061ae32182 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:05.350070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca86e72-2518-444d-9006-b5061ae32182 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:05.387377 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ab3c3-a387-4fc7-92cb-3bf2f6ae25b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:05.388071 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ab3c3-a387-4fc7-92cb-3bf2f6ae25b2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:05.388355 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ab3c3-a387-4fc7-92cb-3bf2f6ae25b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:05.388632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ab3c3-a387-4fc7-92cb-3bf2f6ae25b2 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:05.389335 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ab3c3-a387-4fc7-92cb-3bf2f6ae25b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:05.390820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ab3c3-a387-4fc7-92cb-3bf2f6ae25b2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:05.398613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 453/909] 10.222.0.25 () {56 vars in 1087 bytes} [Mon May 23 12:20:05 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:20:05.598754 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6a906-5931-4ff3-9c9a-6bc68918bf4d None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:05.599052 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6a906-5931-4ff3-9c9a-6bc68918bf4d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:05.599357 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6a906-5931-4ff3-9c9a-6bc68918bf4d None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:05.601048 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 457/910] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:05.606948 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1856cea-0f2d-4e71-a33c-234de8d02aef None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:05.607237 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1856cea-0f2d-4e71-a33c-234de8d02aef None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:05.607516 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1856cea-0f2d-4e71-a33c-234de8d02aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:05.628457 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d1856cea-0f2d-4e71-a33c-234de8d02aef None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:05.630197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d1856cea-0f2d-4e71-a33c-234de8d02aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:05.651701 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce0292-b851-4763-a055-efbb91ed46f9 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:05.652013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce0292-b851-4763-a055-efbb91ed46f9 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:05.652271 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce0292-b851-4763-a055-efbb91ed46f9 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:05.653879 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 458/911] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:05.658747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410cd94-1659-4a2f-a248-11a831ef6237 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:05.659041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410cd94-1659-4a2f-a248-11a831ef6237 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:05.659326 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410cd94-1659-4a2f-a248-11a831ef6237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:05.675674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:05.676192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-7410cd94-1659-4a2f-a248-11a831ef6237 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:05.677474 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-7410cd94-1659-4a2f-a248-11a831ef6237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:05.703433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 454/912] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:05.703614 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:05.726577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1856cea-0f2d-4e71-a33c-234de8d02aef None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:05.758034 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 459/913] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:20:05.780187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410cd94-1659-4a2f-a248-11a831ef6237 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:05.854038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1856cea-0f2d-4e71-a33c-234de8d02aef None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:05.891638 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410cd94-1659-4a2f-a248-11a831ef6237 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:05.899894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186c18e-15bc-4de1-99be-db2a70a6dc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:05.901375 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186c18e-15bc-4de1-99be-db2a70a6dc18 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:05.901819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186c18e-15bc-4de1-99be-db2a70a6dc18 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:05.902270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186c18e-15bc-4de1-99be-db2a70a6dc18 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:05.917248 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6186c18e-15bc-4de1-99be-db2a70a6dc18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:20:05.929168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-6186c18e-15bc-4de1-99be-db2a70a6dc18 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:20:05.929168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:05.929168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:05.929168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:05.929168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:05.929168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:05.929168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:05.929168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:05.929168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:05.929168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:05.929168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:05.929168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:05.929168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:20:05.929168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:20:05.929168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:20:05.929168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:20:05.930362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:20:05.930362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:20:05.930362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:20:05.930362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:20:05.930362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:05.930362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:05.930362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:05.930362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:05.930362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:05.930362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:05.930362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:05.930362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:05.930362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:05.930362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:05.930362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:05.930362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:05.931436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:05.931436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:05.931436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:05.931436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:05.931436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:20:05.931436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:20:05.931436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:20:05.931436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:20:05.931436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:20:05.931436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:20:05.931436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:20:05.931436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:05.933966 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80246097-b8d4-4025-b22f-4788d479007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:05.934162 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 455/914] 10.222.0.25 () {56 vars in 1120 bytes} [Mon May 23 12:20:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:20:05.942837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80246097-b8d4-4025-b22f-4788d479007d None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:05.942837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80246097-b8d4-4025-b22f-4788d479007d None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:05.942837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80246097-b8d4-4025-b22f-4788d479007d None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:05.942837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80246097-b8d4-4025-b22f-4788d479007d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:05.942837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80246097-b8d4-4025-b22f-4788d479007d None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:05.943246 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186c18e-15bc-4de1-99be-db2a70a6dc18 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:05.963660 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 460/915] 10.222.0.25 () {60 vars in 1141 bytes} [Mon May 23 12:20:05 2022] POST /identity/v3/services => generated 241 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:20:05.978198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:06.062645 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186c18e-15bc-4de1-99be-db2a70a6dc18 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:06.108525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c37402-4d6d-4e63-bfdc-a4024f5d5451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:06.109127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c37402-4d6d-4e63-bfdc-a4024f5d5451 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:06.109413 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c37402-4d6d-4e63-bfdc-a4024f5d5451 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:06.109688 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c37402-4d6d-4e63-bfdc-a4024f5d5451 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:06.110452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c37402-4d6d-4e63-bfdc-a4024f5d5451 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:06.110800 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c37402-4d6d-4e63-bfdc-a4024f5d5451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:06.114971 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c37402-4d6d-4e63-bfdc-a4024f5d5451 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:06.122074 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 456/916] 10.222.0.25 () {56 vars in 1115 bytes} [Mon May 23 12:20:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:06.127772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80246097-b8d4-4025-b22f-4788d479007d None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:06.149267 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:06.244321 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80246097-b8d4-4025-b22f-4788d479007d None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:06.279563 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2559051-91ec-4100-89e3-dc8207d88893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:06.280670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2559051-91ec-4100-89e3-dc8207d88893 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:06.281098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2559051-91ec-4100-89e3-dc8207d88893 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:06.281518 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2559051-91ec-4100-89e3-dc8207d88893 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:06.292800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2559051-91ec-4100-89e3-dc8207d88893 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:06.294445 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2559051-91ec-4100-89e3-dc8207d88893 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:06.312444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-a2559051-91ec-4100-89e3-dc8207d88893 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:06.312444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:06.312444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:06.312444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:06.312444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:06.312444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:06.312444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:06.312444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:06.312444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:06.312444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:06.312444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:06.312444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:06.312444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:20:06.312444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:20:06.312444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:20:06.313545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:20:06.313545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:06.313545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:06.313545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:06.313545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:06.313545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:06.313545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:06.313545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:06.313545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:06.313545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:06.313545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:06.313545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:06.313545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:06.313545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:06.313545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:06.313545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:06.313545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:06.314680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:20:06.314680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:20:06.314680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:06.314680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:06.320899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 461/917] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:06.322383 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c37402-4d6d-4e63-bfdc-a4024f5d5451 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:06.419479 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:06.426963 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c37402-4d6d-4e63-bfdc-a4024f5d5451 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:06.467025 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07fc9d-35b4-4c51-8b9f-e2baa6e12cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:06.467710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07fc9d-35b4-4c51-8b9f-e2baa6e12cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:06.468044 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07fc9d-35b4-4c51-8b9f-e2baa6e12cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:06.468330 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07fc9d-35b4-4c51-8b9f-e2baa6e12cb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:06.469066 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07fc9d-35b4-4c51-8b9f-e2baa6e12cb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:06.469375 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07fc9d-35b4-4c51-8b9f-e2baa6e12cb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:06.470826 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07fc9d-35b4-4c51-8b9f-e2baa6e12cb4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:06.484583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 457/918] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:06.490712 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2559051-91ec-4100-89e3-dc8207d88893 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:06.565783 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:06.599377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2559051-91ec-4100-89e3-dc8207d88893 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:06.637023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12107777-19cf-498b-9e3f-a4cb82e86570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:06.637847 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12107777-19cf-498b-9e3f-a4cb82e86570 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:06.638130 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12107777-19cf-498b-9e3f-a4cb82e86570 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:06.638407 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12107777-19cf-498b-9e3f-a4cb82e86570 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:06.647573 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12107777-19cf-498b-9e3f-a4cb82e86570 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:06.649046 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12107777-19cf-498b-9e3f-a4cb82e86570 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:06.664210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-12107777-19cf-498b-9e3f-a4cb82e86570 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:20:06.664210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:06.664210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:06.664210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:06.664210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:06.664210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:06.664210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:06.664210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:06.664210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:06.664210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:06.664210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:06.664210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:06.664210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:20:06.664210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:20:06.664210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:20:06.664210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:20:06.665189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:06.665189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:06.665189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:20:06.665189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:20:06.665189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:20:06.665189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:20:06.665189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:06.665189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:06.665189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:06.665189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:06.665189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:06.665189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:06.665189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:06.665189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:06.665189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:06.665189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:06.665189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:06.665189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:06.666132 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:06.666132 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:06.666132 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:20:06.666132 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:20:06.666132 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:20:06.666132 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:20:06.666132 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:20:06.666132 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:20:06.666132 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:20:06.666132 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:06.670168 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 462/919] 10.222.0.25 () {56 vars in 1117 bytes} [Mon May 23 12:20:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:06.671597 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07fc9d-35b4-4c51-8b9f-e2baa6e12cb4 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:06.785304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07fc9d-35b4-4c51-8b9f-e2baa6e12cb4 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:06.824179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636b6e0-c868-4ed2-b717-0dc20bbeab28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:06.825091 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636b6e0-c868-4ed2-b717-0dc20bbeab28 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:06.825591 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636b6e0-c868-4ed2-b717-0dc20bbeab28 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:06.826074 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636b6e0-c868-4ed2-b717-0dc20bbeab28 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:06.827848 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636b6e0-c868-4ed2-b717-0dc20bbeab28 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:06.828412 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636b6e0-c868-4ed2-b717-0dc20bbeab28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:06.831163 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636b6e0-c868-4ed2-b717-0dc20bbeab28 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:06.855581 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 458/920] 10.222.0.25 () {56 vars in 1149 bytes} [Mon May 23 12:20:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:06.861561 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12107777-19cf-498b-9e3f-a4cb82e86570 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:06.971886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12107777-19cf-498b-9e3f-a4cb82e86570 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:07.001820 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:07.008272 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50709917-1a55-4e67-970c-607029f5b379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:07.009073 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50709917-1a55-4e67-970c-607029f5b379 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:07.009406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50709917-1a55-4e67-970c-607029f5b379 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:07.009687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50709917-1a55-4e67-970c-607029f5b379 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:07.021744 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50709917-1a55-4e67-970c-607029f5b379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:07.023231 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50709917-1a55-4e67-970c-607029f5b379 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:07.041096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-50709917-1a55-4e67-970c-607029f5b379 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:07.041096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:07.041096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:07.041096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:07.041096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:07.041096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:07.041096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:07.041096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:07.041096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:07.041096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:07.041096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:07.041096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:07.041096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:20:07.041096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:20:07.041096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:20:07.042025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:20:07.042025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:07.042025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:07.042025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:07.042025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:07.042025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:07.042025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:07.042025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:07.042025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:07.042025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:07.042025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:07.042025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:07.042025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:07.042025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:07.042025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:07.042025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:07.042025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:07.042943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:20:07.042943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:20:07.042943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:07.042943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:07.046748 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 463/921] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:07.048278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636b6e0-c868-4ed2-b717-0dc20bbeab28 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:07.065918 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dd3cc-7c37-4706-b188-60d8df805918 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:07.066402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dd3cc-7c37-4706-b188-60d8df805918 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:07.067037 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dd3cc-7c37-4706-b188-60d8df805918 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:07.068929 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 464/922] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:07.075387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3f557-9f20-47fe-a702-91537cc23045 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:07.075699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3f557-9f20-47fe-a702-91537cc23045 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:07.076022 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3f557-9f20-47fe-a702-91537cc23045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:07.077132 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:07.099663 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-8ca3f557-9f20-47fe-a702-91537cc23045 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:07.102047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-8ca3f557-9f20-47fe-a702-91537cc23045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:07.214540 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636b6e0-c868-4ed2-b717-0dc20bbeab28 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:07.215334 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 465/923] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:20:07.235086 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3f557-9f20-47fe-a702-91537cc23045 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:07.253100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df9bac-7b8a-47ca-88ce-8ff233915fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:07.253754 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df9bac-7b8a-47ca-88ce-8ff233915fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:07.254038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df9bac-7b8a-47ca-88ce-8ff233915fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:07.254850 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df9bac-7b8a-47ca-88ce-8ff233915fd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:07.255876 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df9bac-7b8a-47ca-88ce-8ff233915fd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:07.256183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df9bac-7b8a-47ca-88ce-8ff233915fd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:07.257857 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df9bac-7b8a-47ca-88ce-8ff233915fd1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:07.278611 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 459/924] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:07.280929 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df9bac-7b8a-47ca-88ce-8ff233915fd1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:07.353864 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3f557-9f20-47fe-a702-91537cc23045 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:07.356759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:07.373591 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:07.390284 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df9bac-7b8a-47ca-88ce-8ff233915fd1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:07.398692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2173f-fdb6-4e0a-aee0-c30250c6e709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:07.399795 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2173f-fdb6-4e0a-aee0-c30250c6e709 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:07.400345 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2173f-fdb6-4e0a-aee0-c30250c6e709 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:07.400817 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2173f-fdb6-4e0a-aee0-c30250c6e709 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:07.401778 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2173f-fdb6-4e0a-aee0-c30250c6e709 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:07.404124 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2173f-fdb6-4e0a-aee0-c30250c6e709 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:07.418870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-dbb2173f-fdb6-4e0a-aee0-c30250c6e709 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 12:20:07.418870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:07.418870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:20:07.418870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:20:07.418870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:20:07.418870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:20:07.418870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:20:07.418870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:07.418870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 12:20:07.418870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:07.418870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:20:07.418870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:07.418870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:07.418870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:07.418870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:07.418870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:07.418870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:07.419955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:07.419955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:07.419955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:07.419955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:07.419955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:07.419955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:07.419955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:20:07.419955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:20:07.419955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:20:07.419955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:20:07.419955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:07.419955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:07.419955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:07.419955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:07.419955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:07.419955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:07.420792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:07.420792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:07.420792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:07.420792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:07.420792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:07.420792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:07.420792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:07.420792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:07.420792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:07.420792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:07.420792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:20:07.420792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:07.420792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 12:20:07.420792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:07.429269 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93594867-9d22-4c0b-97c7-84fa26605547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:07.429269 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93594867-9d22-4c0b-97c7-84fa26605547 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:07.429269 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93594867-9d22-4c0b-97c7-84fa26605547 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:07.429269 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93594867-9d22-4c0b-97c7-84fa26605547 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:07.430069 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 466/925] 10.222.0.25 () {56 vars in 1114 bytes} [Mon May 23 12:20:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:07.431654 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2173f-fdb6-4e0a-aee0-c30250c6e709 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:07.436993 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93594867-9d22-4c0b-97c7-84fa26605547 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:07.438616 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93594867-9d22-4c0b-97c7-84fa26605547 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:07.453332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-93594867-9d22-4c0b-97c7-84fa26605547 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:20:07.453332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:07.453332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:07.453332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:07.453332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:07.453332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:07.453332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:07.453332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:07.453332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:07.453332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:07.453332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:07.453332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:07.453332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:20:07.453332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:20:07.453332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:20:07.454291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:20:07.454291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:07.454291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:07.454291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:07.454291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:07.454291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:07.454291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:07.454291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:07.454291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:07.454291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:07.454291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:07.454291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:07.454291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:07.454291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:07.454291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:07.454291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:07.454291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:07.455240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:20:07.455240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:20:07.455240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:20:07.455240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:20:07.455240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:20:07.455240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:20:07.455240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:20:07.455240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:07.455240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 460/926] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:20:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:07.460961 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93594867-9d22-4c0b-97c7-84fa26605547 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:07.554624 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2173f-fdb6-4e0a-aee0-c30250c6e709 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:07.567962 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93594867-9d22-4c0b-97c7-84fa26605547 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:07.594167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13452d5e-c6ef-494d-a602-06c1e097584c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:07.595304 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13452d5e-c6ef-494d-a602-06c1e097584c None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:07.595817 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13452d5e-c6ef-494d-a602-06c1e097584c None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:07.596305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13452d5e-c6ef-494d-a602-06c1e097584c None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:07.597263 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13452d5e-c6ef-494d-a602-06c1e097584c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:07.597823 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13452d5e-c6ef-494d-a602-06c1e097584c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:07.600065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13452d5e-c6ef-494d-a602-06c1e097584c None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:07.607036 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 467/927] 10.222.0.25 () {56 vars in 1114 bytes} [Mon May 23 12:20:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:07.608241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12045d-e7d4-4ea0-87ad-6bad7fa8ee34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:07.608935 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12045d-e7d4-4ea0-87ad-6bad7fa8ee34 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:07.609220 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12045d-e7d4-4ea0-87ad-6bad7fa8ee34 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:07.609497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12045d-e7d4-4ea0-87ad-6bad7fa8ee34 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:07.610311 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12045d-e7d4-4ea0-87ad-6bad7fa8ee34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:07.614560 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12045d-e7d4-4ea0-87ad-6bad7fa8ee34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:07.614560 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12045d-e7d4-4ea0-87ad-6bad7fa8ee34 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:07.614560 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:07.615939 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13452d5e-c6ef-494d-a602-06c1e097584c None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:07.633501 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 461/928] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:20:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:07.635254 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12045d-e7d4-4ea0-87ad-6bad7fa8ee34 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:07.668825 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:07.743275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13452d5e-c6ef-494d-a602-06c1e097584c None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:07.775090 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12045d-e7d4-4ea0-87ad-6bad7fa8ee34 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:07.781033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfbfb8-0562-463f-99d7-89b75f06322d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:07.781914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfbfb8-0562-463f-99d7-89b75f06322d None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:07.782346 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfbfb8-0562-463f-99d7-89b75f06322d None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:07.782828 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfbfb8-0562-463f-99d7-89b75f06322d None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:07.783756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfbfb8-0562-463f-99d7-89b75f06322d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:07.784263 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfbfb8-0562-463f-99d7-89b75f06322d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:07.786868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfbfb8-0562-463f-99d7-89b75f06322d None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:07.793351 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 468/929] 10.222.0.25 () {56 vars in 1114 bytes} [Mon May 23 12:20:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:07.796737 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2014e47-6281-4e47-b58b-687c118ba380 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:07.797036 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2014e47-6281-4e47-b58b-687c118ba380 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:07.797322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2014e47-6281-4e47-b58b-687c118ba380 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:07.798864 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 469/930] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:07.799375 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2014e47-6281-4e47-b58b-687c118ba380 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:07.818405 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e91978-98aa-46d2-b31e-0470571fee71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:07.819399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e91978-98aa-46d2-b31e-0470571fee71 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:07.819601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e91978-98aa-46d2-b31e-0470571fee71 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:07.819862 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e91978-98aa-46d2-b31e-0470571fee71 None admin] PATH_INFO: `/v3/projects/402397b981be4f0c9e778a2771c41937/users/eb30fc9bc5a04139b2a364ff03f4ad60/roles/66df182349134f17825bf29c92d8c87b` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:07.822137 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e91978-98aa-46d2-b31e-0470571fee71 None admin] RBAC: Authorizing `identity:create_grant(project_id=402397b981be4f0c9e778a2771c41937, user_id=eb30fc9bc5a04139b2a364ff03f4ad60, role_id=66df182349134f17825bf29c92d8c87b)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:07.823691 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e91978-98aa-46d2-b31e-0470571fee71 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:07.846603 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 462/931] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:20:07 2022] PUT /identity/v3/projects/402397b981be4f0c9e778a2771c41937/users/eb30fc9bc5a04139b2a364ff03f4ad60/roles/66df182349134f17825bf29c92d8c87b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:20:07.849290 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3bbd0-33c1-4a03-af86-8b98aa35d0d3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:07.849884 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3bbd0-33c1-4a03-af86-8b98aa35d0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:07.850432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3bbd0-33c1-4a03-af86-8b98aa35d0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:07.871786 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-52e3bbd0-33c1-4a03-af86-8b98aa35d0d3 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:07.873674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-52e3bbd0-33c1-4a03-af86-8b98aa35d0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:07.932520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2014e47-6281-4e47-b58b-687c118ba380 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:07.934660 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:07.938889 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:07.963969 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 463/932] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:07.992363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3bbd0-33c1-4a03-af86-8b98aa35d0d3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:07.999749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd5a61-ae75-4658-baf7-01567bc0a2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:08.000913 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd5a61-ae75-4658-baf7-01567bc0a2d3 None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:08.001405 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd5a61-ae75-4658-baf7-01567bc0a2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:08.002606 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd5a61-ae75-4658-baf7-01567bc0a2d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:08.003685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd5a61-ae75-4658-baf7-01567bc0a2d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:08.006710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd5a61-ae75-4658-baf7-01567bc0a2d3 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:08.037394 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 470/933] 10.222.0.25 () {60 vars in 1144 bytes} [Mon May 23 12:20:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:20:08.147214 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3bbd0-33c1-4a03-af86-8b98aa35d0d3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:08.203751 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3398fd-4746-452f-adef-af41f94a8b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:08.205690 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3398fd-4746-452f-adef-af41f94a8b9d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:08.206356 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3398fd-4746-452f-adef-af41f94a8b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:08.206881 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3398fd-4746-452f-adef-af41f94a8b9d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:08.208349 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3398fd-4746-452f-adef-af41f94a8b9d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:08.210000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3398fd-4746-452f-adef-af41f94a8b9d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:08.224065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-5e3398fd-4746-452f-adef-af41f94a8b9d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 12:20:08.224065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:08.224065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:20:08.224065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:20:08.224065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:20:08.224065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:20:08.224065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:20:08.224065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:08.224065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 12:20:08.224065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:08.224065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:20:08.224065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:08.224065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:08.224065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:08.224065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:08.224065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:08.225067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:08.225067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:08.225067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:08.225067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:08.225067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:08.225067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:08.225067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:08.225067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:20:08.225067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:20:08.225067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:20:08.225067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:20:08.225067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:08.225067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:08.225067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:08.225067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:08.225067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:08.225902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:08.225902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:08.225902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:08.225902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:08.225902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:08.225902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:08.225902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:08.225902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:08.225902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:08.225902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:08.225902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:08.225902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:20:08.225902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:08.225902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 12:20:08.225902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:08.228964 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 464/934] 10.222.0.25 () {56 vars in 1132 bytes} [Mon May 23 12:20:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:20:08.235716 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd5a61-ae75-4658-baf7-01567bc0a2d3 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:08.363792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd5a61-ae75-4658-baf7-01567bc0a2d3 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:08.402990 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb937456-8b0f-458f-b15d-78c81cd99f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:08.403591 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb937456-8b0f-458f-b15d-78c81cd99f09 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:08.403875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb937456-8b0f-458f-b15d-78c81cd99f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:08.404150 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb937456-8b0f-458f-b15d-78c81cd99f09 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:08.404868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb937456-8b0f-458f-b15d-78c81cd99f09 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:08.405172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb937456-8b0f-458f-b15d-78c81cd99f09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:08.406687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb937456-8b0f-458f-b15d-78c81cd99f09 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:08.412559 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 471/935] 10.222.0.25 () {56 vars in 1126 bytes} [Mon May 23 12:20:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:08.419208 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3398fd-4746-452f-adef-af41f94a8b9d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:08.455569 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a963a-1afc-438e-953d-9368147131fc None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:08.456040 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a963a-1afc-438e-953d-9368147131fc None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:08.456420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a963a-1afc-438e-953d-9368147131fc None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:08.458255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 472/936] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:20:08.464209 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf3ec1-af23-4e30-b308-5461502b26d8 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:08.464635 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf3ec1-af23-4e30-b308-5461502b26d8 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:08.465016 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf3ec1-af23-4e30-b308-5461502b26d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:08.469697 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:08.484204 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-febf3ec1-af23-4e30-b308-5461502b26d8 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:08.485614 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-febf3ec1-af23-4e30-b308-5461502b26d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:08.510985 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:08.537032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3398fd-4746-452f-adef-af41f94a8b9d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:08.579147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f6c79-bfa4-47c7-8f48-8d21dd3e5b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:08.579818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f6c79-bfa4-47c7-8f48-8d21dd3e5b79 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:08.580098 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f6c79-bfa4-47c7-8f48-8d21dd3e5b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:08.580371 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f6c79-bfa4-47c7-8f48-8d21dd3e5b79 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:08.581088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f6c79-bfa4-47c7-8f48-8d21dd3e5b79 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:08.581390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f6c79-bfa4-47c7-8f48-8d21dd3e5b79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:08.583339 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f6c79-bfa4-47c7-8f48-8d21dd3e5b79 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:08.587678 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 473/937] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:20:08.591246 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 465/938] 10.222.0.25 () {56 vars in 1126 bytes} [Mon May 23 12:20:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:08.596737 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf3ec1-af23-4e30-b308-5461502b26d8 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:08.605698 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f6c79-bfa4-47c7-8f48-8d21dd3e5b79 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:08.703831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf3ec1-af23-4e30-b308-5461502b26d8 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:08.718133 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f6c79-bfa4-47c7-8f48-8d21dd3e5b79 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:08.726417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:08.742119 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a2250-ba3e-4cd6-bd19-cb5f3f5ed96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:08.742816 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a2250-ba3e-4cd6-bd19-cb5f3f5ed96b None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:08.743098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a2250-ba3e-4cd6-bd19-cb5f3f5ed96b None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:08.743375 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a2250-ba3e-4cd6-bd19-cb5f3f5ed96b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:08.744259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a2250-ba3e-4cd6-bd19-cb5f3f5ed96b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:08.745514 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a2250-ba3e-4cd6-bd19-cb5f3f5ed96b None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:08.760684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844ded5-45b8-4910-84ed-95dae7b0995c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:08.762137 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844ded5-45b8-4910-84ed-95dae7b0995c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:08.762588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844ded5-45b8-4910-84ed-95dae7b0995c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:08.763008 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844ded5-45b8-4910-84ed-95dae7b0995c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:08.763906 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844ded5-45b8-4910-84ed-95dae7b0995c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:08.765572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844ded5-45b8-4910-84ed-95dae7b0995c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:08.774876 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 474/939] 10.222.0.25 () {60 vars in 1144 bytes} [Mon May 23 12:20:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:20:08.779777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-f844ded5-45b8-4910-84ed-95dae7b0995c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:20:08.779777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:08.779777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:20:08.779777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:20:08.779777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:20:08.779777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:20:08.779777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:20:08.779777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:08.779777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:20:08.779777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:08.779777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:20:08.779777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:08.779777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:08.779777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:08.779777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:08.779777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:08.779777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:08.781037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:08.781037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:08.781037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:08.781037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:08.781037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:08.781037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:08.781037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:20:08.781037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:20:08.781037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:20:08.781037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:20:08.781037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:08.781037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:08.781037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:08.781037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:08.781037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:08.781037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:08.781916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:08.781916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:08.781916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:08.781916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:08.781916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:08.781916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:08.781916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:08.781916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:08.781916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:08.781916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:08.781916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:20:08.781916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:08.781916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:20:08.781916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:08.790345 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 466/940] 10.222.0.25 () {56 vars in 1126 bytes} [Mon May 23 12:20:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:20:08.791671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a2250-ba3e-4cd6-bd19-cb5f3f5ed96b None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:08.838918 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:08.922909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a2250-ba3e-4cd6-bd19-cb5f3f5ed96b None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:08.962286 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf14fe0-eae9-408e-a052-8fb848a11502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:08.962923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf14fe0-eae9-408e-a052-8fb848a11502 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:08.963181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf14fe0-eae9-408e-a052-8fb848a11502 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:08.963456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf14fe0-eae9-408e-a052-8fb848a11502 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:08.964170 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf14fe0-eae9-408e-a052-8fb848a11502 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:08.964471 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf14fe0-eae9-408e-a052-8fb848a11502 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:08.965860 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf14fe0-eae9-408e-a052-8fb848a11502 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:08.971528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 475/941] 10.222.0.25 () {56 vars in 1122 bytes} [Mon May 23 12:20:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:20:08.977559 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844ded5-45b8-4910-84ed-95dae7b0995c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:09.086868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844ded5-45b8-4910-84ed-95dae7b0995c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:09.124309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a438cdc-c69e-48d4-bf7a-81d7065a9f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:09.124977 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a438cdc-c69e-48d4-bf7a-81d7065a9f38 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:09.125259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a438cdc-c69e-48d4-bf7a-81d7065a9f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:09.125536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a438cdc-c69e-48d4-bf7a-81d7065a9f38 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:09.126244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a438cdc-c69e-48d4-bf7a-81d7065a9f38 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:09.126570 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a438cdc-c69e-48d4-bf7a-81d7065a9f38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:09.127947 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a438cdc-c69e-48d4-bf7a-81d7065a9f38 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:09.133544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 467/942] 10.222.0.25 () {56 vars in 1122 bytes} [Mon May 23 12:20:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:09.139416 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf14fe0-eae9-408e-a052-8fb848a11502 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:09.214838 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:09.249528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf14fe0-eae9-408e-a052-8fb848a11502 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:09.287715 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9f4ed-cb89-4c0b-9dfb-3711d70cea73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:09.288377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9f4ed-cb89-4c0b-9dfb-3711d70cea73 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:09.288661 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9f4ed-cb89-4c0b-9dfb-3711d70cea73 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:09.288938 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9f4ed-cb89-4c0b-9dfb-3711d70cea73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:09.289728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9f4ed-cb89-4c0b-9dfb-3711d70cea73 None admin] RBAC: Adding query filter params (interface=public, service_id=4b9975c60b85400daa0e67c02f43e867, region_id=RegionOne) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:09.290039 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9f4ed-cb89-4c0b-9dfb-3711d70cea73 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:09.291426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9f4ed-cb89-4c0b-9dfb-3711d70cea73 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:09.296964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 476/943] 10.222.0.25 () {56 vars in 1251 bytes} [Mon May 23 12:20:09 2022] GET /identity/v3/endpoints?service_id=4b9975c60b85400daa0e67c02f43e867&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:09.302912 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a438cdc-c69e-48d4-bf7a-81d7065a9f38 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:09.338850 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:09.405588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a438cdc-c69e-48d4-bf7a-81d7065a9f38 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:09.443416 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bddec-e716-426d-a163-51cbbf0a3fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:09.444079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bddec-e716-426d-a163-51cbbf0a3fae None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:09.444360 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bddec-e716-426d-a163-51cbbf0a3fae None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:09.444631 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bddec-e716-426d-a163-51cbbf0a3fae None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:09.445308 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bddec-e716-426d-a163-51cbbf0a3fae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:09.446709 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bddec-e716-426d-a163-51cbbf0a3fae None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:09.453097 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 468/944] 10.222.0.25 () {56 vars in 1087 bytes} [Mon May 23 12:20:09 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:20:10.241557 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a6f89-d75f-40c0-ab0b-7c95ab1306d6 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:10.242096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a6f89-d75f-40c0-ab0b-7c95ab1306d6 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:10.242174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a6f89-d75f-40c0-ab0b-7c95ab1306d6 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:10.243792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 477/945] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:10.249184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee6fb9-713e-4c16-8d5c-379d007d06b5 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:10.250035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee6fb9-713e-4c16-8d5c-379d007d06b5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:10.250533 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee6fb9-713e-4c16-8d5c-379d007d06b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:10.268380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1bee6fb9-713e-4c16-8d5c-379d007d06b5 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:10.270575 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1bee6fb9-713e-4c16-8d5c-379d007d06b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:10.340907 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 469/946] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:10.363982 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a6f89-d75f-40c0-ab0b-7c95ab1306d6 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:10.377452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb614cd-b289-44ff-bd32-2db771921c52 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:10.377747 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb614cd-b289-44ff-bd32-2db771921c52 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:10.378012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb614cd-b289-44ff-bd32-2db771921c52 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:10.381002 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 470/947] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:10.386180 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a2ba3-5599-4dd3-88a2-149c2e9302c0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:10.386659 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a2ba3-5599-4dd3-88a2-149c2e9302c0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:10.387080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a2ba3-5599-4dd3-88a2-149c2e9302c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:10.404221 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-dc1a2ba3-5599-4dd3-88a2-149c2e9302c0 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:10.405702 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-dc1a2ba3-5599-4dd3-88a2-149c2e9302c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:10.430153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:10.476321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 471/948] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:10.484164 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a6f89-d75f-40c0-ab0b-7c95ab1306d6 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:10.500491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a2ba3-5599-4dd3-88a2-149c2e9302c0 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:10.525383 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b5345-c3b0-44f5-8dbf-edaa7779ff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:10.526570 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5345-c3b0-44f5-8dbf-edaa7779ff00 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:10.527455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5345-c3b0-44f5-8dbf-edaa7779ff00 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:10.528090 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5345-c3b0-44f5-8dbf-edaa7779ff00 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:10.530893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:10.543909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b5345-c3b0-44f5-8dbf-edaa7779ff00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:20:10.554413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-6a5b5345-c3b0-44f5-8dbf-edaa7779ff00 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:20:10.554413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:10.554413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:10.554413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:10.554413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:10.554413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:10.554413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:10.554413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:10.554413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:10.554413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:10.554413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:10.554413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:10.554413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:20:10.554413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:20:10.554413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:20:10.554413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:20:10.555402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:20:10.555402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:20:10.555402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:20:10.555402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:20:10.555402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:10.555402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:10.555402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:10.555402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:10.555402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:10.555402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:10.555402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:10.555402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:10.555402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:10.555402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:10.555402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:10.555402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:10.556228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:10.556228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:10.556228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:10.556228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:10.556228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:20:10.556228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:20:10.556228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:20:10.556228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:20:10.556228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:20:10.556228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:20:10.556228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:20:10.556228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:10.560457 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 478/949] 10.222.0.25 () {56 vars in 1120 bytes} [Mon May 23 12:20:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:10.567015 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b5345-c3b0-44f5-8dbf-edaa7779ff00 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:10.625973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a2ba3-5599-4dd3-88a2-149c2e9302c0 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:10.664344 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf229654-d840-4992-a33c-f6993254eed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:10.665517 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf229654-d840-4992-a33c-f6993254eed6 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:10.665998 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf229654-d840-4992-a33c-f6993254eed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:10.666490 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf229654-d840-4992-a33c-f6993254eed6 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:10.667458 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf229654-d840-4992-a33c-f6993254eed6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:10.669348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf229654-d840-4992-a33c-f6993254eed6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:10.671038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: WARNING keystone.server.flask.common [None req-bf229654-d840-4992-a33c-f6993254eed6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 23 12:20:10.678089 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b5345-c3b0-44f5-8dbf-edaa7779ff00 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:10.689907 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.sql.core [None req-bf229654-d840-4992-a33c-f6993254eed6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 12:20:10.689907 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 23 12:20:10.689907 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [parameters: {'id': '1442968cff0a4e72845e31a0616d2d31', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 23 12:20:10.689907 dv-cinder-836996-27-smb devstack@keystone.service[80198]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80198) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 12:20:10.709270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-bf229654-d840-4992-a33c-f6993254eed6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1442968cff0a4e72845e31a0616d2d31.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1442968cff0a4e72845e31a0616d2d31. May 23 12:20:10.709270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:10.709270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 12:20:10.709270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 12:20:10.709270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 12:20:10.709270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 12:20:10.709270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 12:20:10.709270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application result = self._query(query) May 23 12:20:10.709270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 12:20:10.709270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application conn.query(q) May 23 12:20:10.709270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 12:20:10.709270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 12:20:10.709270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 12:20:10.710195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application result.read() May 23 12:20:10.710195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 12:20:10.710195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 12:20:10.710195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 12:20:10.710195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 12:20:10.710195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 12:20:10.710195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 12:20:10.710195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 12:20:10.710195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 12:20:10.710195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 12:20:10.710195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:10.710195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 12:20:10.710195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:10.710195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:10.710195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 12:20:10.710195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 12:20:10.710195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 23 12:20:10.710195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return project_ref.to_dict() May 23 12:20:10.711179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 12:20:10.711179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application next(self.gen) May 23 12:20:10.711179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 12:20:10.711179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application yield resource May 23 12:20:10.711179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 12:20:10.711179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application next(self.gen) May 23 12:20:10.711179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 12:20:10.711179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self.session.rollback() May 23 12:20:10.711179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 12:20:10.711179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self.force_reraise() May 23 12:20:10.711179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 12:20:10.711179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise self.value May 23 12:20:10.711179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 12:20:10.711179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 12:20:10.711179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 12:20:10.711179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application session.commit() May 23 12:20:10.711179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 12:20:10.712057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 12:20:10.712057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 12:20:10.712057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._prepare_impl() May 23 12:20:10.712057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 12:20:10.712057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self.session.flush() May 23 12:20:10.712057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 12:20:10.712057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._flush(objects) May 23 12:20:10.712057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 12:20:10.712057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 12:20:10.712057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 12:20:10.712057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application compat.raise_( May 23 12:20:10.712057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 12:20:10.712057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception May 23 12:20:10.712057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 12:20:10.712057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application flush_context.execute() May 23 12:20:10.712057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 12:20:10.712057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rec.execute(self) May 23 12:20:10.713894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 12:20:10.713894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 12:20:10.713894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 12:20:10.713894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 12:20:10.713894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 23 12:20:10.713894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application c = connection._execute_20( May 23 12:20:10.713894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 12:20:10.713894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 12:20:10.713894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 12:20:10.713894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 12:20:10.713894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 12:20:10.713894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 12:20:10.713894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 12:20:10.713894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 12:20:10.713894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 12:20:10.719309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 12:20:10.719309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 12:20:10.719309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception May 23 12:20:10.719309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 12:20:10.719309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 12:20:10.719309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 12:20:10.719309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 12:20:10.719309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 12:20:10.719309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application result = self._query(query) May 23 12:20:10.719309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 12:20:10.719309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application conn.query(q) May 23 12:20:10.719309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 12:20:10.719309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 12:20:10.719309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 12:20:10.719309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application result.read() May 23 12:20:10.719309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 12:20:10.719309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 12:20:10.720361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 12:20:10.720361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 12:20:10.720361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 12:20:10.720361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 12:20:10.720361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 12:20:10.720361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 12:20:10.720361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 12:20:10.720361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 23 12:20:10.720361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [parameters: {'id': '1442968cff0a4e72845e31a0616d2d31', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 23 12:20:10.720361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 12:20:10.720361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:10.720361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:20:10.720361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:10.720361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:10.720361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 23 12:20:10.721318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 23 12:20:10.721318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 12:20:10.721318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 12:20:10.721318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 23 12:20:10.721318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:10.721318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:20:10.721318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:10.721318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:10.721318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:10.721318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:10.721318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:10.721318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:10.721318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:10.721318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:10.721318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:10.721318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:10.721318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:10.722388 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:10.722388 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 23 12:20:10.722388 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 23 12:20:10.722388 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:10.722388 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:10.722388 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 23 12:20:10.722388 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.Conflict( May 23 12:20:10.722388 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1442968cff0a4e72845e31a0616d2d31. May 23 12:20:10.722388 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:10.722388 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 472/950] 10.222.0.25 () {60 vars in 1140 bytes} [Mon May 23 12:20:10 2022] POST /identity/v3/projects => generated 262 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:10.725469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf229654-d840-4992-a33c-f6993254eed6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:10.728743 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce643935-46a8-4306-88e3-105abadbf58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:10.729519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce643935-46a8-4306-88e3-105abadbf58e None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:10.729744 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce643935-46a8-4306-88e3-105abadbf58e None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:10.730085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce643935-46a8-4306-88e3-105abadbf58e None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:10.730868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce643935-46a8-4306-88e3-105abadbf58e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:10.731428 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce643935-46a8-4306-88e3-105abadbf58e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:10.732954 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce643935-46a8-4306-88e3-105abadbf58e None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:10.747197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:10.747411 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 479/951] 10.222.0.25 () {56 vars in 1115 bytes} [Mon May 23 12:20:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:10.749679 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce643935-46a8-4306-88e3-105abadbf58e None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:10.808099 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:10.852961 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf229654-d840-4992-a33c-f6993254eed6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:10.854184 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce643935-46a8-4306-88e3-105abadbf58e None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:10.891793 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccff531-fa6a-43d2-9c28-73e1a9073494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:10.892569 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccff531-fa6a-43d2-9c28-73e1a9073494 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:10.892853 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccff531-fa6a-43d2-9c28-73e1a9073494 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:10.893161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccff531-fa6a-43d2-9c28-73e1a9073494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:10.898628 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95532b3a-817d-42ba-a6cf-aef20f361595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:10.899703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95532b3a-817d-42ba-a6cf-aef20f361595 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:10.900182 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95532b3a-817d-42ba-a6cf-aef20f361595 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:10.901150 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95532b3a-817d-42ba-a6cf-aef20f361595 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:10.904526 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccff531-fa6a-43d2-9c28-73e1a9073494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:10.906029 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccff531-fa6a-43d2-9c28-73e1a9073494 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:10.910279 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95532b3a-817d-42ba-a6cf-aef20f361595 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:10.912770 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95532b3a-817d-42ba-a6cf-aef20f361595 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:10.923155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-2ccff531-fa6a-43d2-9c28-73e1a9073494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:10.923155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:10.923155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:10.923155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:10.923155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:10.923155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:10.923155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:10.923155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:10.923155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:10.923155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:10.923155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:10.923155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:10.923155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:20:10.923155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:20:10.923155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:20:10.924101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:20:10.924101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:10.924101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:10.924101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:10.924101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:10.924101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:10.924101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:10.924101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:10.924101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:10.924101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:10.924101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:10.924101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:10.924101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:10.924101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:10.924101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:10.924101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:10.924101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:10.925065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:20:10.925065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:20:10.925065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:10.925065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:10.929301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 480/952] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:20:10.930133 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccff531-fa6a-43d2-9c28-73e1a9073494 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:10.931689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-95532b3a-817d-42ba-a6cf-aef20f361595 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:20:10.931689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:10.931689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:10.931689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:10.931689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:10.931689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:10.931689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:10.931689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:10.931689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:10.931689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:10.931689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:10.931689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:10.931689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:20:10.931689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:20:10.931689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:20:10.932550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:20:10.932550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:10.932550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:10.932550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:10.932550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:10.932550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:10.932550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:10.932550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:10.932550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:10.932550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:10.932550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:10.932550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:10.932550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:10.932550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:10.932550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:10.932550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:10.932550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:10.933498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:20:10.933498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:20:10.933498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:20:10.933498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:20:10.933498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:20:10.933498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:20:10.933498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:20:10.933498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:10.942761 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 473/953] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:20:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:10.943664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95532b3a-817d-42ba-a6cf-aef20f361595 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:11.047397 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:11.050071 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccff531-fa6a-43d2-9c28-73e1a9073494 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:11.061158 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:11.075820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95532b3a-817d-42ba-a6cf-aef20f361595 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:11.090782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5560355-02da-40a2-b008-d49b51081889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:11.091828 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5560355-02da-40a2-b008-d49b51081889 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:11.092312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5560355-02da-40a2-b008-d49b51081889 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:11.092834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5560355-02da-40a2-b008-d49b51081889 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:11.093971 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5560355-02da-40a2-b008-d49b51081889 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:11.094476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5560355-02da-40a2-b008-d49b51081889 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:11.096089 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5560355-02da-40a2-b008-d49b51081889 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:11.110671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 481/954] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:11.117755 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217cf55-f138-4556-bbba-c304c2630339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:11.117755 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217cf55-f138-4556-bbba-c304c2630339 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:11.117755 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217cf55-f138-4556-bbba-c304c2630339 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:11.117755 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217cf55-f138-4556-bbba-c304c2630339 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:11.118101 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217cf55-f138-4556-bbba-c304c2630339 None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:11.118101 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217cf55-f138-4556-bbba-c304c2630339 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:11.119431 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5560355-02da-40a2-b008-d49b51081889 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:11.119553 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217cf55-f138-4556-bbba-c304c2630339 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:11.146529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 474/955] 10.222.0.25 () {56 vars in 1112 bytes} [Mon May 23 12:20:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:11.151123 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb551b-d532-426b-92bb-43c8df15f827 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:11.151293 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb551b-d532-426b-92bb-43c8df15f827 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:11.151482 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb551b-d532-426b-92bb-43c8df15f827 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:11.157305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 475/956] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:20:11.159382 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a5e8b-dab9-4f19-9f51-2842acd5b4d2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:11.159674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a5e8b-dab9-4f19-9f51-2842acd5b4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:11.159951 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a5e8b-dab9-4f19-9f51-2842acd5b4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:11.182380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-696a5e8b-dab9-4f19-9f51-2842acd5b4d2 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:11.185787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-696a5e8b-dab9-4f19-9f51-2842acd5b4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:11.246609 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5560355-02da-40a2-b008-d49b51081889 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:11.280168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 476/957] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:11.292736 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2786e38-f219-4887-8fec-f560d263916d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:11.293558 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2786e38-f219-4887-8fec-f560d263916d None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:11.293839 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2786e38-f219-4887-8fec-f560d263916d None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:11.294143 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2786e38-f219-4887-8fec-f560d263916d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:11.303628 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2786e38-f219-4887-8fec-f560d263916d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:11.304754 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a5e8b-dab9-4f19-9f51-2842acd5b4d2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:11.308388 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2786e38-f219-4887-8fec-f560d263916d None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:11.326420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-d2786e38-f219-4887-8fec-f560d263916d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:20:11.326420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:11.326420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:11.326420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:11.326420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:11.326420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:11.326420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:11.326420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:11.326420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:11.326420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:11.326420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:11.326420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:11.326420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:20:11.326420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:20:11.326420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:20:11.326420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:20:11.327453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:11.327453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:11.327453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:20:11.327453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:20:11.327453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:20:11.327453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:20:11.327453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:11.327453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:11.327453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:11.327453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:11.327453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:11.327453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:11.327453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:11.327453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:11.327453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:11.327453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:11.327453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:11.327453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:11.328398 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:11.328398 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:11.328398 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:20:11.328398 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:20:11.328398 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:20:11.328398 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:20:11.328398 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:20:11.328398 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:20:11.328398 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 12:20:11.328398 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:11.331324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 482/958] 10.222.0.25 () {56 vars in 1117 bytes} [Mon May 23 12:20:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:11.337479 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2786e38-f219-4887-8fec-f560d263916d None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:11.374194 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:11.386064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:11.434159 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a5e8b-dab9-4f19-9f51-2842acd5b4d2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:11.467310 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2786e38-f219-4887-8fec-f560d263916d None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:11.474590 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1738e-65e7-4cb6-89f5-4101340b9b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:11.475661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1738e-65e7-4cb6-89f5-4101340b9b69 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:11.476160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1738e-65e7-4cb6-89f5-4101340b9b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:11.477071 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1738e-65e7-4cb6-89f5-4101340b9b69 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:11.477966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1738e-65e7-4cb6-89f5-4101340b9b69 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:11.480394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1738e-65e7-4cb6-89f5-4101340b9b69 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:11.497079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-acb1738e-65e7-4cb6-89f5-4101340b9b69 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 12:20:11.497079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:11.497079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:20:11.497079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:20:11.497079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:20:11.497079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:20:11.497079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:20:11.497079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:11.497079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 12:20:11.497079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:11.497079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:20:11.497079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:11.497079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:11.497079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:11.497079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:11.497079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:11.497079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:11.498196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:11.498196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:11.498196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:11.498196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:11.498196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:11.498196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:11.498196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:20:11.498196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:20:11.498196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:20:11.498196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:20:11.498196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:11.498196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:11.498196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:11.498196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:11.498196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:11.498196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:11.499088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:11.499088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:11.499088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:11.499088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:11.499088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:11.499088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:11.499088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:11.499088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:11.499088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:11.499088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:11.499088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:20:11.499088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:11.499088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 12:20:11.499088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:11.500575 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 477/959] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:20:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:20:11.506540 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1738e-65e7-4cb6-89f5-4101340b9b69 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:11.514778 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4f659-7dcf-49e5-a7ad-112a888ceb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:11.515474 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4f659-7dcf-49e5-a7ad-112a888ceb1d None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:11.515759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4f659-7dcf-49e5-a7ad-112a888ceb1d None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:11.516035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4f659-7dcf-49e5-a7ad-112a888ceb1d None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:11.516896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4f659-7dcf-49e5-a7ad-112a888ceb1d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:11.517207 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4f659-7dcf-49e5-a7ad-112a888ceb1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:11.519572 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4f659-7dcf-49e5-a7ad-112a888ceb1d None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:11.548028 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 483/960] 10.222.0.25 () {56 vars in 1149 bytes} [Mon May 23 12:20:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:11.553466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4f659-7dcf-49e5-a7ad-112a888ceb1d None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:11.618660 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1738e-65e7-4cb6-89f5-4101340b9b69 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:11.647570 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:11.656603 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14548ee4-dfa3-4549-bce0-3d6b59b4f3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:11.657571 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14548ee4-dfa3-4549-bce0-3d6b59b4f3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:11.657853 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14548ee4-dfa3-4549-bce0-3d6b59b4f3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:11.658135 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14548ee4-dfa3-4549-bce0-3d6b59b4f3d9 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:11.659044 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14548ee4-dfa3-4549-bce0-3d6b59b4f3d9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:11.659379 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14548ee4-dfa3-4549-bce0-3d6b59b4f3d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:11.661303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14548ee4-dfa3-4549-bce0-3d6b59b4f3d9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:11.668464 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:11.671148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 478/961] 10.222.0.25 () {56 vars in 1112 bytes} [Mon May 23 12:20:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:20:11.672714 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14548ee4-dfa3-4549-bce0-3d6b59b4f3d9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:11.690826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4f659-7dcf-49e5-a7ad-112a888ceb1d None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:11.730306 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d7e26-4895-4722-bb4d-a564348decfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:11.731391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d7e26-4895-4722-bb4d-a564348decfe None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:11.731681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d7e26-4895-4722-bb4d-a564348decfe None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:11.731958 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d7e26-4895-4722-bb4d-a564348decfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:11.778486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14548ee4-dfa3-4549-bce0-3d6b59b4f3d9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:11.809909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d7e26-4895-4722-bb4d-a564348decfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:11.811411 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d7e26-4895-4722-bb4d-a564348decfe None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:11.813256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4909b7-b3b4-4093-878b-5a4040a6bb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:11.813920 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4909b7-b3b4-4093-878b-5a4040a6bb05 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:11.814208 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4909b7-b3b4-4093-878b-5a4040a6bb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:11.814488 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4909b7-b3b4-4093-878b-5a4040a6bb05 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:11.815225 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4909b7-b3b4-4093-878b-5a4040a6bb05 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:11.815533 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4909b7-b3b4-4093-878b-5a4040a6bb05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:11.817431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4909b7-b3b4-4093-878b-5a4040a6bb05 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:11.824281 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 479/962] 10.222.0.25 () {56 vars in 1112 bytes} [Mon May 23 12:20:11 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:11.825525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c781a-3172-4b1d-bf7e-ee5702d75169 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:11.825815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c781a-3172-4b1d-bf7e-ee5702d75169 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:11.826093 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c781a-3172-4b1d-bf7e-ee5702d75169 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:11.827447 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 480/963] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:11.840742 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78525ee3-1c1f-45c9-8ec3-849389918ebc None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:11.841306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78525ee3-1c1f-45c9-8ec3-849389918ebc None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:11.841734 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78525ee3-1c1f-45c9-8ec3-849389918ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:11.866488 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-78525ee3-1c1f-45c9-8ec3-849389918ebc None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:11.869264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-78525ee3-1c1f-45c9-8ec3-849389918ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:11.931763 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:11.936758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:11.962958 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 481/964] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:11.964027 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 484/965] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:20:11 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 12:20:11.971926 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78525ee3-1c1f-45c9-8ec3-849389918ebc None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:11.982696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d7e26-4895-4722-bb4d-a564348decfe None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:12.105195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78525ee3-1c1f-45c9-8ec3-849389918ebc None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:12.107567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d7e26-4895-4722-bb4d-a564348decfe None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:12.143301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4c2c2-9929-40fb-8d1a-93bc5507b627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:12.144383 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4c2c2-9929-40fb-8d1a-93bc5507b627 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:12.144890 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4c2c2-9929-40fb-8d1a-93bc5507b627 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:12.145354 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4c2c2-9929-40fb-8d1a-93bc5507b627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:12.158014 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4c2c2-9929-40fb-8d1a-93bc5507b627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:12.158913 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59f9ea-b693-4e73-966b-d3c9f986fa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:12.159912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59f9ea-b693-4e73-966b-d3c9f986fa15 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:12.160214 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4c2c2-9929-40fb-8d1a-93bc5507b627 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:12.160600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59f9ea-b693-4e73-966b-d3c9f986fa15 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:12.161229 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59f9ea-b693-4e73-966b-d3c9f986fa15 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:12.162066 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59f9ea-b693-4e73-966b-d3c9f986fa15 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:12.163671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59f9ea-b693-4e73-966b-d3c9f986fa15 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:12.177147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-1a59f9ea-b693-4e73-966b-d3c9f986fa15 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:20:12.177147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:12.177147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:20:12.177147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:20:12.177147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:20:12.177147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:20:12.177147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:20:12.177147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:12.177147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:20:12.177147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:12.177147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:20:12.177147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:12.177147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:12.177147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:12.177147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:12.177147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:12.177147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:12.178162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:12.178162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:12.178162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:12.178162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:12.178162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:12.178162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:12.178162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:20:12.178162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:20:12.178162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:20:12.178162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:20:12.178162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:12.178162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:12.178162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:12.178162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:12.178162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:12.178162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:12.179057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:12.179057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:12.179057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:12.179057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:12.179057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:12.179057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:12.179057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:12.179057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:12.179057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:12.179057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:12.179057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:20:12.179057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:12.179057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:20:12.179057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:12.180347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-ccd4c2c2-9929-40fb-8d1a-93bc5507b627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:12.180347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:12.180347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:12.180347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:12.180347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:12.180347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:12.180347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:12.180347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:12.180347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:12.180347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:12.180347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:12.180347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:12.180347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:20:12.180347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:20:12.180347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:20:12.190599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:20:12.190599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:12.190599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:12.190599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:12.190599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:12.190599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:12.190599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:12.190599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:12.190599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:12.190599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:12.190599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:12.190599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:12.190599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:12.190599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:12.190599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:12.190599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:12.190599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:12.193641 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:20:12.193641 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:20:12.193641 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:12.193641 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:12.193641 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 482/966] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:12.194299 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 485/967] 10.222.0.25 () {56 vars in 1126 bytes} [Mon May 23 12:20:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:20:12.194444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4c2c2-9929-40fb-8d1a-93bc5507b627 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:12.197045 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59f9ea-b693-4e73-966b-d3c9f986fa15 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:12.238380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:12.267739 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:12.312357 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4c2c2-9929-40fb-8d1a-93bc5507b627 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:12.323899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59f9ea-b693-4e73-966b-d3c9f986fa15 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:12.357593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774b230-bdaf-4bfd-b952-017a6d16bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:12.358674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774b230-bdaf-4bfd-b952-017a6d16bbcf None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:12.359186 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774b230-bdaf-4bfd-b952-017a6d16bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:12.359712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774b230-bdaf-4bfd-b952-017a6d16bbcf None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:12.360689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774b230-bdaf-4bfd-b952-017a6d16bbcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:12.361211 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774b230-bdaf-4bfd-b952-017a6d16bbcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:12.361649 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc0d05-de43-4645-9a1b-e899e5a76919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:12.362316 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc0d05-de43-4645-9a1b-e899e5a76919 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:12.362650 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc0d05-de43-4645-9a1b-e899e5a76919 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:12.362935 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc0d05-de43-4645-9a1b-e899e5a76919 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:12.363686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc0d05-de43-4645-9a1b-e899e5a76919 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:12.363984 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774b230-bdaf-4bfd-b952-017a6d16bbcf None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:12.364105 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc0d05-de43-4645-9a1b-e899e5a76919 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:12.365354 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc0d05-de43-4645-9a1b-e899e5a76919 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:12.375689 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 486/968] 10.222.0.25 () {56 vars in 1122 bytes} [Mon May 23 12:20:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:12.377283 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc0d05-de43-4645-9a1b-e899e5a76919 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:12.381867 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 483/969] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:20:12.387183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774b230-bdaf-4bfd-b952-017a6d16bbcf None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:12.492961 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc0d05-de43-4645-9a1b-e899e5a76919 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:12.497853 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:12.502910 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774b230-bdaf-4bfd-b952-017a6d16bbcf None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:12.509692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:12.532049 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2956b6-ac81-4cb7-ae20-953f0946ea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:12.532719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2956b6-ac81-4cb7-ae20-953f0946ea7b None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:12.533006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2956b6-ac81-4cb7-ae20-953f0946ea7b None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:12.533285 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2956b6-ac81-4cb7-ae20-953f0946ea7b None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:12.534108 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2956b6-ac81-4cb7-ae20-953f0946ea7b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:12.534421 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2956b6-ac81-4cb7-ae20-953f0946ea7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:12.535873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2956b6-ac81-4cb7-ae20-953f0946ea7b None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:12.546118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 487/970] 10.222.0.25 () {56 vars in 1122 bytes} [Mon May 23 12:20:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:12.547457 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2956b6-ac81-4cb7-ae20-953f0946ea7b None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:12.553264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6d93f-1c82-4535-9766-1004824f56f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:12.554069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6d93f-1c82-4535-9766-1004824f56f4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:12.554353 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6d93f-1c82-4535-9766-1004824f56f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:12.554662 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6d93f-1c82-4535-9766-1004824f56f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:12.562750 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6d93f-1c82-4535-9766-1004824f56f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:12.564542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6d93f-1c82-4535-9766-1004824f56f4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:12.583815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-48f6d93f-1c82-4535-9766-1004824f56f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:20:12.583815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:12.583815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:12.583815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:12.583815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:12.583815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:12.583815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:12.583815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:12.583815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:12.583815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:12.583815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:12.583815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:12.583815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:20:12.583815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:20:12.583815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:20:12.584759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:20:12.584759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:12.584759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:12.584759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:12.584759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:12.584759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:12.584759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:12.584759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:12.584759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:12.584759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:12.584759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:12.584759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:12.584759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:12.584759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:12.584759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:12.584759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:12.584759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:12.585661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:20:12.585661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:20:12.585661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:20:12.585661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:20:12.585661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:20:12.585661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:20:12.585661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:20:12.585661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:12.589986 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 484/971] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:20:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:12.590891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6d93f-1c82-4535-9766-1004824f56f4 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:12.679892 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2956b6-ac81-4cb7-ae20-953f0946ea7b None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:12.713664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6d93f-1c82-4535-9766-1004824f56f4 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:12.722862 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db575a3-f79f-4d69-a660-5f436cf33815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:12.723795 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db575a3-f79f-4d69-a660-5f436cf33815 None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:12.724319 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db575a3-f79f-4d69-a660-5f436cf33815 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:12.725138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db575a3-f79f-4d69-a660-5f436cf33815 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:12.726441 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db575a3-f79f-4d69-a660-5f436cf33815 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:12.728356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db575a3-f79f-4d69-a660-5f436cf33815 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:12.758814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 488/972] 10.222.0.25 () {60 vars in 1144 bytes} [Mon May 23 12:20:12 2022] POST /identity/v3/endpoints => generated 349 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:20:12.764942 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0e03a-8705-40c7-82f5-fd3b6df85f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:12.765612 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0e03a-8705-40c7-82f5-fd3b6df85f6d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:12.765897 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0e03a-8705-40c7-82f5-fd3b6df85f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:12.766170 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0e03a-8705-40c7-82f5-fd3b6df85f6d None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:12.767055 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0e03a-8705-40c7-82f5-fd3b6df85f6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:12.767371 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0e03a-8705-40c7-82f5-fd3b6df85f6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:12.768972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0e03a-8705-40c7-82f5-fd3b6df85f6d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:12.790268 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db575a3-f79f-4d69-a660-5f436cf33815 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:12.790748 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 485/973] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:20:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:12.835811 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:12.903364 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db575a3-f79f-4d69-a660-5f436cf33815 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:12.941413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d8fc3-b6cd-472c-ad98-c0ae6e8dbc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:12.942684 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d8fc3-b6cd-472c-ad98-c0ae6e8dbc0e None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:12.942969 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d8fc3-b6cd-472c-ad98-c0ae6e8dbc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:12.943242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d8fc3-b6cd-472c-ad98-c0ae6e8dbc0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:12.946525 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d8fc3-b6cd-472c-ad98-c0ae6e8dbc0e None admin] RBAC: Adding query filter params (role.id=66df182349134f17825bf29c92d8c87b, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=eb30fc9bc5a04139b2a364ff03f4ad60) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:12.946525 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d8fc3-b6cd-472c-ad98-c0ae6e8dbc0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:12.946525 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d8fc3-b6cd-472c-ad98-c0ae6e8dbc0e None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:12.952876 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 489/974] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:20:12 2022] GET /identity/v3/role_assignments?user.id=eb30fc9bc5a04139b2a364ff03f4ad60&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=66df182349134f17825bf29c92d8c87b => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:13.523455 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084e67d-e8e2-4e95-bd58-7e9482d167a3 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:13.523969 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084e67d-e8e2-4e95-bd58-7e9482d167a3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:13.523969 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084e67d-e8e2-4e95-bd58-7e9482d167a3 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:13.526844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 486/975] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:13.532589 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb9f4b-ed3e-40b9-ae90-891706384785 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:13.533027 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb9f4b-ed3e-40b9-ae90-891706384785 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:13.533135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb9f4b-ed3e-40b9-ae90-891706384785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:13.551647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-24bb9f4b-ed3e-40b9-ae90-891706384785 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:13.552850 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-24bb9f4b-ed3e-40b9-ae90-891706384785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:13.625529 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 490/976] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:13.650679 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084e67d-e8e2-4e95-bd58-7e9482d167a3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:13.668792 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:13.761848 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084e67d-e8e2-4e95-bd58-7e9482d167a3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:13.797262 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aeaf07-ac8b-4ca7-bab2-ccce40e68193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:13.797853 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeaf07-ac8b-4ca7-bab2-ccce40e68193 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:13.798139 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeaf07-ac8b-4ca7-bab2-ccce40e68193 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:13.798417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeaf07-ac8b-4ca7-bab2-ccce40e68193 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:13.799163 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aeaf07-ac8b-4ca7-bab2-ccce40e68193 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:13.800670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aeaf07-ac8b-4ca7-bab2-ccce40e68193 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:13.815950 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.sql.core [None req-60aeaf07-ac8b-4ca7-bab2-ccce40e68193 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 12:20:13.815950 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 23 12:20:13.815950 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [parameters: {'user_id': 'ae59d807f91c4d1e92e0e29d5172361e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 23 12:20:13.815950 dv-cinder-836996-27-smb devstack@keystone.service[80198]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80198) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 12:20:13.826830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-60aeaf07-ac8b-4ca7-bab2-ccce40e68193 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 23 12:20:13.826830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:13.826830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 12:20:13.826830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 12:20:13.826830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 12:20:13.826830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 12:20:13.826830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 12:20:13.826830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application result = self._query(query) May 23 12:20:13.826830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 12:20:13.826830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application conn.query(q) May 23 12:20:13.826830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 12:20:13.826830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 12:20:13.826830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 12:20:13.826830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application result.read() May 23 12:20:13.826830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 12:20:13.828819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 12:20:13.828819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 12:20:13.828819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 12:20:13.828819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 12:20:13.828819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 12:20:13.828819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 12:20:13.828819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 12:20:13.828819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 12:20:13.828819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:13.828819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 12:20:13.828819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:13.828819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:13.828819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 12:20:13.828819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 12:20:13.828819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 23 12:20:13.828819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 23 12:20:13.828819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 12:20:13.828819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application next(self.gen) May 23 12:20:13.831048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 12:20:13.831048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application yield resource May 23 12:20:13.831048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 12:20:13.831048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application next(self.gen) May 23 12:20:13.831048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 12:20:13.831048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self.session.rollback() May 23 12:20:13.831048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 12:20:13.831048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self.force_reraise() May 23 12:20:13.831048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 12:20:13.831048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise self.value May 23 12:20:13.831048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 12:20:13.831048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 12:20:13.831048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 12:20:13.831048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application session.commit() May 23 12:20:13.831048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 12:20:13.831048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 12:20:13.831048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 12:20:13.833169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._prepare_impl() May 23 12:20:13.833169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 12:20:13.833169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self.session.flush() May 23 12:20:13.833169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 12:20:13.833169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._flush(objects) May 23 12:20:13.833169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 12:20:13.833169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 12:20:13.833169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 12:20:13.833169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application compat.raise_( May 23 12:20:13.833169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 12:20:13.833169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception May 23 12:20:13.833169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 12:20:13.833169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application flush_context.execute() May 23 12:20:13.833169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 12:20:13.833169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rec.execute(self) May 23 12:20:13.833169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 12:20:13.833169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 12:20:13.835670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 12:20:13.835670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 12:20:13.835670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 23 12:20:13.835670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application result = connection._execute_20( May 23 12:20:13.835670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 12:20:13.835670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 12:20:13.835670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 12:20:13.835670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 12:20:13.835670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 12:20:13.835670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 12:20:13.835670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 12:20:13.835670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 12:20:13.835670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 12:20:13.835670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 12:20:13.835670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 12:20:13.835670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception May 23 12:20:13.839547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 12:20:13.839547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 12:20:13.839547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 12:20:13.839547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 12:20:13.839547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 12:20:13.839547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application result = self._query(query) May 23 12:20:13.839547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 12:20:13.839547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application conn.query(q) May 23 12:20:13.839547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 12:20:13.839547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 12:20:13.839547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 12:20:13.839547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application result.read() May 23 12:20:13.839547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 12:20:13.839547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 12:20:13.839547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 12:20:13.839547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 12:20:13.840426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 12:20:13.840426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 12:20:13.840426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 12:20:13.840426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 12:20:13.840426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 12:20:13.840426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 23 12:20:13.840426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ae59d807f91c4d1e92e0e29d5172361e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 23 12:20:13.840426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 12:20:13.840426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:13.840426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:20:13.840426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:13.840426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:13.840426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:13.840426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:13.840426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:13.841256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:13.841256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:13.841256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:13.841256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:13.841256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:13.841256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:13.841256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:13.841256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 23 12:20:13.841256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 23 12:20:13.841256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:13.841256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:13.841256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:20:13.841256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:20:13.841256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:20:13.841256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:20:13.841256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 23 12:20:13.841256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 23 12:20:13.842190 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 23 12:20:13.842190 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 23 12:20:13.842190 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 12:20:13.842190 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 12:20:13.842190 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 23 12:20:13.842190 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:13.842190 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 487/977] 10.222.0.25 () {60 vars in 1131 bytes} [Mon May 23 12:20:13 2022] POST /identity/v3/users => generated 160 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:13.842799 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb9f4b-ed3e-40b9-ae90-891706384785 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:13.879588 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:13.955006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb9f4b-ed3e-40b9-ae90-891706384785 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:13.993883 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8448ffb-7b07-4ce2-b15d-979f14220b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:13.995058 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8448ffb-7b07-4ce2-b15d-979f14220b60 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:13.995492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8448ffb-7b07-4ce2-b15d-979f14220b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:13.995920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8448ffb-7b07-4ce2-b15d-979f14220b60 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:14.003772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8448ffb-7b07-4ce2-b15d-979f14220b60 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:14.005456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8448ffb-7b07-4ce2-b15d-979f14220b60 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:14.020574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-e8448ffb-7b07-4ce2-b15d-979f14220b60 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 12:20:14.020574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:14.020574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:14.020574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:14.020574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:14.020574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:14.020574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:14.020574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:14.020574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:14.020574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:14.020574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:14.020574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:14.020574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:20:14.020574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:20:14.020574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:20:14.020574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:20:14.021724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:14.021724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:14.021724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:20:14.021724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:20:14.021724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:20:14.021724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:20:14.021724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:14.021724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:14.021724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:14.021724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:14.021724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:14.021724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:14.021724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:14.021724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:14.021724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:14.021724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:14.021724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:14.021724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:14.022927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:14.022927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:14.022927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:20:14.022927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:20:14.022927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:20:14.022927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:20:14.022927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:20:14.022927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:20:14.022927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 12:20:14.022927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:14.029574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 491/978] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:20:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:14.031358 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aeaf07-ac8b-4ca7-bab2-ccce40e68193 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:14.113918 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aaa55e-067d-48ec-9f56-c6c92e953190 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:14.114208 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aaa55e-067d-48ec-9f56-c6c92e953190 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:14.114495 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aaa55e-067d-48ec-9f56-c6c92e953190 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:14.116245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 492/979] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:14.117883 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:14.121897 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edf17d-d3ff-4cf0-9e8d-d48ace1b1ea5 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:14.122529 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edf17d-d3ff-4cf0-9e8d-d48ace1b1ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:14.123056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edf17d-d3ff-4cf0-9e8d-d48ace1b1ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:14.144261 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-42edf17d-d3ff-4cf0-9e8d-d48ace1b1ea5 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:14.146388 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-42edf17d-d3ff-4cf0-9e8d-d48ace1b1ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:14.154436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aeaf07-ac8b-4ca7-bab2-ccce40e68193 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:14.197400 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90a582-9524-4262-83fc-214bc968586b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:14.198236 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90a582-9524-4262-83fc-214bc968586b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:14.198548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90a582-9524-4262-83fc-214bc968586b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:14.198828 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90a582-9524-4262-83fc-214bc968586b None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:14.200094 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90a582-9524-4262-83fc-214bc968586b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:14.200460 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90a582-9524-4262-83fc-214bc968586b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:14.202383 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90a582-9524-4262-83fc-214bc968586b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:14.226766 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 493/980] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:14.245287 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edf17d-d3ff-4cf0-9e8d-d48ace1b1ea5 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:14.250617 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 488/981] 10.222.0.25 () {56 vars in 1101 bytes} [Mon May 23 12:20:14 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:14.273796 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:14.361331 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edf17d-d3ff-4cf0-9e8d-d48ace1b1ea5 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:14.405240 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c606c8-6542-4758-bd45-d6ecabe5a5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:14.405835 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c606c8-6542-4758-bd45-d6ecabe5a5b7 None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:14.406126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c606c8-6542-4758-bd45-d6ecabe5a5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:14.406402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c606c8-6542-4758-bd45-d6ecabe5a5b7 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:14.407164 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c606c8-6542-4758-bd45-d6ecabe5a5b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:14.408564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c606c8-6542-4758-bd45-d6ecabe5a5b7 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:14.425489 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 494/982] 10.222.0.25 () {60 vars in 1141 bytes} [Mon May 23 12:20:14 2022] POST /identity/v3/services => generated 242 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:20:15.119497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935cb32-191e-4a2d-a8e3-0d485a4b6c19 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:15.120020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935cb32-191e-4a2d-a8e3-0d485a4b6c19 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:15.120305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935cb32-191e-4a2d-a8e3-0d485a4b6c19 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:15.121688 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 489/983] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:15.126829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fba24e-b350-4131-b166-1962a598cc72 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:15.127219 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fba24e-b350-4131-b166-1962a598cc72 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:15.127405 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fba24e-b350-4131-b166-1962a598cc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:15.144121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-e9fba24e-b350-4131-b166-1962a598cc72 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:15.145829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e9fba24e-b350-4131-b166-1962a598cc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:15.221446 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726e11f-9b24-4285-8377-970b9744a378 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:15.221762 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726e11f-9b24-4285-8377-970b9744a378 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:15.222007 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726e11f-9b24-4285-8377-970b9744a378 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:15.224209 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 490/984] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:15.230545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 495/985] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:15.230703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af1eb2-4a80-435a-a07e-1ccde2431a6f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:15.230703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af1eb2-4a80-435a-a07e-1ccde2431a6f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:15.230703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af1eb2-4a80-435a-a07e-1ccde2431a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:15.246794 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-04af1eb2-4a80-435a-a07e-1ccde2431a6f None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:15.248560 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-04af1eb2-4a80-435a-a07e-1ccde2431a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:15.249007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fba24e-b350-4131-b166-1962a598cc72 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:15.253108 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:15.324758 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 491/986] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:20:15.346094 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af1eb2-4a80-435a-a07e-1ccde2431a6f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:15.356829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fba24e-b350-4131-b166-1962a598cc72 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:15.394277 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e3bb4-8833-492e-a8e2-d9bf597f0ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:15.395585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e3bb4-8833-492e-a8e2-d9bf597f0ddc None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:15.395874 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e3bb4-8833-492e-a8e2-d9bf597f0ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:15.396246 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e3bb4-8833-492e-a8e2-d9bf597f0ddc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:15.396884 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e3bb4-8833-492e-a8e2-d9bf597f0ddc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:15.398366 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e3bb4-8833-492e-a8e2-d9bf597f0ddc None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:15.410356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-2d0e3bb4-8833-492e-a8e2-d9bf597f0ddc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:20:15.410356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:15.410356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:20:15.410356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:20:15.410356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:20:15.410356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:20:15.410356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:20:15.410356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:15.410356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:20:15.410356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:15.410356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:20:15.410356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:15.410356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:15.410356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:15.410356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:15.410356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:15.410356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:15.411367 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:15.411367 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:15.411367 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:15.411367 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:15.411367 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:15.411367 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:15.411367 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:20:15.411367 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:20:15.411367 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:20:15.411367 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:20:15.411367 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:15.411367 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:15.411367 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:15.411367 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:15.411367 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:15.411367 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:15.412193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:15.412193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:15.412193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:15.412193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:15.412193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:15.412193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:15.412193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:15.412193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:15.412193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:15.412193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:15.412193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:20:15.412193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:15.412193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:20:15.412193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:15.412193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 496/987] 10.222.0.25 () {56 vars in 1126 bytes} [Mon May 23 12:20:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:20:15.414151 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:15.418351 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e3bb4-8833-492e-a8e2-d9bf597f0ddc None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:15.456739 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af1eb2-4a80-435a-a07e-1ccde2431a6f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:15.487811 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:15.493715 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239d529-ce1d-41f1-9a15-7ac159f0ff39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:15.494627 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239d529-ce1d-41f1-9a15-7ac159f0ff39 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:15.494970 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239d529-ce1d-41f1-9a15-7ac159f0ff39 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:15.495278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239d529-ce1d-41f1-9a15-7ac159f0ff39 None admin] PATH_INFO: `/v3/services/image` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:15.495934 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239d529-ce1d-41f1-9a15-7ac159f0ff39 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:15.497323 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239d529-ce1d-41f1-9a15-7ac159f0ff39 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:15.509432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-b239d529-ce1d-41f1-9a15-7ac159f0ff39 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 12:20:15.509432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:15.509432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:20:15.509432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:20:15.509432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:20:15.509432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:20:15.509432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:20:15.509432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:15.509432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 12:20:15.509432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:15.509432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:20:15.509432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:15.509432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:15.509432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:15.509432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:15.509432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:15.509432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:15.510409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:15.510409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:15.510409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:15.510409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:15.510409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:15.510409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:15.510409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:20:15.510409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:20:15.510409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:20:15.510409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:20:15.510409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:15.510409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:15.510409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:15.510409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:15.510409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:15.510409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:15.511529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:15.511529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:15.511529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:15.511529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:15.511529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:15.511529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:15.511529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:15.511529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:15.511529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:15.511529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:15.511529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:20:15.511529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:15.511529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 12:20:15.511529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:15.515624 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 492/988] 10.222.0.25 () {56 vars in 1105 bytes} [Mon May 23 12:20:15 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:20:15.516453 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239d529-ce1d-41f1-9a15-7ac159f0ff39 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:15.525374 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e3bb4-8833-492e-a8e2-d9bf597f0ddc None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:15.562289 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24ec63-984d-4fed-9b8e-4d8e099712f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:15.562989 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24ec63-984d-4fed-9b8e-4d8e099712f1 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:15.563277 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24ec63-984d-4fed-9b8e-4d8e099712f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:15.563558 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24ec63-984d-4fed-9b8e-4d8e099712f1 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:15.564266 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24ec63-984d-4fed-9b8e-4d8e099712f1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:15.564571 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24ec63-984d-4fed-9b8e-4d8e099712f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:15.565951 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24ec63-984d-4fed-9b8e-4d8e099712f1 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:15.571811 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 497/989] 10.222.0.25 () {56 vars in 1122 bytes} [Mon May 23 12:20:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:20:15.577195 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24ec63-984d-4fed-9b8e-4d8e099712f1 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:15.624355 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239d529-ce1d-41f1-9a15-7ac159f0ff39 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:15.653522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:15.666945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee82292-7f14-465b-a654-e13373379d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:15.667616 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee82292-7f14-465b-a654-e13373379d8c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:15.667909 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee82292-7f14-465b-a654-e13373379d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:15.668382 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee82292-7f14-465b-a654-e13373379d8c None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:15.669103 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee82292-7f14-465b-a654-e13373379d8c None admin] RBAC: Adding query filter params (name=image) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:15.669406 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee82292-7f14-465b-a654-e13373379d8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:15.671082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee82292-7f14-465b-a654-e13373379d8c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:15.677502 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 493/990] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:15.682954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee82292-7f14-465b-a654-e13373379d8c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:15.695857 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24ec63-984d-4fed-9b8e-4d8e099712f1 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:15.726818 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:15.734988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32f19b-5a18-4925-b4b8-287943fb4c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:15.735819 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32f19b-5a18-4925-b4b8-287943fb4c3c None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:15.736389 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32f19b-5a18-4925-b4b8-287943fb4c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:15.736681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32f19b-5a18-4925-b4b8-287943fb4c3c None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:15.737391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32f19b-5a18-4925-b4b8-287943fb4c3c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:15.737701 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32f19b-5a18-4925-b4b8-287943fb4c3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:15.740088 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32f19b-5a18-4925-b4b8-287943fb4c3c None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:15.748973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 498/991] 10.222.0.25 () {56 vars in 1122 bytes} [Mon May 23 12:20:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:15.752141 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32f19b-5a18-4925-b4b8-287943fb4c3c None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:15.793680 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee82292-7f14-465b-a654-e13373379d8c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:15.828459 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b8074-040f-4920-aab9-8cd9f2447d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:15.829415 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b8074-040f-4920-aab9-8cd9f2447d09 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:15.829415 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b8074-040f-4920-aab9-8cd9f2447d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:15.829681 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b8074-040f-4920-aab9-8cd9f2447d09 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:15.830385 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b8074-040f-4920-aab9-8cd9f2447d09 None admin] RBAC: Adding query filter params (type=image) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:15.830726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b8074-040f-4920-aab9-8cd9f2447d09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:15.832632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b8074-040f-4920-aab9-8cd9f2447d09 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:15.837329 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 494/992] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:15 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:20:15.872965 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32f19b-5a18-4925-b4b8-287943fb4c3c None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:15.911785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07e271-7164-4b7d-b161-e77adefaab98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:15.912830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07e271-7164-4b7d-b161-e77adefaab98 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:15.913302 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07e271-7164-4b7d-b161-e77adefaab98 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:15.913760 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07e271-7164-4b7d-b161-e77adefaab98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:15.914813 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07e271-7164-4b7d-b161-e77adefaab98 None admin] RBAC: Adding query filter params (interface=admin, service_id=4b9975c60b85400daa0e67c02f43e867, region_id=RegionOne) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:15.915313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07e271-7164-4b7d-b161-e77adefaab98 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:15.916969 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07e271-7164-4b7d-b161-e77adefaab98 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:15.923498 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 499/993] 10.222.0.25 () {56 vars in 1249 bytes} [Mon May 23 12:20:15 2022] GET /identity/v3/endpoints?service_id=4b9975c60b85400daa0e67c02f43e867&interface=admin®ion_id=RegionOne => generated 193 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:15.929135 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b8074-040f-4920-aab9-8cd9f2447d09 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:15.994314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:16.057205 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b8074-040f-4920-aab9-8cd9f2447d09 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:16.094011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c4598-743b-4eba-a334-00cd54be5b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:16.094703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c4598-743b-4eba-a334-00cd54be5b4f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:16.094994 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c4598-743b-4eba-a334-00cd54be5b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:16.095273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c4598-743b-4eba-a334-00cd54be5b4f None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:16.095956 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c4598-743b-4eba-a334-00cd54be5b4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:16.097345 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c4598-743b-4eba-a334-00cd54be5b4f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:16.110548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 495/994] 10.222.0.25 () {56 vars in 1087 bytes} [Mon May 23 12:20:15 2022] GET /identity/v3/services => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:20:16.660888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd22489-ab94-48ef-867d-549178cb30ce None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:16.661940 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd22489-ab94-48ef-867d-549178cb30ce None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:16.661940 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd22489-ab94-48ef-867d-549178cb30ce None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:16.663460 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 500/995] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:16.668569 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77355e7a-6a86-4404-95a3-5ae54ef3093e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:16.668973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77355e7a-6a86-4404-95a3-5ae54ef3093e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:16.669153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77355e7a-6a86-4404-95a3-5ae54ef3093e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:16.686114 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-77355e7a-6a86-4404-95a3-5ae54ef3093e None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:16.687332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-77355e7a-6a86-4404-95a3-5ae54ef3093e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:16.756273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 496/996] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:16.778976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd22489-ab94-48ef-867d-549178cb30ce None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:16.839683 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:16.885346 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd22489-ab94-48ef-867d-549178cb30ce None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:16.919718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab36012-937a-4864-ab27-fef7d66c689e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:16.920746 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab36012-937a-4864-ab27-fef7d66c689e None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:16.921181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab36012-937a-4864-ab27-fef7d66c689e None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:16.921605 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab36012-937a-4864-ab27-fef7d66c689e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:16.922396 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab36012-937a-4864-ab27-fef7d66c689e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:16.923928 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab36012-937a-4864-ab27-fef7d66c689e None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:16.936176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-1ab36012-937a-4864-ab27-fef7d66c689e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 12:20:16.936176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:16.936176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:20:16.936176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:20:16.936176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:20:16.936176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:20:16.936176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:20:16.936176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:16.936176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 12:20:16.936176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:16.936176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:20:16.936176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:16.936176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:16.936176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:16.936176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:16.936176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:16.936176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:16.937349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:16.937349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:16.937349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:16.937349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:16.937349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:16.937349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:16.937349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:20:16.937349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:20:16.937349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:20:16.937349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:20:16.937349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:16.937349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:16.937349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:16.937349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:16.937349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:16.937349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:16.938391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:16.938391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:16.938391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:16.938391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:16.938391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:16.938391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:16.938391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:16.938391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:16.938391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:16.938391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:16.938391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:20:16.938391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:16.938391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 12:20:16.938391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:16.940831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 501/997] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:20:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:16.946767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77355e7a-6a86-4404-95a3-5ae54ef3093e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:16.998914 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:17.049555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77355e7a-6a86-4404-95a3-5ae54ef3093e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:17.083719 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf2e3d-90d1-40ca-8bb6-10f19b4fdab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:17.084378 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf2e3d-90d1-40ca-8bb6-10f19b4fdab1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:17.084668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf2e3d-90d1-40ca-8bb6-10f19b4fdab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:17.084943 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf2e3d-90d1-40ca-8bb6-10f19b4fdab1 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:17.085639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf2e3d-90d1-40ca-8bb6-10f19b4fdab1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:17.085943 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf2e3d-90d1-40ca-8bb6-10f19b4fdab1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:17.087359 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf2e3d-90d1-40ca-8bb6-10f19b4fdab1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:17.092268 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 497/998] 10.222.0.25 () {56 vars in 1112 bytes} [Mon May 23 12:20:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:20:17.098263 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab36012-937a-4864-ab27-fef7d66c689e None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:17.202641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab36012-937a-4864-ab27-fef7d66c689e None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:17.227458 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:17.240227 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613211ae-6580-495c-a03d-c3aae9aa44c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:17.240893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613211ae-6580-495c-a03d-c3aae9aa44c2 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:17.241176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613211ae-6580-495c-a03d-c3aae9aa44c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:17.241517 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613211ae-6580-495c-a03d-c3aae9aa44c2 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:17.242219 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613211ae-6580-495c-a03d-c3aae9aa44c2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:17.242550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613211ae-6580-495c-a03d-c3aae9aa44c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:17.243964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613211ae-6580-495c-a03d-c3aae9aa44c2 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:17.249007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 502/999] 10.222.0.25 () {56 vars in 1112 bytes} [Mon May 23 12:20:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:17.255266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf2e3d-90d1-40ca-8bb6-10f19b4fdab1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:17.356448 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf2e3d-90d1-40ca-8bb6-10f19b4fdab1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:17.372741 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:17.393859 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32659f1b-abed-42d2-bc46-6f34a233328b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:17.394568 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32659f1b-abed-42d2-bc46-6f34a233328b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:17.394857 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32659f1b-abed-42d2-bc46-6f34a233328b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:17.395135 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32659f1b-abed-42d2-bc46-6f34a233328b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:17.395930 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32659f1b-abed-42d2-bc46-6f34a233328b None admin] RBAC: Adding query filter params (interface=public, service_id=42d19f8b9f714b4e8db8a82278d76262, region_id=RegionOne) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:17.396246 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32659f1b-abed-42d2-bc46-6f34a233328b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:17.397732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32659f1b-abed-42d2-bc46-6f34a233328b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:17.403074 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 498/1000] 10.222.0.25 () {56 vars in 1251 bytes} [Mon May 23 12:20:17 2022] GET /identity/v3/endpoints?service_id=42d19f8b9f714b4e8db8a82278d76262&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:17.408530 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613211ae-6580-495c-a03d-c3aae9aa44c2 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:17.510308 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613211ae-6580-495c-a03d-c3aae9aa44c2 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:17.542873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df103490-d3fa-4df6-a84e-3f4b7d679778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:17.543531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df103490-d3fa-4df6-a84e-3f4b7d679778 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:17.543816 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df103490-d3fa-4df6-a84e-3f4b7d679778 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:17.544091 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df103490-d3fa-4df6-a84e-3f4b7d679778 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:17.544761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df103490-d3fa-4df6-a84e-3f4b7d679778 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:17.546123 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df103490-d3fa-4df6-a84e-3f4b7d679778 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:17.553145 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 503/1001] 10.222.0.25 () {56 vars in 1087 bytes} [Mon May 23 12:20:17 2022] GET /identity/v3/services => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:20:18.179543 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c772a48-ae1b-41c6-932e-2839f234f18c None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:18.180097 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c772a48-ae1b-41c6-932e-2839f234f18c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:18.180097 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c772a48-ae1b-41c6-932e-2839f234f18c None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:18.184281 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 499/1002] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:18.186991 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b47805-24ca-48c6-8700-df58f72cec2d None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:18.187372 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b47805-24ca-48c6-8700-df58f72cec2d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:18.187562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b47805-24ca-48c6-8700-df58f72cec2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:18.204376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-71b47805-24ca-48c6-8700-df58f72cec2d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:18.205559 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-71b47805-24ca-48c6-8700-df58f72cec2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:18.253977 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:18.276084 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 504/1003] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:18.297702 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c772a48-ae1b-41c6-932e-2839f234f18c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:18.326013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efce0c-9bd8-49a6-a763-1cecbf79ae7a None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:18.326341 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efce0c-9bd8-49a6-a763-1cecbf79ae7a None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:18.326628 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efce0c-9bd8-49a6-a763-1cecbf79ae7a None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:18.328010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 505/1004] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:20:18.336615 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27a8e6-40b6-41de-a40b-86e5cb461023 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:18.336615 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27a8e6-40b6-41de-a40b-86e5cb461023 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:18.336615 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27a8e6-40b6-41de-a40b-86e5cb461023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:18.351999 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-6e27a8e6-40b6-41de-a40b-86e5cb461023 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:18.353133 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-6e27a8e6-40b6-41de-a40b-86e5cb461023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:18.407892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c772a48-ae1b-41c6-932e-2839f234f18c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:18.426674 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 506/1005] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:20:18.446419 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27a8e6-40b6-41de-a40b-86e5cb461023 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:18.446620 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57096e67-7053-4ab7-8a12-db31a36f9096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:18.447159 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57096e67-7053-4ab7-8a12-db31a36f9096 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:18.447445 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57096e67-7053-4ab7-8a12-db31a36f9096 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:18.447722 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57096e67-7053-4ab7-8a12-db31a36f9096 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:18.448462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57096e67-7053-4ab7-8a12-db31a36f9096 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:18.449865 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57096e67-7053-4ab7-8a12-db31a36f9096 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:18.467362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 500/1006] 10.222.0.25 () {60 vars in 1141 bytes} [Mon May 23 12:20:18 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:20:18.575636 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27a8e6-40b6-41de-a40b-86e5cb461023 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:18.590726 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:18.621167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470d9ea-3806-46d0-abd0-b0ddf5352eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:18.621981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470d9ea-3806-46d0-abd0-b0ddf5352eaa None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:18.622266 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470d9ea-3806-46d0-abd0-b0ddf5352eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:18.622567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470d9ea-3806-46d0-abd0-b0ddf5352eaa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:18.623228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470d9ea-3806-46d0-abd0-b0ddf5352eaa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:18.624624 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470d9ea-3806-46d0-abd0-b0ddf5352eaa None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:18.637671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-b470d9ea-3806-46d0-abd0-b0ddf5352eaa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:20:18.637671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:18.637671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:20:18.637671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:20:18.637671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:20:18.637671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:20:18.637671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:20:18.637671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:18.637671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:20:18.637671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:18.637671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:20:18.637671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:18.637671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:18.637671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:18.637671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:18.637671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:18.637671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:18.644186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:18.644186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:18.644186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:18.644186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:18.644186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:18.644186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:18.644186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:20:18.644186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:20:18.644186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:20:18.644186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:20:18.644186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:18.644186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:18.644186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:18.644186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:18.644186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:18.644186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:18.645759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:18.645759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:18.645759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:18.645759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:18.645759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:18.645759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:18.645759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:18.645759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:18.645759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:18.645759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:18.645759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:20:18.645759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:18.645759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 12:20:18.645759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:18.645759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 507/1007] 10.222.0.25 () {56 vars in 1126 bytes} [Mon May 23 12:20:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:20:18.646724 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57096e67-7053-4ab7-8a12-db31a36f9096 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:18.693436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:18.760947 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57096e67-7053-4ab7-8a12-db31a36f9096 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:18.794547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0815cfd-b61f-4bc1-aaed-d2c36e99ff43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:18.795276 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0815cfd-b61f-4bc1-aaed-d2c36e99ff43 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:18.795573 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0815cfd-b61f-4bc1-aaed-d2c36e99ff43 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:18.795861 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0815cfd-b61f-4bc1-aaed-d2c36e99ff43 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:18.796572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0815cfd-b61f-4bc1-aaed-d2c36e99ff43 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:18.796885 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0815cfd-b61f-4bc1-aaed-d2c36e99ff43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:18.798273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0815cfd-b61f-4bc1-aaed-d2c36e99ff43 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:18.804000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 501/1008] 10.222.0.25 () {56 vars in 1122 bytes} [Mon May 23 12:20:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:18.809399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470d9ea-3806-46d0-abd0-b0ddf5352eaa None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:18.912077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470d9ea-3806-46d0-abd0-b0ddf5352eaa None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:18.946205 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d25c0-28fb-409d-ae50-0786bd4fa217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:18.946892 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d25c0-28fb-409d-ae50-0786bd4fa217 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:18.947182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d25c0-28fb-409d-ae50-0786bd4fa217 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:18.947461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d25c0-28fb-409d-ae50-0786bd4fa217 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:18.948163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d25c0-28fb-409d-ae50-0786bd4fa217 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:18.948474 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d25c0-28fb-409d-ae50-0786bd4fa217 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:18.949847 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d25c0-28fb-409d-ae50-0786bd4fa217 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:18.959236 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 508/1009] 10.222.0.25 () {56 vars in 1122 bytes} [Mon May 23 12:20:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:18.960819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0815cfd-b61f-4bc1-aaed-d2c36e99ff43 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:19.064823 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0815cfd-b61f-4bc1-aaed-d2c36e99ff43 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:19.067027 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:19.101747 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef223e-c9f9-40b0-8ad9-d779079bada3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:19.102409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef223e-c9f9-40b0-8ad9-d779079bada3 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:19.102727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef223e-c9f9-40b0-8ad9-d779079bada3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:19.103005 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef223e-c9f9-40b0-8ad9-d779079bada3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:19.103755 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef223e-c9f9-40b0-8ad9-d779079bada3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:19.105149 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef223e-c9f9-40b0-8ad9-d779079bada3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:19.130539 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 502/1010] 10.222.0.25 () {60 vars in 1144 bytes} [Mon May 23 12:20:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:20:19.755308 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c897103-1aa6-4b14-91e8-1191fbc48ee1 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:19.755858 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c897103-1aa6-4b14-91e8-1191fbc48ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:19.755858 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c897103-1aa6-4b14-91e8-1191fbc48ee1 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:19.757332 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 509/1011] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:19.762239 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35a62a-3e7a-43d8-ab6b-beda065bfb8d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:19.762636 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35a62a-3e7a-43d8-ab6b-beda065bfb8d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:19.762827 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35a62a-3e7a-43d8-ab6b-beda065bfb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:19.780267 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-8e35a62a-3e7a-43d8-ab6b-beda065bfb8d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:19.781465 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8e35a62a-3e7a-43d8-ab6b-beda065bfb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:19.859574 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 503/1012] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:19 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:19.881838 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c897103-1aa6-4b14-91e8-1191fbc48ee1 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:19.920702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:19.990320 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c897103-1aa6-4b14-91e8-1191fbc48ee1 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:20.022424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4147837-752a-43f2-a948-4c0893e77d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:20.023166 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4147837-752a-43f2-a948-4c0893e77d09 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:20.023450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4147837-752a-43f2-a948-4c0893e77d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:20.023729 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4147837-752a-43f2-a948-4c0893e77d09 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:20.024368 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4147837-752a-43f2-a948-4c0893e77d09 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:20.025720 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4147837-752a-43f2-a948-4c0893e77d09 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:20.037600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-c4147837-752a-43f2-a948-4c0893e77d09 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 12:20:20.037600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:20.037600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:20:20.037600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:20:20.037600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:20:20.037600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:20:20.037600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:20:20.037600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:20.037600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 12:20:20.037600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:20.037600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:20:20.037600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:20.037600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:20.037600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:20.037600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:20.037600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:20.037600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:20.038631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:20.038631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:20.038631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:20.038631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:20.038631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:20.038631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:20.038631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:20:20.038631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:20:20.038631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:20:20.038631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:20:20.038631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:20.038631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:20.038631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:20.038631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:20.038631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:20.038631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:20.039492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:20.039492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:20.039492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:20.039492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:20.039492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:20.039492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:20.039492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:20.039492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:20.039492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:20.039492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:20.039492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:20:20.039492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:20.039492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 12:20:20.039492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:20.040904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 510/1013] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:20:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:20:20.044734 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35a62a-3e7a-43d8-ab6b-beda065bfb8d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:20.138666 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:20.153057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35a62a-3e7a-43d8-ab6b-beda065bfb8d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:20.195479 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de25e94-3ed8-4f23-9abd-dcc9f5ba6207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:20.196342 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de25e94-3ed8-4f23-9abd-dcc9f5ba6207 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:20.196671 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de25e94-3ed8-4f23-9abd-dcc9f5ba6207 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:20.196983 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de25e94-3ed8-4f23-9abd-dcc9f5ba6207 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:20.197748 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de25e94-3ed8-4f23-9abd-dcc9f5ba6207 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:20.198061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de25e94-3ed8-4f23-9abd-dcc9f5ba6207 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:20.199488 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de25e94-3ed8-4f23-9abd-dcc9f5ba6207 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:20.204939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 504/1014] 10.222.0.25 () {56 vars in 1112 bytes} [Mon May 23 12:20:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:20.211264 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4147837-752a-43f2-a948-4c0893e77d09 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:20.315942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:20.318868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4147837-752a-43f2-a948-4c0893e77d09 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:20.355083 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e7aa2-52ec-4874-9c79-6d65a564abb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:20.355993 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e7aa2-52ec-4874-9c79-6d65a564abb0 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:20.356289 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e7aa2-52ec-4874-9c79-6d65a564abb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:20.356568 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e7aa2-52ec-4874-9c79-6d65a564abb0 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:20.357276 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e7aa2-52ec-4874-9c79-6d65a564abb0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:20.357585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e7aa2-52ec-4874-9c79-6d65a564abb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:20.358996 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e7aa2-52ec-4874-9c79-6d65a564abb0 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:20.364281 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 511/1015] 10.222.0.25 () {56 vars in 1112 bytes} [Mon May 23 12:20:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:20.369657 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de25e94-3ed8-4f23-9abd-dcc9f5ba6207 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:20.472117 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de25e94-3ed8-4f23-9abd-dcc9f5ba6207 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:20.509073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb4846-9bb8-4016-9044-7696ca09cfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:20.509728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb4846-9bb8-4016-9044-7696ca09cfaa None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:20.510013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb4846-9bb8-4016-9044-7696ca09cfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:20.510287 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb4846-9bb8-4016-9044-7696ca09cfaa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:20.511083 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb4846-9bb8-4016-9044-7696ca09cfaa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:20.512462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb4846-9bb8-4016-9044-7696ca09cfaa None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:20.538755 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 505/1016] 10.222.0.25 () {60 vars in 1144 bytes} [Mon May 23 12:20:20 2022] POST /identity/v3/endpoints => generated 334 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:20:20.841566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8a8ff-3623-4b15-8251-75343585187e None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:20.842111 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8a8ff-3623-4b15-8251-75343585187e None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:20.842190 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8a8ff-3623-4b15-8251-75343585187e None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:20.844379 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 512/1017] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:20.851220 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd9657-08c2-429c-ad60-d67748d1bf63 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:20.851721 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd9657-08c2-429c-ad60-d67748d1bf63 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:20.851798 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd9657-08c2-429c-ad60-d67748d1bf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:20.869970 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-10dd9657-08c2-429c-ad60-d67748d1bf63 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:20.871205 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-10dd9657-08c2-429c-ad60-d67748d1bf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:20.873344 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:20.953179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 506/1018] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:20.979576 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8a8ff-3623-4b15-8251-75343585187e None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:21.091025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8a8ff-3623-4b15-8251-75343585187e None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:21.134695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e4c5c-af8d-48de-b0f7-f8e965c745cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:21.135996 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e4c5c-af8d-48de-b0f7-f8e965c745cc None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:21.136344 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e4c5c-af8d-48de-b0f7-f8e965c745cc None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:21.136630 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e4c5c-af8d-48de-b0f7-f8e965c745cc None admin] PATH_INFO: `/v3/services/image` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:21.137291 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e4c5c-af8d-48de-b0f7-f8e965c745cc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:21.138698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e4c5c-af8d-48de-b0f7-f8e965c745cc None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:21.151161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-e83e4c5c-af8d-48de-b0f7-f8e965c745cc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 12:20:21.151161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:21.151161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:20:21.151161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:20:21.151161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:20:21.151161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:20:21.151161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:20:21.151161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:21.151161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 12:20:21.151161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:21.151161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:20:21.151161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:21.151161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:21.151161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:21.151161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:21.151161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:21.151161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:21.152167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:21.152167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:21.152167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:21.152167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:21.152167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:21.152167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:21.152167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:20:21.152167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:20:21.152167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:20:21.152167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:20:21.152167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:21.152167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:21.152167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:21.152167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:21.152167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:21.152167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:21.153688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:21.153688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:21.153688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:21.153688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:21.153688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:21.153688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:21.153688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:21.153688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:21.153688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:21.153688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:21.153688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:20:21.153688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:21.153688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 12:20:21.153688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:21.158152 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 513/1019] 10.222.0.25 () {56 vars in 1105 bytes} [Mon May 23 12:20:20 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:21.159230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd9657-08c2-429c-ad60-d67748d1bf63 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:21.277473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd9657-08c2-429c-ad60-d67748d1bf63 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:21.311900 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e2446-6e04-4683-b2ad-acb8659fb20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:21.312563 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e2446-6e04-4683-b2ad-acb8659fb20e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:21.312850 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e2446-6e04-4683-b2ad-acb8659fb20e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:21.313126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e2446-6e04-4683-b2ad-acb8659fb20e None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:21.313826 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e2446-6e04-4683-b2ad-acb8659fb20e None admin] RBAC: Adding query filter params (name=image) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:21.314132 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e2446-6e04-4683-b2ad-acb8659fb20e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:21.315540 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e2446-6e04-4683-b2ad-acb8659fb20e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:21.317098 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:21.322768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 507/1020] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:21.328242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e4c5c-af8d-48de-b0f7-f8e965c745cc None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:21.357984 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:21.380844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2d96e-657f-4a3f-98d5-a26d9d9140c0 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:21.381135 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2d96e-657f-4a3f-98d5-a26d9d9140c0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:21.381417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2d96e-657f-4a3f-98d5-a26d9d9140c0 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:21.383164 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 508/1021] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:20:21.388313 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaed768-c39e-427b-8b65-7bb6e3967f6b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:21.388544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaed768-c39e-427b-8b65-7bb6e3967f6b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:21.388827 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaed768-c39e-427b-8b65-7bb6e3967f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:21.406235 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-bbaed768-c39e-427b-8b65-7bb6e3967f6b None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:21.407450 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bbaed768-c39e-427b-8b65-7bb6e3967f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:21.438302 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e4c5c-af8d-48de-b0f7-f8e965c745cc None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:21.474190 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3038e4-3342-4583-9fde-c44eeed082a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:21.475024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 509/1022] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:20:21.475140 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3038e4-3342-4583-9fde-c44eeed082a6 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:21.475140 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3038e4-3342-4583-9fde-c44eeed082a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:21.475419 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3038e4-3342-4583-9fde-c44eeed082a6 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:21.476126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3038e4-3342-4583-9fde-c44eeed082a6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:21.476435 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3038e4-3342-4583-9fde-c44eeed082a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:21.477863 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3038e4-3342-4583-9fde-c44eeed082a6 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:21.487993 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 514/1023] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:21.488992 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaed768-c39e-427b-8b65-7bb6e3967f6b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:21.499445 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3038e4-3342-4583-9fde-c44eeed082a6 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:21.595411 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaed768-c39e-427b-8b65-7bb6e3967f6b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:21.596868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:21.612041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3038e4-3342-4583-9fde-c44eeed082a6 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:21.622272 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:21.631739 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8a59e-3dca-435f-9811-c132a24a0409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:21.632396 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8a59e-3dca-435f-9811-c132a24a0409 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:21.632684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8a59e-3dca-435f-9811-c132a24a0409 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:21.632967 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8a59e-3dca-435f-9811-c132a24a0409 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:21.633758 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8a59e-3dca-435f-9811-c132a24a0409 None admin] RBAC: Adding query filter params (interface=public, service_id=f34b9d1950d74cfcb6d9d4ba778ca10f, region_id=RegionOne) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:21.634072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8a59e-3dca-435f-9811-c132a24a0409 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:21.635497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8a59e-3dca-435f-9811-c132a24a0409 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:21.640690 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 510/1024] 10.222.0.25 () {56 vars in 1251 bytes} [Mon May 23 12:20:21 2022] GET /identity/v3/endpoints?service_id=f34b9d1950d74cfcb6d9d4ba778ca10f&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:21.646483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8a59e-3dca-435f-9811-c132a24a0409 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:21.655210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53cbb1-de24-434f-ad67-5a7fd79016a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:21.656002 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53cbb1-de24-434f-ad67-5a7fd79016a5 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:21.656289 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53cbb1-de24-434f-ad67-5a7fd79016a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:21.656568 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53cbb1-de24-434f-ad67-5a7fd79016a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:21.657742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53cbb1-de24-434f-ad67-5a7fd79016a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:21.659213 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53cbb1-de24-434f-ad67-5a7fd79016a5 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:21.660967 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 515/1025] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:20:21.666927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53cbb1-de24-434f-ad67-5a7fd79016a5 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:21.761164 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8a59e-3dca-435f-9811-c132a24a0409 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:21.772068 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53cbb1-de24-434f-ad67-5a7fd79016a5 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:21.801242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9702d8-1a82-49dd-81a4-c7bb1c53361a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:21.801916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9702d8-1a82-49dd-81a4-c7bb1c53361a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:21.802252 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9702d8-1a82-49dd-81a4-c7bb1c53361a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:21.802559 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9702d8-1a82-49dd-81a4-c7bb1c53361a None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:21.803253 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9702d8-1a82-49dd-81a4-c7bb1c53361a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:21.804649 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9702d8-1a82-49dd-81a4-c7bb1c53361a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:21.808813 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76f683-29a6-4737-995e-95ab20f5a1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:21.809475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76f683-29a6-4737-995e-95ab20f5a1b3 None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:21.809763 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76f683-29a6-4737-995e-95ab20f5a1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:21.810044 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76f683-29a6-4737-995e-95ab20f5a1b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:21.810788 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76f683-29a6-4737-995e-95ab20f5a1b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:21.818604 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 511/1026] 10.222.0.25 () {56 vars in 1087 bytes} [Mon May 23 12:20:21 2022] GET /identity/v3/services => generated 1957 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:20:21.818801 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76f683-29a6-4737-995e-95ab20f5a1b3 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:21.844814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 516/1027] 10.222.0.25 () {60 vars in 1141 bytes} [Mon May 23 12:20:21 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:20:22.883882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f73bc-9c87-414b-8772-43b5cbafbb1f None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:22.884407 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f73bc-9c87-414b-8772-43b5cbafbb1f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:22.884407 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f73bc-9c87-414b-8772-43b5cbafbb1f None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:22.885937 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 512/1028] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:22.891011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bb249-6b35-4ee0-80bb-c31e1b1c4263 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:22.891428 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bb249-6b35-4ee0-80bb-c31e1b1c4263 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:22.891602 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bb249-6b35-4ee0-80bb-c31e1b1c4263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:22.907666 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-574bb249-6b35-4ee0-80bb-c31e1b1c4263 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:22.908837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-574bb249-6b35-4ee0-80bb-c31e1b1c4263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:22.917406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:22.983612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 517/1029] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:23.007792 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f73bc-9c87-414b-8772-43b5cbafbb1f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:23.069296 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:23.120567 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f73bc-9c87-414b-8772-43b5cbafbb1f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:23.154745 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd509e6-cf14-4807-9791-cc9a64fdfd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:23.155399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd509e6-cf14-4807-9791-cc9a64fdfd8f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:23.155681 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd509e6-cf14-4807-9791-cc9a64fdfd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:23.155956 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd509e6-cf14-4807-9791-cc9a64fdfd8f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:23.166413 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd509e6-cf14-4807-9791-cc9a64fdfd8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:20:23.174370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-4dd509e6-cf14-4807-9791-cc9a64fdfd8f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:20:23.174370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:23.174370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:23.174370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:23.174370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:23.174370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:23.174370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:23.174370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:23.174370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:23.174370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:23.174370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:23.174370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:23.174370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:20:23.174370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:20:23.174370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:20:23.174370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:20:23.175306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:20:23.175306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:20:23.175306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:20:23.175306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:20:23.175306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:23.175306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:23.175306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:23.175306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:23.175306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:23.175306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:23.175306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:23.175306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:23.175306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:23.175306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:23.175306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:23.175306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:23.176760 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:23.176760 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:23.176760 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:23.176760 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:23.176760 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:20:23.176760 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:20:23.176760 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:20:23.176760 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:20:23.176760 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:20:23.176760 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:20:23.176760 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:20:23.176760 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:23.176760 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 513/1030] 10.222.0.25 () {56 vars in 1120 bytes} [Mon May 23 12:20:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:23.182073 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bb249-6b35-4ee0-80bb-c31e1b1c4263 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:23.280407 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bb249-6b35-4ee0-80bb-c31e1b1c4263 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:23.313305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cdba1-4cf4-4067-af83-1e5a5c43e9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:23.313963 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cdba1-4cf4-4067-af83-1e5a5c43e9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:23.314249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cdba1-4cf4-4067-af83-1e5a5c43e9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:23.314534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cdba1-4cf4-4067-af83-1e5a5c43e9a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:23.315271 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cdba1-4cf4-4067-af83-1e5a5c43e9a3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:23.315583 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cdba1-4cf4-4067-af83-1e5a5c43e9a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:23.317386 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cdba1-4cf4-4067-af83-1e5a5c43e9a3 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:23.330683 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 518/1031] 10.222.0.25 () {56 vars in 1115 bytes} [Mon May 23 12:20:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:23.332370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd509e6-cf14-4807-9791-cc9a64fdfd8f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:23.436843 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd509e6-cf14-4807-9791-cc9a64fdfd8f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:23.452589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:23.471531 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f14bb9-90cd-4d24-bfe5-99e1407c4f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:23.472378 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f14bb9-90cd-4d24-bfe5-99e1407c4f8a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:23.473153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f14bb9-90cd-4d24-bfe5-99e1407c4f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:23.473426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f14bb9-90cd-4d24-bfe5-99e1407c4f8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:23.484214 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f14bb9-90cd-4d24-bfe5-99e1407c4f8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:23.485674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f14bb9-90cd-4d24-bfe5-99e1407c4f8a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:23.502361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-b8f14bb9-90cd-4d24-bfe5-99e1407c4f8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:23.502361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:23.502361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:23.502361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:23.502361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:23.502361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:23.502361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:23.502361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:23.502361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:23.502361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:23.502361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:23.502361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:23.502361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:20:23.502361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:20:23.502361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:20:23.503348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:20:23.503348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:23.503348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:23.503348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:23.503348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:23.503348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:23.503348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:23.503348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:23.503348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:23.503348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:23.503348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:23.503348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:23.503348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:23.503348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:23.503348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:23.503348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:23.503348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:23.504265 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:20:23.504265 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:20:23.504265 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:23.504265 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:23.504265 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 514/1032] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:20:23.510236 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cdba1-4cf4-4067-af83-1e5a5c43e9a3 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:23.514437 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:23.616486 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cdba1-4cf4-4067-af83-1e5a5c43e9a3 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:23.659216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc16e7-f688-48cc-bcbd-e059680ed604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:23.659916 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc16e7-f688-48cc-bcbd-e059680ed604 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:23.660206 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc16e7-f688-48cc-bcbd-e059680ed604 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:23.660487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc16e7-f688-48cc-bcbd-e059680ed604 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:23.661214 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc16e7-f688-48cc-bcbd-e059680ed604 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:23.661531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc16e7-f688-48cc-bcbd-e059680ed604 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:23.662952 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc16e7-f688-48cc-bcbd-e059680ed604 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:23.675620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 519/1033] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:23.681329 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f14bb9-90cd-4d24-bfe5-99e1407c4f8a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:23.786026 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f14bb9-90cd-4d24-bfe5-99e1407c4f8a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:23.820912 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc82757-24d7-4e8d-9396-a94fa5ff7d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:23.821714 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc82757-24d7-4e8d-9396-a94fa5ff7d0c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:23.822004 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc82757-24d7-4e8d-9396-a94fa5ff7d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:23.822286 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc82757-24d7-4e8d-9396-a94fa5ff7d0c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:23.830187 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc82757-24d7-4e8d-9396-a94fa5ff7d0c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:23.831786 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc82757-24d7-4e8d-9396-a94fa5ff7d0c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:23.845572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-0bc82757-24d7-4e8d-9396-a94fa5ff7d0c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 12:20:23.845572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:23.845572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:23.845572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:23.845572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:23.845572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:23.845572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:23.845572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:23.845572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:23.845572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:23.845572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:23.845572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:23.845572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:20:23.845572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:20:23.845572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:20:23.845572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:20:23.846829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:23.846829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:23.846829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:20:23.846829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:20:23.846829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:20:23.846829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:20:23.846829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:23.846829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:23.846829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:23.846829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:23.846829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:23.846829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:23.846829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:23.846829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:23.846829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:23.846829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:23.846829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:23.846829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:23.853110 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:23.853110 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:23.853110 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:20:23.853110 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:20:23.853110 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:20:23.853110 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:20:23.853110 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:20:23.853110 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:20:23.853110 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 12:20:23.853110 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:23.853110 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 515/1034] 10.222.0.25 () {56 vars in 1093 bytes} [Mon May 23 12:20:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:20:23.855252 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc16e7-f688-48cc-bcbd-e059680ed604 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:23.923828 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:23.963606 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc16e7-f688-48cc-bcbd-e059680ed604 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:24.000194 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc75dde-9622-45dc-a35a-0c250c554563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:24.000884 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc75dde-9622-45dc-a35a-0c250c554563 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:24.001169 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc75dde-9622-45dc-a35a-0c250c554563 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:24.001474 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc75dde-9622-45dc-a35a-0c250c554563 None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:24.002356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc75dde-9622-45dc-a35a-0c250c554563 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:24.002704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc75dde-9622-45dc-a35a-0c250c554563 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:24.004292 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc75dde-9622-45dc-a35a-0c250c554563 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:24.028662 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 520/1035] 10.222.0.25 () {56 vars in 1133 bytes} [Mon May 23 12:20:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:24.030146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc82757-24d7-4e8d-9396-a94fa5ff7d0c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:24.060788 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:24.093574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981d730-63c0-47da-8e08-0136a29ff4fb None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:24.093874 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981d730-63c0-47da-8e08-0136a29ff4fb None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:24.094179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981d730-63c0-47da-8e08-0136a29ff4fb None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:24.095726 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 521/1036] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:20:24.101857 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a78511-1868-41ea-a270-272b262cd35d None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:24.102148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a78511-1868-41ea-a270-272b262cd35d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:24.102433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a78511-1868-41ea-a270-272b262cd35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:24.121000 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-35a78511-1868-41ea-a270-272b262cd35d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:24.122324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-35a78511-1868-41ea-a270-272b262cd35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:24.150772 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc82757-24d7-4e8d-9396-a94fa5ff7d0c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:24.189659 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f00bce-692b-4c16-be9b-4595fc7b6676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:24.190314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f00bce-692b-4c16-be9b-4595fc7b6676 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:24.190630 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f00bce-692b-4c16-be9b-4595fc7b6676 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:24.190912 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f00bce-692b-4c16-be9b-4595fc7b6676 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:24.196264 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 522/1037] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:24.197596 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f2741-c967-4460-bc3e-981f441cb4ab None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:24.197890 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f2741-c967-4460-bc3e-981f441cb4ab None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:24.198171 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f2741-c967-4460-bc3e-981f441cb4ab None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:24.199565 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 523/1038] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:24.204694 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefc0c0-e22a-43ea-a92a-1efc13973ae5 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:24.204988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefc0c0-e22a-43ea-a92a-1efc13973ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:24.205271 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefc0c0-e22a-43ea-a92a-1efc13973ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:24.221963 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-dcefc0c0-e22a-43ea-a92a-1efc13973ae5 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:24.223215 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-dcefc0c0-e22a-43ea-a92a-1efc13973ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:24.264026 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f00bce-692b-4c16-be9b-4595fc7b6676 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:24.265506 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f00bce-692b-4c16-be9b-4595fc7b6676 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:24.270159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:24.289959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 524/1039] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:20:24.292259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:24.295575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefc0c0-e22a-43ea-a92a-1efc13973ae5 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:24.364965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 516/1040] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:20:24 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 12:20:24.367440 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f00bce-692b-4c16-be9b-4595fc7b6676 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:24.394961 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefc0c0-e22a-43ea-a92a-1efc13973ae5 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:24.429507 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557a30f-0dc2-4661-ae2d-5241a20522de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:24.430294 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557a30f-0dc2-4661-ae2d-5241a20522de None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:24.430605 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557a30f-0dc2-4661-ae2d-5241a20522de None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:24.430885 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557a30f-0dc2-4661-ae2d-5241a20522de None admin] PATH_INFO: `/v3/services/image` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:24.431534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557a30f-0dc2-4661-ae2d-5241a20522de None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:24.432899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557a30f-0dc2-4661-ae2d-5241a20522de None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:24.444656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-a557a30f-0dc2-4661-ae2d-5241a20522de None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 12:20:24.444656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:24.444656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:20:24.444656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:20:24.444656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:20:24.444656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:20:24.444656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:20:24.444656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:24.444656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 12:20:24.444656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:24.444656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:20:24.444656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:24.444656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:24.444656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:24.444656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:24.444656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:24.444656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:24.445908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:24.445908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:24.445908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:24.445908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:24.445908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:24.445908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:24.445908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:20:24.445908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:20:24.445908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:20:24.445908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:20:24.445908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:24.445908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:24.445908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:24.445908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:24.445908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:24.445908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:24.446866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:24.446866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:24.446866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:24.446866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:24.446866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:24.446866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:24.446866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:24.446866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:24.446866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:24.446866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:24.446866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:20:24.446866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:20:24.446866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 12:20:24.446866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:24.450652 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 525/1041] 10.222.0.25 () {56 vars in 1105 bytes} [Mon May 23 12:20:24 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:24.451631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557a30f-0dc2-4661-ae2d-5241a20522de None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:24.462620 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f00bce-692b-4c16-be9b-4595fc7b6676 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:24.488741 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:24.497057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299d26c-27f7-47d9-b406-c976ebe79bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:24.497494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:24.497844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d26c-27f7-47d9-b406-c976ebe79bff None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:24.498121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d26c-27f7-47d9-b406-c976ebe79bff None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:24.498446 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d26c-27f7-47d9-b406-c976ebe79bff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:24.499591 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299d26c-27f7-47d9-b406-c976ebe79bff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:24.501021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299d26c-27f7-47d9-b406-c976ebe79bff None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:24.502634 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 517/1042] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:24.503380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299d26c-27f7-47d9-b406-c976ebe79bff None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:24.551004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557a30f-0dc2-4661-ae2d-5241a20522de None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:24.583699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477657b5-4d6a-449c-89c0-e3b767e00e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:24.584484 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477657b5-4d6a-449c-89c0-e3b767e00e24 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:24.584766 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477657b5-4d6a-449c-89c0-e3b767e00e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:24.585037 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477657b5-4d6a-449c-89c0-e3b767e00e24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:24.598363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477657b5-4d6a-449c-89c0-e3b767e00e24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:24.599828 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477657b5-4d6a-449c-89c0-e3b767e00e24 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:24.607288 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299d26c-27f7-47d9-b406-c976ebe79bff None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:24.617047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-477657b5-4d6a-449c-89c0-e3b767e00e24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:24.617047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:24.617047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:24.617047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:24.617047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:24.617047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:24.617047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:24.617047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:24.617047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:24.617047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:24.617047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:24.617047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:24.617047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:20:24.617047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:20:24.617047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:20:24.617933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:20:24.617933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:24.617933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:24.617933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:24.617933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:24.617933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:24.617933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:24.617933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:24.617933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:24.617933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:24.617933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:24.617933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:24.617933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:24.617933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:24.617933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:24.617933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:24.617933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:24.618857 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:20:24.618857 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:20:24.618857 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:24.618857 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:24.618857 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 526/1043] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:24.619169 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477657b5-4d6a-449c-89c0-e3b767e00e24 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:24.646860 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa503fa-23dd-4915-80dc-1b41b6611e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:24.647517 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa503fa-23dd-4915-80dc-1b41b6611e37 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:24.647811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa503fa-23dd-4915-80dc-1b41b6611e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:24.648090 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa503fa-23dd-4915-80dc-1b41b6611e37 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:24.648812 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa503fa-23dd-4915-80dc-1b41b6611e37 None admin] RBAC: Adding query filter params (name=image) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:24.649104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa503fa-23dd-4915-80dc-1b41b6611e37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:24.650484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa503fa-23dd-4915-80dc-1b41b6611e37 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:24.655629 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 518/1044] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:24.656250 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa503fa-23dd-4915-80dc-1b41b6611e37 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:24.716970 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:24.720509 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477657b5-4d6a-449c-89c0-e3b767e00e24 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:24.720851 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:24.755011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12086ab6-fd95-4445-998c-0c78b6dc733e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:24.755675 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12086ab6-fd95-4445-998c-0c78b6dc733e None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:24.755962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12086ab6-fd95-4445-998c-0c78b6dc733e None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:24.756239 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12086ab6-fd95-4445-998c-0c78b6dc733e None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:24.756938 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12086ab6-fd95-4445-998c-0c78b6dc733e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:24.758377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12086ab6-fd95-4445-998c-0c78b6dc733e None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:24.761318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa503fa-23dd-4915-80dc-1b41b6611e37 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:24.777534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 527/1045] 10.222.0.25 () {60 vars in 1132 bytes} [Mon May 23 12:20:24 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:20:24.778330 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12086ab6-fd95-4445-998c-0c78b6dc733e None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:24.818770 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ca8b2-fc39-457c-9dd7-5ae0c56ab4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:24.819460 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ca8b2-fc39-457c-9dd7-5ae0c56ab4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:24.819745 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ca8b2-fc39-457c-9dd7-5ae0c56ab4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:24.820026 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ca8b2-fc39-457c-9dd7-5ae0c56ab4f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:24.820764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ca8b2-fc39-457c-9dd7-5ae0c56ab4f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:24.821072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ca8b2-fc39-457c-9dd7-5ae0c56ab4f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:24.822525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ca8b2-fc39-457c-9dd7-5ae0c56ab4f1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:24.839662 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 519/1046] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:24.840925 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ca8b2-fc39-457c-9dd7-5ae0c56ab4f1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:24.896355 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12086ab6-fd95-4445-998c-0c78b6dc733e None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:24.934833 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef183e6-138b-4e83-bfc4-daa94c2f5da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:24.935528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef183e6-138b-4e83-bfc4-daa94c2f5da2 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:24.935853 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef183e6-138b-4e83-bfc4-daa94c2f5da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:24.936062 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef183e6-138b-4e83-bfc4-daa94c2f5da2 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:24.936787 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef183e6-138b-4e83-bfc4-daa94c2f5da2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:24.937156 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef183e6-138b-4e83-bfc4-daa94c2f5da2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:24.938606 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef183e6-138b-4e83-bfc4-daa94c2f5da2 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:24.949387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 528/1047] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:24.950544 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef183e6-138b-4e83-bfc4-daa94c2f5da2 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:24.955510 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ca8b2-fc39-457c-9dd7-5ae0c56ab4f1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:24.975283 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:24.977566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:25.000521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d0ae0-b5c2-41eb-8d08-26c8e22a5b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:25.001006 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d0ae0-b5c2-41eb-8d08-26c8e22a5b58 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:25.001301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d0ae0-b5c2-41eb-8d08-26c8e22a5b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:25.001586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d0ae0-b5c2-41eb-8d08-26c8e22a5b58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:25.009860 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d0ae0-b5c2-41eb-8d08-26c8e22a5b58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:25.011671 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d0ae0-b5c2-41eb-8d08-26c8e22a5b58 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:25.027673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-af6d0ae0-b5c2-41eb-8d08-26c8e22a5b58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:20:25.027673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:25.027673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:25.027673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:25.027673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:25.027673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:25.027673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:25.027673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:25.027673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:25.027673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:25.027673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:25.027673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:25.027673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:20:25.027673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:20:25.027673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:20:25.028703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:20:25.028703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:25.028703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:25.028703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:25.028703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:25.028703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:25.028703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:25.028703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:25.028703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:25.028703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:25.028703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:25.028703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:25.028703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:25.028703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:25.028703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:25.028703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:25.028703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:25.029609 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:20:25.029609 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:20:25.029609 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:20:25.029609 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:20:25.029609 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:20:25.029609 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:20:25.029609 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:20:25.029609 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:25.031676 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 520/1048] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:20:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:25.037754 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d0ae0-b5c2-41eb-8d08-26c8e22a5b58 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:25.076986 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef183e6-138b-4e83-bfc4-daa94c2f5da2 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:25.117416 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b1b19-c94f-4136-8ac1-0e391fcb168e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:25.118097 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b1b19-c94f-4136-8ac1-0e391fcb168e None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:25.118386 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b1b19-c94f-4136-8ac1-0e391fcb168e None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:25.119082 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b1b19-c94f-4136-8ac1-0e391fcb168e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:25.119845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b1b19-c94f-4136-8ac1-0e391fcb168e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:25.121582 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b1b19-c94f-4136-8ac1-0e391fcb168e None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:25.143826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 529/1049] 10.222.0.25 () {60 vars in 1144 bytes} [Mon May 23 12:20:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:20:25.144530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d0ae0-b5c2-41eb-8d08-26c8e22a5b58 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:25.193311 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955cc249-010d-4934-aa9b-3304ea1eb86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:25.194119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cc249-010d-4934-aa9b-3304ea1eb86b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:25.194478 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cc249-010d-4934-aa9b-3304ea1eb86b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:25.194893 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cc249-010d-4934-aa9b-3304ea1eb86b None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:25.195790 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cc249-010d-4934-aa9b-3304ea1eb86b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:25.196173 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cc249-010d-4934-aa9b-3304ea1eb86b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:25.197752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cc249-010d-4934-aa9b-3304ea1eb86b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:25.216439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 521/1050] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:20:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:20:25.217868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b1b19-c94f-4136-8ac1-0e391fcb168e None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:25.301838 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:25.332423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b1b19-c94f-4136-8ac1-0e391fcb168e None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:25.368490 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff94d8f-ea43-4b14-b906-c9c6b239e5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:25.369201 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff94d8f-ea43-4b14-b906-c9c6b239e5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:25.369490 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff94d8f-ea43-4b14-b906-c9c6b239e5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:25.369818 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff94d8f-ea43-4b14-b906-c9c6b239e5c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:25.370684 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff94d8f-ea43-4b14-b906-c9c6b239e5c2 None admin] RBAC: Adding query filter params (role.id=66df182349134f17825bf29c92d8c87b, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=d49997b9108145b78eb4db1d8823bf4d) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:25.371002 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff94d8f-ea43-4b14-b906-c9c6b239e5c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:25.372447 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff94d8f-ea43-4b14-b906-c9c6b239e5c2 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:25.378383 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 530/1051] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:20:25 2022] GET /identity/v3/role_assignments?user.id=d49997b9108145b78eb4db1d8823bf4d&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=66df182349134f17825bf29c92d8c87b => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:27.025572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a27dc8-ba04-4387-a07d-40bb503b6255 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:27.026122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a27dc8-ba04-4387-a07d-40bb503b6255 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:27.026122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a27dc8-ba04-4387-a07d-40bb503b6255 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:27.027551 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 522/1052] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:27.032856 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227492f-e7f9-4b06-8450-1dfff407ae5b None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:27.033248 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227492f-e7f9-4b06-8450-1dfff407ae5b None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:27.033422 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227492f-e7f9-4b06-8450-1dfff407ae5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:27.050127 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-f227492f-e7f9-4b06-8450-1dfff407ae5b None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:27.051853 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-f227492f-e7f9-4b06-8450-1dfff407ae5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:27.130600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 531/1053] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:27.146371 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a27dc8-ba04-4387-a07d-40bb503b6255 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:27.193047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:27.257970 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a27dc8-ba04-4387-a07d-40bb503b6255 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:27.292238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb4a26-07ac-4a3a-9323-0729189d3773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:27.292947 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb4a26-07ac-4a3a-9323-0729189d3773 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:27.293229 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb4a26-07ac-4a3a-9323-0729189d3773 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:27.293505 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb4a26-07ac-4a3a-9323-0729189d3773 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:27.303689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb4a26-07ac-4a3a-9323-0729189d3773 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:20:27.311100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-2fcb4a26-07ac-4a3a-9323-0729189d3773 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:20:27.311100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:27.311100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:27.311100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:27.311100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:27.311100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:27.311100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:27.311100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:27.311100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:27.311100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:27.311100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:27.311100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:27.311100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:20:27.311100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:20:27.311100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:20:27.311100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:20:27.312024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:20:27.312024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:20:27.312024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:20:27.312024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:20:27.312024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:27.312024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:27.312024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:27.312024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:27.312024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:27.312024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:27.312024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:27.312024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:27.312024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:27.312024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:27.312024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:27.312024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:27.312864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:27.312864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:27.312864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:27.312864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:27.312864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:20:27.312864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:20:27.312864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:20:27.312864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:20:27.312864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:20:27.312864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:20:27.312864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:20:27.312864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:27.312864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 523/1054] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:20:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:27.318835 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227492f-e7f9-4b06-8450-1dfff407ae5b None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:27.390333 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:27.393377 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc262c-6a29-4c1d-9303-e6365f94189f None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:27.393666 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc262c-6a29-4c1d-9303-e6365f94189f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:27.393948 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc262c-6a29-4c1d-9303-e6365f94189f None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:27.396137 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 524/1055] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:27.401800 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1a8c8-ba1c-4979-92f1-75fc5bcb8ba4 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:27.402104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1a8c8-ba1c-4979-92f1-75fc5bcb8ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:27.402365 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1a8c8-ba1c-4979-92f1-75fc5bcb8ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:27.420903 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-fca1a8c8-ba1c-4979-92f1-75fc5bcb8ba4 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:27.422077 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fca1a8c8-ba1c-4979-92f1-75fc5bcb8ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:27.429171 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227492f-e7f9-4b06-8450-1dfff407ae5b None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:27.464580 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911883d2-147c-4558-b4a2-85cdfb68db58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:27.465245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911883d2-147c-4558-b4a2-85cdfb68db58 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:27.465528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911883d2-147c-4558-b4a2-85cdfb68db58 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:27.465803 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911883d2-147c-4558-b4a2-85cdfb68db58 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:27.466566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911883d2-147c-4558-b4a2-85cdfb68db58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:27.466992 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911883d2-147c-4558-b4a2-85cdfb68db58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:27.468363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911883d2-147c-4558-b4a2-85cdfb68db58 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:27.481564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 532/1056] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:20:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:27.482560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911883d2-147c-4558-b4a2-85cdfb68db58 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:27.495195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 525/1057] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:20:27.517717 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1a8c8-ba1c-4979-92f1-75fc5bcb8ba4 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:27.544757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:27.585199 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911883d2-147c-4558-b4a2-85cdfb68db58 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:27.613245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:27.619611 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d991fc-b677-4140-b80e-c6052994ea18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:27.620341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1a8c8-ba1c-4979-92f1-75fc5bcb8ba4 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:27.620470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d991fc-b677-4140-b80e-c6052994ea18 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:27.620760 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d991fc-b677-4140-b80e-c6052994ea18 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:27.621041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d991fc-b677-4140-b80e-c6052994ea18 None admin] PATH_INFO: `/v3/users/85b73312a50c41698cebaf132b89e704` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:27.635772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d991fc-b677-4140-b80e-c6052994ea18 None admin] RBAC: Authorizing `identity:get_user(user_id=85b73312a50c41698cebaf132b89e704)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:27.637301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d991fc-b677-4140-b80e-c6052994ea18 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:27.643609 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 533/1058] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:20:27 2022] GET /identity/v3/users/85b73312a50c41698cebaf132b89e704 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:20:27.643609 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334c902-9829-4758-81f2-bc1adb15c68e None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:27.643609 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334c902-9829-4758-81f2-bc1adb15c68e None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:27.643609 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334c902-9829-4758-81f2-bc1adb15c68e None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:27.643609 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 534/1059] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:27.645589 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334c902-9829-4758-81f2-bc1adb15c68e None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:27.658763 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120fa46-a14f-4933-883a-84a95b815ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:27.659406 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120fa46-a14f-4933-883a-84a95b815ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:27.659721 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120fa46-a14f-4933-883a-84a95b815ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:27.659996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120fa46-a14f-4933-883a-84a95b815ca2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:27.728640 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120fa46-a14f-4933-883a-84a95b815ca2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:27.730128 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120fa46-a14f-4933-883a-84a95b815ca2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:27.751613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334c902-9829-4758-81f2-bc1adb15c68e None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:27.758037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:27.786117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc015d3-dc66-49f3-b5c9-402614ffb67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:27.786780 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc015d3-dc66-49f3-b5c9-402614ffb67b None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:27.787074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc015d3-dc66-49f3-b5c9-402614ffb67b None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:27.787351 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc015d3-dc66-49f3-b5c9-402614ffb67b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:27.831605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 526/1060] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:20:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 12:20:27.832941 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd089e7-714f-434c-aea3-52078278c9eb None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:27.833266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd089e7-714f-434c-aea3-52078278c9eb None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:27.833580 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd089e7-714f-434c-aea3-52078278c9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:27.842574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:27.849864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6bd089e7-714f-434c-aea3-52078278c9eb None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:27.851141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6bd089e7-714f-434c-aea3-52078278c9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:27.855154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc015d3-dc66-49f3-b5c9-402614ffb67b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:27.856859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc015d3-dc66-49f3-b5c9-402614ffb67b None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:27.920114 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 527/1061] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:27.920960 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd089e7-714f-434c-aea3-52078278c9eb None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:27.961963 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 535/1062] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:20:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 12:20:27.961963 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc015d3-dc66-49f3-b5c9-402614ffb67b None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:27.994431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:28.040227 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd089e7-714f-434c-aea3-52078278c9eb None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:28.052244 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:28.065252 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc015d3-dc66-49f3-b5c9-402614ffb67b None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:28.076052 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f42c5-bfc2-49b0-8b32-02896d619d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:28.076844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f42c5-bfc2-49b0-8b32-02896d619d22 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:28.077126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f42c5-bfc2-49b0-8b32-02896d619d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:28.077403 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f42c5-bfc2-49b0-8b32-02896d619d22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:28.087987 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f42c5-bfc2-49b0-8b32-02896d619d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:28.089395 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f42c5-bfc2-49b0-8b32-02896d619d22 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:28.098962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada060ef-1163-406d-a64b-27bd2e22a43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:28.099828 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada060ef-1163-406d-a64b-27bd2e22a43e None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:28.100116 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada060ef-1163-406d-a64b-27bd2e22a43e None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:28.100391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada060ef-1163-406d-a64b-27bd2e22a43e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:28.106566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-392f42c5-bfc2-49b0-8b32-02896d619d22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:28.106566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:28.106566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:28.106566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:28.106566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:28.106566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:28.106566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:28.106566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:28.106566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:28.106566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:28.106566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:28.106566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:28.106566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:20:28.106566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:20:28.106566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:20:28.107449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:20:28.107449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:28.107449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:28.107449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:28.107449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:28.107449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:28.107449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:28.107449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:28.107449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:28.107449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:28.107449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:28.107449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:28.107449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:28.107449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:28.107449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:28.107449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:28.107449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:28.113417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:20:28.113417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:20:28.113417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:28.113417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:28.113417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 528/1063] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:28.113417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f42c5-bfc2-49b0-8b32-02896d619d22 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:28.113782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada060ef-1163-406d-a64b-27bd2e22a43e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:20:28.118981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-ada060ef-1163-406d-a64b-27bd2e22a43e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:20:28.118981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:28.118981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:28.118981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:28.118981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:28.118981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:28.118981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:28.118981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:28.118981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:28.118981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:28.118981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:28.118981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:28.118981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:20:28.118981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:20:28.118981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:20:28.118981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:20:28.120102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:20:28.120102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:20:28.120102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:20:28.120102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:20:28.120102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:28.120102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:28.120102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:28.120102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:28.120102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:28.120102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:28.120102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:28.120102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:28.120102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:28.120102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:28.120102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:28.120102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:28.120976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:28.120976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:28.120976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:28.120976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:28.120976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:20:28.120976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:20:28.120976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:20:28.120976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:20:28.120976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:20:28.120976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:20:28.120976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:20:28.120976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:28.120976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 536/1064] 10.222.0.25 () {56 vars in 1120 bytes} [Mon May 23 12:20:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:28.121711 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada060ef-1163-406d-a64b-27bd2e22a43e None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:28.215486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f42c5-bfc2-49b0-8b32-02896d619d22 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:28.220797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada060ef-1163-406d-a64b-27bd2e22a43e None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:28.224733 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:28.249656 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee8b7d-9759-45cc-a657-415982b44b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:28.250517 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee8b7d-9759-45cc-a657-415982b44b5b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:28.250808 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee8b7d-9759-45cc-a657-415982b44b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:28.251082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee8b7d-9759-45cc-a657-415982b44b5b None admin] PATH_INFO: `/v3/projects/ca76ebf8fe31456bbc15d0fe395e4676` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:28.252254 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee8b7d-9759-45cc-a657-415982b44b5b None admin] RBAC: Authorizing `identity:get_project(project_id=ca76ebf8fe31456bbc15d0fe395e4676)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:28.254238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee8b7d-9759-45cc-a657-415982b44b5b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:28.255844 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc23a14-ea0c-4899-a1dc-5e272bf6ce39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:28.255979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 529/1065] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:20:28 2022] GET /identity/v3/projects/ca76ebf8fe31456bbc15d0fe395e4676 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:28.256614 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc23a14-ea0c-4899-a1dc-5e272bf6ce39 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:28.256727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee8b7d-9759-45cc-a657-415982b44b5b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:28.256902 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc23a14-ea0c-4899-a1dc-5e272bf6ce39 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:28.257181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc23a14-ea0c-4899-a1dc-5e272bf6ce39 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:28.257898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc23a14-ea0c-4899-a1dc-5e272bf6ce39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:28.258208 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc23a14-ea0c-4899-a1dc-5e272bf6ce39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:28.259616 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc23a14-ea0c-4899-a1dc-5e272bf6ce39 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:28.282529 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 537/1066] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:28.282529 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc23a14-ea0c-4899-a1dc-5e272bf6ce39 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:28.287041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:28.383738 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc23a14-ea0c-4899-a1dc-5e272bf6ce39 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:28.388191 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee8b7d-9759-45cc-a657-415982b44b5b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:28.424142 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610c04a-b3ac-4d9d-8601-1d102f542b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:28.424820 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610c04a-b3ac-4d9d-8601-1d102f542b3c None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:28.425099 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610c04a-b3ac-4d9d-8601-1d102f542b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:28.425930 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610c04a-b3ac-4d9d-8601-1d102f542b3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:28.426801 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610c04a-b3ac-4d9d-8601-1d102f542b3c None admin] RBAC: Adding query filter params (role.id=3ae7c5e54e084ac4a1f94da93a667583, scope.project.id=ca76ebf8fe31456bbc15d0fe395e4676, user.id=85b73312a50c41698cebaf132b89e704) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:28.426923 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e26b0-69b1-44aa-93d5-7e631846c351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:28.427119 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610c04a-b3ac-4d9d-8601-1d102f542b3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:28.427466 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e26b0-69b1-44aa-93d5-7e631846c351 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:28.427749 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e26b0-69b1-44aa-93d5-7e631846c351 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:28.428021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e26b0-69b1-44aa-93d5-7e631846c351 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:28.428574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610c04a-b3ac-4d9d-8601-1d102f542b3c None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:28.428781 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e26b0-69b1-44aa-93d5-7e631846c351 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:28.429086 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e26b0-69b1-44aa-93d5-7e631846c351 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:28.430490 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e26b0-69b1-44aa-93d5-7e631846c351 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:28.435707 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 538/1067] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:20:28 2022] GET /identity/v3/role_assignments?user.id=85b73312a50c41698cebaf132b89e704&scope.project.id=ca76ebf8fe31456bbc15d0fe395e4676&role.id=3ae7c5e54e084ac4a1f94da93a667583 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:28.442766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 530/1068] 10.222.0.25 () {56 vars in 1115 bytes} [Mon May 23 12:20:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:28.448881 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610c04a-b3ac-4d9d-8601-1d102f542b3c None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:28.532364 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:28.568990 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610c04a-b3ac-4d9d-8601-1d102f542b3c None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:28.610260 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dedb517-5fab-4d40-9d48-63ec53fc38c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:28.611143 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedb517-5fab-4d40-9d48-63ec53fc38c8 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:28.611457 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedb517-5fab-4d40-9d48-63ec53fc38c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:28.611738 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedb517-5fab-4d40-9d48-63ec53fc38c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:28.623840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dedb517-5fab-4d40-9d48-63ec53fc38c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:28.625311 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dedb517-5fab-4d40-9d48-63ec53fc38c8 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:28.642392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-3dedb517-5fab-4d40-9d48-63ec53fc38c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:28.642392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:28.642392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:28.642392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:28.642392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:28.642392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:28.642392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:28.642392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:28.642392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:28.642392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:28.642392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:28.642392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:28.642392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:20:28.642392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:20:28.642392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:20:28.643506 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:20:28.643506 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:28.643506 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:28.643506 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:28.643506 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:28.643506 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:28.643506 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:28.643506 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:28.643506 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:28.643506 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:28.643506 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:28.643506 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:28.643506 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:28.643506 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:28.643506 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:28.643506 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:28.643506 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:28.645135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:20:28.645135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:20:28.645135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:28.645135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:28.645135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 539/1069] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:28.650345 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e26b0-69b1-44aa-93d5-7e631846c351 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:28.690245 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:28.751671 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e26b0-69b1-44aa-93d5-7e631846c351 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:28.786784 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510e462-7a3f-4f68-8f96-c4d77df546a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:28.787448 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510e462-7a3f-4f68-8f96-c4d77df546a5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:28.787735 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510e462-7a3f-4f68-8f96-c4d77df546a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:28.788013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510e462-7a3f-4f68-8f96-c4d77df546a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:28.788743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510e462-7a3f-4f68-8f96-c4d77df546a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:28.789052 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510e462-7a3f-4f68-8f96-c4d77df546a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:28.790443 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510e462-7a3f-4f68-8f96-c4d77df546a5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:28.801710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 531/1070] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:28.807276 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dedb517-5fab-4d40-9d48-63ec53fc38c8 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:28.905913 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dedb517-5fab-4d40-9d48-63ec53fc38c8 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:28.927961 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:28.939341 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e05a87-689c-4fb5-9bad-1494c333dd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:28.940124 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e05a87-689c-4fb5-9bad-1494c333dd8d None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:28.940405 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e05a87-689c-4fb5-9bad-1494c333dd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:28.940678 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e05a87-689c-4fb5-9bad-1494c333dd8d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:28.948778 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e05a87-689c-4fb5-9bad-1494c333dd8d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:28.950251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e05a87-689c-4fb5-9bad-1494c333dd8d None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:28.964278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-b3e05a87-689c-4fb5-9bad-1494c333dd8d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 12:20:28.964278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:28.964278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:28.964278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:28.964278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:28.964278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:28.964278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:28.964278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:28.964278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:28.964278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:28.964278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:28.964278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:28.964278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:20:28.964278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:20:28.964278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:20:28.964278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:20:28.965251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:28.965251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:28.965251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:20:28.965251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:20:28.965251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:20:28.965251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:20:28.965251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:28.965251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:28.965251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:28.965251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:28.965251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:28.965251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:28.965251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:28.965251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:28.965251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:28.965251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:28.965251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:28.965251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:28.966200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:28.966200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:28.966200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:20:28.966200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:20:28.966200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:20:28.966200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:20:28.966200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:20:28.966200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:20:28.966200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 12:20:28.966200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:28.966200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 540/1071] 10.222.0.25 () {56 vars in 1093 bytes} [Mon May 23 12:20:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:28.971240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510e462-7a3f-4f68-8f96-c4d77df546a5 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:29.066267 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:29.070941 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510e462-7a3f-4f68-8f96-c4d77df546a5 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:29.105069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbf2d1-ce55-4d7f-80c3-a790f0d0b045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:29.105986 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbf2d1-ce55-4d7f-80c3-a790f0d0b045 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:29.106273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbf2d1-ce55-4d7f-80c3-a790f0d0b045 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:29.106642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbf2d1-ce55-4d7f-80c3-a790f0d0b045 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:29.107483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbf2d1-ce55-4d7f-80c3-a790f0d0b045 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:29.107795 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbf2d1-ce55-4d7f-80c3-a790f0d0b045 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:29.109233 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbf2d1-ce55-4d7f-80c3-a790f0d0b045 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:29.127141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 532/1072] 10.222.0.25 () {56 vars in 1133 bytes} [Mon May 23 12:20:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:29.133584 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e05a87-689c-4fb5-9bad-1494c333dd8d None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:29.239429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e05a87-689c-4fb5-9bad-1494c333dd8d None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:29.274759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416a302-aeaf-4e03-982e-f1989c8132a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:29.275549 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416a302-aeaf-4e03-982e-f1989c8132a1 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:29.275874 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416a302-aeaf-4e03-982e-f1989c8132a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:29.276189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416a302-aeaf-4e03-982e-f1989c8132a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:29.287432 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416a302-aeaf-4e03-982e-f1989c8132a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:29.288974 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416a302-aeaf-4e03-982e-f1989c8132a1 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:29.307051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-0416a302-aeaf-4e03-982e-f1989c8132a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:29.307051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:29.307051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:29.307051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:29.307051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:29.307051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:29.307051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:29.307051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:29.307051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:29.307051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:29.307051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:29.307051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:29.307051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:20:29.307051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:20:29.307051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:20:29.308098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:20:29.308098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:29.308098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:29.308098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:29.308098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:29.308098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:29.308098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:29.308098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:29.308098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:29.308098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:29.308098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:29.308098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:29.308098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:29.308098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:29.308098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:29.308098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:29.308098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:29.309195 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:20:29.309195 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:20:29.309195 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:29.309195 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:29.310807 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 541/1073] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:29.314219 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbf2d1-ce55-4d7f-80c3-a790f0d0b045 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:29.412729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbf2d1-ce55-4d7f-80c3-a790f0d0b045 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:29.446487 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5e333-b005-422e-a260-c3793dbaeca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:29.447105 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5e333-b005-422e-a260-c3793dbaeca4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:29.447390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5e333-b005-422e-a260-c3793dbaeca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:29.447665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5e333-b005-422e-a260-c3793dbaeca4 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:29.448381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5e333-b005-422e-a260-c3793dbaeca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:29.448688 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5e333-b005-422e-a260-c3793dbaeca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:29.450069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5e333-b005-422e-a260-c3793dbaeca4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:29.461144 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 533/1074] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:29.466791 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416a302-aeaf-4e03-982e-f1989c8132a1 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:29.501913 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:29.568219 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416a302-aeaf-4e03-982e-f1989c8132a1 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:29.603802 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8e7c7-bb94-4147-836e-0f64782380c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:29.604598 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8e7c7-bb94-4147-836e-0f64782380c4 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:29.604927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8e7c7-bb94-4147-836e-0f64782380c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:29.605233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8e7c7-bb94-4147-836e-0f64782380c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:29.612805 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8e7c7-bb94-4147-836e-0f64782380c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:29.614379 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8e7c7-bb94-4147-836e-0f64782380c4 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:29.630174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-f7e8e7c7-bb94-4147-836e-0f64782380c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:20:29.630174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:29.630174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:29.630174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:29.630174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:29.630174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:29.630174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:29.630174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:29.630174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:29.630174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:29.630174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:29.630174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:29.630174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:20:29.630174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:20:29.630174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:20:29.631233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:20:29.631233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:29.631233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:29.631233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:29.631233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:29.631233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:29.631233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:29.631233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:29.631233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:29.631233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:29.631233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:29.631233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:29.631233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:29.631233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:29.631233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:29.631233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:29.631233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:29.632152 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:20:29.632152 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:20:29.632152 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:20:29.632152 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:20:29.632152 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:20:29.632152 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:20:29.632152 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:20:29.632152 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:29.632152 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 542/1075] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:20:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:29.637503 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5e333-b005-422e-a260-c3793dbaeca4 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:29.656577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:29.735910 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5e333-b005-422e-a260-c3793dbaeca4 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:29.767639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae59fc-146f-4105-90c0-2c2b3a2d56da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:29.768286 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae59fc-146f-4105-90c0-2c2b3a2d56da None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:29.768571 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae59fc-146f-4105-90c0-2c2b3a2d56da None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:29.768867 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae59fc-146f-4105-90c0-2c2b3a2d56da None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:29.770185 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae59fc-146f-4105-90c0-2c2b3a2d56da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:29.770496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae59fc-146f-4105-90c0-2c2b3a2d56da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:29.772076 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae59fc-146f-4105-90c0-2c2b3a2d56da None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:29.783751 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 534/1076] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:20:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:29.789781 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8e7c7-bb94-4147-836e-0f64782380c4 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:29.881921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:29.888171 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8e7c7-bb94-4147-836e-0f64782380c4 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:29.922212 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad7e84-ddcf-4a01-b34c-7d0bf6a00fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:29.923118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad7e84-ddcf-4a01-b34c-7d0bf6a00fef None admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:29.923407 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad7e84-ddcf-4a01-b34c-7d0bf6a00fef None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:29.923687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad7e84-ddcf-4a01-b34c-7d0bf6a00fef None admin] PATH_INFO: `/v3/projects/402397b981be4f0c9e778a2771c41937/users/d49997b9108145b78eb4db1d8823bf4d/roles/66df182349134f17825bf29c92d8c87b` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:29.925877 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad7e84-ddcf-4a01-b34c-7d0bf6a00fef None admin] RBAC: Authorizing `identity:create_grant(project_id=402397b981be4f0c9e778a2771c41937, user_id=d49997b9108145b78eb4db1d8823bf4d, role_id=66df182349134f17825bf29c92d8c87b)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:29.927465 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad7e84-ddcf-4a01-b34c-7d0bf6a00fef None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:29.939923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 543/1077] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:20:29 2022] PUT /identity/v3/projects/402397b981be4f0c9e778a2771c41937/users/d49997b9108145b78eb4db1d8823bf4d/roles/66df182349134f17825bf29c92d8c87b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:20:30.646431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e97333-c37a-40e4-9285-7ff424f2ca6d None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:30.647005 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e97333-c37a-40e4-9285-7ff424f2ca6d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:30.647005 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e97333-c37a-40e4-9285-7ff424f2ca6d None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:30.648361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 535/1078] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:30.653705 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38e0e4-7ad2-42b0-bb6c-a6152b5c41c5 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:30.654140 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38e0e4-7ad2-42b0-bb6c-a6152b5c41c5 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:30.654264 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38e0e4-7ad2-42b0-bb6c-a6152b5c41c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:30.670128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-df38e0e4-7ad2-42b0-bb6c-a6152b5c41c5 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:30.671335 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-df38e0e4-7ad2-42b0-bb6c-a6152b5c41c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:30.736468 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 544/1079] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:30.758931 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e97333-c37a-40e4-9285-7ff424f2ca6d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:30.833569 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:30.857523 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e97333-c37a-40e4-9285-7ff424f2ca6d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:30.890204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79a93b-9d02-4d57-81b6-f34e5edbdc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:30.890999 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79a93b-9d02-4d57-81b6-f34e5edbdc1f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:30.891289 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79a93b-9d02-4d57-81b6-f34e5edbdc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:30.891558 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79a93b-9d02-4d57-81b6-f34e5edbdc1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:30.901282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79a93b-9d02-4d57-81b6-f34e5edbdc1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:20:30.908583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-ad79a93b-9d02-4d57-81b6-f34e5edbdc1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:20:30.908583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:30.908583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:30.908583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:30.908583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:30.908583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:30.908583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:30.908583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:30.908583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:30.908583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:30.908583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:30.908583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:30.908583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:20:30.908583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:20:30.908583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:20:30.908583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:20:30.909689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:20:30.909689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:20:30.909689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:20:30.909689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:20:30.909689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:30.909689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:30.909689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:30.909689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:30.909689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:30.909689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:30.909689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:30.909689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:30.909689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:30.909689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:30.909689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:30.909689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:30.910592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:30.910592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:30.910592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:30.910592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:30.910592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:20:30.910592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:20:30.910592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:20:30.910592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:20:30.910592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:20:30.910592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:20:30.910592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:20:30.910592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:30.910592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 536/1080] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:20:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:30.915589 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38e0e4-7ad2-42b0-bb6c-a6152b5c41c5 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:30.998866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:31.014070 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38e0e4-7ad2-42b0-bb6c-a6152b5c41c5 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:31.048839 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1ba19-401d-4d3b-9bd9-4887b132c24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:31.049505 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1ba19-401d-4d3b-9bd9-4887b132c24b None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:31.049789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1ba19-401d-4d3b-9bd9-4887b132c24b None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:31.050116 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1ba19-401d-4d3b-9bd9-4887b132c24b None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:31.050898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1ba19-401d-4d3b-9bd9-4887b132c24b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:31.051204 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1ba19-401d-4d3b-9bd9-4887b132c24b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:31.052576 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1ba19-401d-4d3b-9bd9-4887b132c24b None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:31.061110 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 545/1081] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:20:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:31.067416 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79a93b-9d02-4d57-81b6-f34e5edbdc1f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:31.168153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79a93b-9d02-4d57-81b6-f34e5edbdc1f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:31.201258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8bfb5-8702-403e-a7c0-60e2142982fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:31.202132 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8bfb5-8702-403e-a7c0-60e2142982fb None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:31.202416 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8bfb5-8702-403e-a7c0-60e2142982fb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:31.202723 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8bfb5-8702-403e-a7c0-60e2142982fb None admin] PATH_INFO: `/v3/users/85b73312a50c41698cebaf132b89e704` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:31.203913 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8bfb5-8702-403e-a7c0-60e2142982fb None admin] RBAC: Authorizing `identity:get_user(user_id=85b73312a50c41698cebaf132b89e704)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:31.205371 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8bfb5-8702-403e-a7c0-60e2142982fb None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:31.207656 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 537/1082] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:20:31 2022] GET /identity/v3/users/85b73312a50c41698cebaf132b89e704 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:31.213236 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1ba19-401d-4d3b-9bd9-4887b132c24b None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:31.308169 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1ba19-401d-4d3b-9bd9-4887b132c24b None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:31.341013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9770a2b-ab10-4a87-b2fa-fd26ac244df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:31.341880 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9770a2b-ab10-4a87-b2fa-fd26ac244df5 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:31.342164 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9770a2b-ab10-4a87-b2fa-fd26ac244df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:31.342439 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9770a2b-ab10-4a87-b2fa-fd26ac244df5 None admin] PATH_INFO: `/v3/projects/ca76ebf8fe31456bbc15d0fe395e4676` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:31.343617 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9770a2b-ab10-4a87-b2fa-fd26ac244df5 None admin] RBAC: Authorizing `identity:get_project(project_id=ca76ebf8fe31456bbc15d0fe395e4676)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:31.345051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9770a2b-ab10-4a87-b2fa-fd26ac244df5 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:31.346771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 546/1083] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:20:31 2022] GET /identity/v3/projects/ca76ebf8fe31456bbc15d0fe395e4676 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:20:31.352472 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8bfb5-8702-403e-a7c0-60e2142982fb None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:31.356418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:31.452283 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8bfb5-8702-403e-a7c0-60e2142982fb None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:31.485293 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33ec00-75b6-4595-980c-0a110444a7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:31.486173 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33ec00-75b6-4595-980c-0a110444a7d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:31.486458 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33ec00-75b6-4595-980c-0a110444a7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:31.486767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33ec00-75b6-4595-980c-0a110444a7d9 None admin] PATH_INFO: `/v3/projects/ca76ebf8fe31456bbc15d0fe395e4676/users/85b73312a50c41698cebaf132b89e704/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:31.489293 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33ec00-75b6-4595-980c-0a110444a7d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca76ebf8fe31456bbc15d0fe395e4676, user_id=85b73312a50c41698cebaf132b89e704, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:31.490773 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33ec00-75b6-4595-980c-0a110444a7d9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:31.503136 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 538/1084] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:20:31 2022] PUT /identity/v3/projects/ca76ebf8fe31456bbc15d0fe395e4676/users/85b73312a50c41698cebaf132b89e704/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:20:32.140198 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db463b7-2a0a-49d6-8ecc-bffe3b53fccd None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:32.140765 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db463b7-2a0a-49d6-8ecc-bffe3b53fccd None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:32.140765 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db463b7-2a0a-49d6-8ecc-bffe3b53fccd None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:32.142112 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 547/1085] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:32.147481 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149f38d-fcd9-4446-8f15-ad2ba1909f19 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:32.147912 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149f38d-fcd9-4446-8f15-ad2ba1909f19 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:32.148041 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149f38d-fcd9-4446-8f15-ad2ba1909f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:32.165383 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-8149f38d-fcd9-4446-8f15-ad2ba1909f19 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:32.166623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8149f38d-fcd9-4446-8f15-ad2ba1909f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:32.229387 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:32.238916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 539/1086] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:32.261763 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db463b7-2a0a-49d6-8ecc-bffe3b53fccd None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:32.280189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:32.371756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db463b7-2a0a-49d6-8ecc-bffe3b53fccd None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:32.407158 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce981432-479b-4ebe-ae49-1958bb19f531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:32.407897 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce981432-479b-4ebe-ae49-1958bb19f531 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:32.408222 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce981432-479b-4ebe-ae49-1958bb19f531 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:32.408557 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce981432-479b-4ebe-ae49-1958bb19f531 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:32.419248 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce981432-479b-4ebe-ae49-1958bb19f531 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:20:32.429475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-ce981432-479b-4ebe-ae49-1958bb19f531 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:20:32.429475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:32.429475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:32.429475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:32.429475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:32.429475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:32.429475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:32.429475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:32.429475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:32.429475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:32.429475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:32.429475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:32.429475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:20:32.429475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:20:32.429475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:20:32.429475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:20:32.430681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:20:32.430681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:20:32.430681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:20:32.430681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:20:32.430681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:32.430681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:32.430681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:32.430681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:32.430681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:32.430681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:32.430681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:32.430681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:32.430681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:32.430681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:32.430681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:32.430681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:32.431587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:32.431587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:32.431587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:32.431587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:32.431587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:20:32.431587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:20:32.431587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:20:32.431587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:20:32.431587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:20:32.431587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:20:32.431587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 12:20:32.431587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:32.431587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 548/1087] 10.222.0.25 () {56 vars in 1120 bytes} [Mon May 23 12:20:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:32.436725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149f38d-fcd9-4446-8f15-ad2ba1909f19 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:32.537260 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149f38d-fcd9-4446-8f15-ad2ba1909f19 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:32.570339 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafca039-6da7-4e58-aa86-9b53e4698bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:32.571026 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafca039-6da7-4e58-aa86-9b53e4698bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:32.571313 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafca039-6da7-4e58-aa86-9b53e4698bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:32.571589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafca039-6da7-4e58-aa86-9b53e4698bf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:32.572331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafca039-6da7-4e58-aa86-9b53e4698bf7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:32.572636 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafca039-6da7-4e58-aa86-9b53e4698bf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:32.574016 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafca039-6da7-4e58-aa86-9b53e4698bf7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:32.581920 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 540/1088] 10.222.0.25 () {56 vars in 1115 bytes} [Mon May 23 12:20:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:20:32.587418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce981432-479b-4ebe-ae49-1958bb19f531 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:32.667892 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:32.692543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce981432-479b-4ebe-ae49-1958bb19f531 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:32.726143 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e66a7b-c385-4ef0-8037-69e094131620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:32.727034 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e66a7b-c385-4ef0-8037-69e094131620 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:32.727324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e66a7b-c385-4ef0-8037-69e094131620 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:32.727605 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e66a7b-c385-4ef0-8037-69e094131620 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:32.739157 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e66a7b-c385-4ef0-8037-69e094131620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:32.740618 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e66a7b-c385-4ef0-8037-69e094131620 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:32.757604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-48e66a7b-c385-4ef0-8037-69e094131620 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:32.757604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:32.757604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:32.757604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:32.757604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:32.757604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:32.757604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:32.757604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:32.757604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:32.757604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:32.757604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:32.757604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:32.757604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:20:32.757604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:20:32.757604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:20:32.758664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:20:32.758664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:32.758664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:32.758664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:32.758664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:32.758664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:32.758664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:32.758664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:32.758664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:32.758664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:32.758664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:32.758664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:32.758664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:32.758664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:32.758664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:32.758664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:32.758664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:32.760004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:20:32.760004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:20:32.760004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:32.760004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:32.760004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 549/1089] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:32.764465 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafca039-6da7-4e58-aa86-9b53e4698bf7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:32.819176 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:32.861581 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafca039-6da7-4e58-aa86-9b53e4698bf7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:32.894703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f64f5-b440-43c3-b4a2-419ccfe5432e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:32.895355 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f64f5-b440-43c3-b4a2-419ccfe5432e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:32.895636 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f64f5-b440-43c3-b4a2-419ccfe5432e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:32.895910 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f64f5-b440-43c3-b4a2-419ccfe5432e None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:32.896618 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f64f5-b440-43c3-b4a2-419ccfe5432e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:32.896919 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f64f5-b440-43c3-b4a2-419ccfe5432e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:32.898298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f64f5-b440-43c3-b4a2-419ccfe5432e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:32.909683 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 541/1090] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:32.915202 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e66a7b-c385-4ef0-8037-69e094131620 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:33.014800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e66a7b-c385-4ef0-8037-69e094131620 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:33.039781 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:33.048206 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea3f24-5997-4398-a677-36188dcdfc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:33.048988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea3f24-5997-4398-a677-36188dcdfc81 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:33.049275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea3f24-5997-4398-a677-36188dcdfc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:33.049552 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea3f24-5997-4398-a677-36188dcdfc81 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:33.057651 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea3f24-5997-4398-a677-36188dcdfc81 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:33.059136 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea3f24-5997-4398-a677-36188dcdfc81 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:33.072845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-4aea3f24-5997-4398-a677-36188dcdfc81 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 12:20:33.072845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:33.072845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:33.072845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:33.072845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:33.072845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:33.072845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:33.072845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:33.072845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:33.072845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:33.072845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:33.072845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:33.072845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:20:33.072845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:20:33.072845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:20:33.072845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:20:33.073896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:33.073896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:33.073896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:20:33.073896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:20:33.073896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:20:33.073896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:20:33.073896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:33.073896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:33.073896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:33.073896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:33.073896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:33.073896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:33.073896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:33.073896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:33.073896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:33.073896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:33.073896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:33.073896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:33.075406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:33.075406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:33.075406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:20:33.075406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:20:33.075406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:20:33.075406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:20:33.075406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:20:33.075406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:20:33.075406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 12:20:33.075406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:33.075406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 550/1091] 10.222.0.25 () {56 vars in 1093 bytes} [Mon May 23 12:20:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:33.079697 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f64f5-b440-43c3-b4a2-419ccfe5432e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:33.179774 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f64f5-b440-43c3-b4a2-419ccfe5432e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:33.198188 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:33.216145 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92762165-3b69-4d5b-8381-87c416b4b9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:33.216808 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92762165-3b69-4d5b-8381-87c416b4b9bf None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:33.217089 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92762165-3b69-4d5b-8381-87c416b4b9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:33.217361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92762165-3b69-4d5b-8381-87c416b4b9bf None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:33.218241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92762165-3b69-4d5b-8381-87c416b4b9bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:33.218582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92762165-3b69-4d5b-8381-87c416b4b9bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:33.220024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92762165-3b69-4d5b-8381-87c416b4b9bf None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:33.236892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 542/1092] 10.222.0.25 () {56 vars in 1133 bytes} [Mon May 23 12:20:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:33.243121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea3f24-5997-4398-a677-36188dcdfc81 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:33.341383 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea3f24-5997-4398-a677-36188dcdfc81 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:33.374751 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf372cd4-e1ab-424d-bada-9e8f3e1f9187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:33.375393 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf372cd4-e1ab-424d-bada-9e8f3e1f9187 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:33.375675 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf372cd4-e1ab-424d-bada-9e8f3e1f9187 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:33.375949 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf372cd4-e1ab-424d-bada-9e8f3e1f9187 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:33.429632 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:33.442056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf372cd4-e1ab-424d-bada-9e8f3e1f9187 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:33.443553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf372cd4-e1ab-424d-bada-9e8f3e1f9187 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:33.544184 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 551/1093] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:20:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:20:33.549931 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92762165-3b69-4d5b-8381-87c416b4b9bf None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:33.651732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92762165-3b69-4d5b-8381-87c416b4b9bf None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:33.686254 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb992d-f7a9-449b-b2a6-881195b2595b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:33.687064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb992d-f7a9-449b-b2a6-881195b2595b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:33.687349 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb992d-f7a9-449b-b2a6-881195b2595b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:33.687623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb992d-f7a9-449b-b2a6-881195b2595b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:33.697474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb992d-f7a9-449b-b2a6-881195b2595b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:33.698974 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb992d-f7a9-449b-b2a6-881195b2595b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:33.716301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-3feb992d-f7a9-449b-b2a6-881195b2595b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:33.716301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:33.716301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:33.716301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:33.716301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:33.716301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:33.716301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:33.716301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:33.716301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:33.716301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:33.716301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:33.716301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:33.716301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:20:33.716301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:20:33.716301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:20:33.717183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:20:33.717183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:33.717183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:33.717183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:33.717183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:33.717183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:33.717183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:33.717183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:33.717183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:33.717183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:33.717183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:33.717183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:33.717183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:33.717183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:33.717183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:33.717183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:33.717183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:33.718238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:20:33.718238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:20:33.718238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:20:33.718238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:33.718238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 543/1094] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:33.723694 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf372cd4-e1ab-424d-bada-9e8f3e1f9187 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:33.783817 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975255c-6d87-4d6f-bf30-f8bcd6963269 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:33.784107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975255c-6d87-4d6f-bf30-f8bcd6963269 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:33.784938 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975255c-6d87-4d6f-bf30-f8bcd6963269 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:33.786453 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 544/1095] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:33.791431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5620c-636a-4902-b1ea-72f292a92f7e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:33.791721 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5620c-636a-4902-b1ea-72f292a92f7e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:33.791994 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5620c-636a-4902-b1ea-72f292a92f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:33.808056 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7bb5620c-636a-4902-b1ea-72f292a92f7e None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:33.809229 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7bb5620c-636a-4902-b1ea-72f292a92f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:33.812487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:33.826019 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf372cd4-e1ab-424d-bada-9e8f3e1f9187 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:33.831645 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:33.865483 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511d08a-82a5-4ce6-8fde-3b447cc105b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:33.866447 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511d08a-82a5-4ce6-8fde-3b447cc105b5 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:33.866902 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511d08a-82a5-4ce6-8fde-3b447cc105b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:33.867320 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511d08a-82a5-4ce6-8fde-3b447cc105b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:33.868419 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511d08a-82a5-4ce6-8fde-3b447cc105b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:33.868890 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511d08a-82a5-4ce6-8fde-3b447cc105b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:33.871040 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511d08a-82a5-4ce6-8fde-3b447cc105b5 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:33.879511 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 545/1096] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:20:33.893451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 552/1097] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:33.895365 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5620c-636a-4902-b1ea-72f292a92f7e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:33.903962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511d08a-82a5-4ce6-8fde-3b447cc105b5 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:33.998065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5620c-636a-4902-b1ea-72f292a92f7e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:34.005026 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511d08a-82a5-4ce6-8fde-3b447cc105b5 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:34.033080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e27bf-45d1-48bf-b530-b54bee3bc7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:34.033866 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e27bf-45d1-48bf-b530-b54bee3bc7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:34.034147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e27bf-45d1-48bf-b530-b54bee3bc7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:34.034990 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e27bf-45d1-48bf-b530-b54bee3bc7f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:34.039921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8b1a7-f2a0-4917-a4fb-a29b3bda6dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:34.040788 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8b1a7-f2a0-4917-a4fb-a29b3bda6dad None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:34.041214 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8b1a7-f2a0-4917-a4fb-a29b3bda6dad None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:34.041579 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e27bf-45d1-48bf-b530-b54bee3bc7f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:34.041689 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8b1a7-f2a0-4917-a4fb-a29b3bda6dad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:34.043069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e27bf-45d1-48bf-b530-b54bee3bc7f3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:34.052522 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8b1a7-f2a0-4917-a4fb-a29b3bda6dad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:20:34.056417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-080e27bf-45d1-48bf-b530-b54bee3bc7f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:20:34.056417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:34.056417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:34.056417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:34.056417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:34.056417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:34.056417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:34.056417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:34.056417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:34.056417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:34.056417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:34.056417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:34.056417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:20:34.056417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:20:34.056417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:20:34.057273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:20:34.057273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:34.057273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:34.057273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:34.057273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:34.057273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:34.057273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:34.057273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:34.057273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:20:34.057273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:34.057273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:34.057273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:34.057273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:34.057273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:34.057273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:34.057273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:34.057273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:34.058169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:20:34.058169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:20:34.058169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:20:34.058169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:20:34.058169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:20:34.058169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:20:34.058169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:20:34.058169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:20:34.058169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 546/1098] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:20:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:34.060065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-e4f8b1a7-f2a0-4917-a4fb-a29b3bda6dad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:20:34.060065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:34.060065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:34.060065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:34.060065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:34.060065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:34.060065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:34.060065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:34.060065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:34.060065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:34.060065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:34.060065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:34.060065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:20:34.060065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:20:34.060065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:20:34.060065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:20:34.061154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:20:34.061154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:20:34.061154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:20:34.061154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:20:34.061154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:34.061154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:34.061154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:34.061154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:34.061154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:34.061154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:34.061154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:34.061154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:34.061154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:34.061154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:34.061154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:34.061154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:34.062007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:34.062007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:34.062007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:34.062007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:34.062007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:20:34.062007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:20:34.062007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:20:34.062007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:20:34.062007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:20:34.062007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:20:34.062007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:20:34.062007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:34.062007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 553/1099] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:20:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:34.063270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e27bf-45d1-48bf-b530-b54bee3bc7f3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:34.067648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8b1a7-f2a0-4917-a4fb-a29b3bda6dad None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:34.080228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:34.082494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:34.169743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e27bf-45d1-48bf-b530-b54bee3bc7f3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:34.171493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8b1a7-f2a0-4917-a4fb-a29b3bda6dad None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:34.207190 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c8e1e-7f62-48a4-9f42-f3aaf7d36a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:34.208203 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c8e1e-7f62-48a4-9f42-f3aaf7d36a8e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:34.208203 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c8e1e-7f62-48a4-9f42-f3aaf7d36a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:34.208371 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c8e1e-7f62-48a4-9f42-f3aaf7d36a8e None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:34.209167 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c8e1e-7f62-48a4-9f42-f3aaf7d36a8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:34.209476 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c8e1e-7f62-48a4-9f42-f3aaf7d36a8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:34.211873 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c8e1e-7f62-48a4-9f42-f3aaf7d36a8e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:34.212205 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de98bb-2668-4b43-90db-15f3405b9767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:34.213306 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de98bb-2668-4b43-90db-15f3405b9767 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:34.213835 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de98bb-2668-4b43-90db-15f3405b9767 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:34.214351 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de98bb-2668-4b43-90db-15f3405b9767 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:34.215289 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de98bb-2668-4b43-90db-15f3405b9767 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:34.215602 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de98bb-2668-4b43-90db-15f3405b9767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:34.217100 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de98bb-2668-4b43-90db-15f3405b9767 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:34.223983 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 547/1100] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:20:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:34.227606 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 554/1101] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:20:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:34.231040 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c8e1e-7f62-48a4-9f42-f3aaf7d36a8e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:34.233569 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de98bb-2668-4b43-90db-15f3405b9767 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:34.303752 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:34.307038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:34.330040 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c8e1e-7f62-48a4-9f42-f3aaf7d36a8e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:34.336419 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de98bb-2668-4b43-90db-15f3405b9767 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:34.363828 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bd5f3-8160-48ed-ae81-2ea2992aa6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:34.364479 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bd5f3-8160-48ed-ae81-2ea2992aa6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:34.364766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bd5f3-8160-48ed-ae81-2ea2992aa6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:34.365045 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bd5f3-8160-48ed-ae81-2ea2992aa6d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:34.365901 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bd5f3-8160-48ed-ae81-2ea2992aa6d6 None admin] RBAC: Adding query filter params (role.id=66df182349134f17825bf29c92d8c87b, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=d49997b9108145b78eb4db1d8823bf4d) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:34.366213 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bd5f3-8160-48ed-ae81-2ea2992aa6d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:34.367696 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bd5f3-8160-48ed-ae81-2ea2992aa6d6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:34.369077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ccea0-16b8-460b-8350-61c1c44003d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:34.369939 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ccea0-16b8-460b-8350-61c1c44003d7 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:34.370224 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ccea0-16b8-460b-8350-61c1c44003d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:34.370510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ccea0-16b8-460b-8350-61c1c44003d7 None admin] PATH_INFO: `/v3/users/85b73312a50c41698cebaf132b89e704` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:34.371717 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ccea0-16b8-460b-8350-61c1c44003d7 None admin] RBAC: Authorizing `identity:get_user(user_id=85b73312a50c41698cebaf132b89e704)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:34.373139 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ccea0-16b8-460b-8350-61c1c44003d7 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:34.373533 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 548/1102] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:20:34 2022] GET /identity/v3/role_assignments?user.id=d49997b9108145b78eb4db1d8823bf4d&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=66df182349134f17825bf29c92d8c87b => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:20:34.375045 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 555/1103] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:20:34 2022] GET /identity/v3/users/85b73312a50c41698cebaf132b89e704 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:20:34.381078 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bd5f3-8160-48ed-ae81-2ea2992aa6d6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:34.485152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bd5f3-8160-48ed-ae81-2ea2992aa6d6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:34.520611 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90311560-9118-4ac6-8c30-ab2ead783e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:34.521266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90311560-9118-4ac6-8c30-ab2ead783e05 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:34.521548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90311560-9118-4ac6-8c30-ab2ead783e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:34.521823 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90311560-9118-4ac6-8c30-ab2ead783e05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:34.533381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:34.590969 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90311560-9118-4ac6-8c30-ab2ead783e05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:34.592438 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90311560-9118-4ac6-8c30-ab2ead783e05 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:34.692407 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 549/1104] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:20:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 12:20:34.698540 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ccea0-16b8-460b-8350-61c1c44003d7 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:34.800776 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ccea0-16b8-460b-8350-61c1c44003d7 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:34.836676 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d446804-5c59-414b-a047-50009d4d81fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:34.837619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d446804-5c59-414b-a047-50009d4d81fe None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:34.837936 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d446804-5c59-414b-a047-50009d4d81fe None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:34.838233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d446804-5c59-414b-a047-50009d4d81fe None admin] PATH_INFO: `/v3/projects/ca76ebf8fe31456bbc15d0fe395e4676` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:34.839531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d446804-5c59-414b-a047-50009d4d81fe None admin] RBAC: Authorizing `identity:get_project(project_id=ca76ebf8fe31456bbc15d0fe395e4676)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:34.841127 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d446804-5c59-414b-a047-50009d4d81fe None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:34.843058 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 556/1105] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:20:34 2022] GET /identity/v3/projects/ca76ebf8fe31456bbc15d0fe395e4676 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:34.849731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90311560-9118-4ac6-8c30-ab2ead783e05 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:34.894014 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:34.953930 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90311560-9118-4ac6-8c30-ab2ead783e05 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:34.989680 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc5d95-3e81-425f-847c-17851573661c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:34.990336 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc5d95-3e81-425f-847c-17851573661c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:34.990655 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc5d95-3e81-425f-847c-17851573661c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:34.990935 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc5d95-3e81-425f-847c-17851573661c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:34.991772 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc5d95-3e81-425f-847c-17851573661c None admin] RBAC: Adding query filter params (role.id=3ae7c5e54e084ac4a1f94da93a667583, scope.project.id=ca76ebf8fe31456bbc15d0fe395e4676, user.id=85b73312a50c41698cebaf132b89e704) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:34.992085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc5d95-3e81-425f-847c-17851573661c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:34.993574 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc5d95-3e81-425f-847c-17851573661c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:34.999573 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 550/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:20:34 2022] GET /identity/v3/role_assignments?user.id=85b73312a50c41698cebaf132b89e704&scope.project.id=ca76ebf8fe31456bbc15d0fe395e4676&role.id=3ae7c5e54e084ac4a1f94da93a667583 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:20:37.211878 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da631bcb-fd39-4495-80ee-c966f294cada None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:37.212375 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da631bcb-fd39-4495-80ee-c966f294cada None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:37.212470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da631bcb-fd39-4495-80ee-c966f294cada None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:37.213802 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 557/1107] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:37.219052 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b52439-f084-491d-9f5d-197871a639ae None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:37.219473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b52439-f084-491d-9f5d-197871a639ae None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:37.219623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b52439-f084-491d-9f5d-197871a639ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:37.236318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c4b52439-f084-491d-9f5d-197871a639ae None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:37.237507 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c4b52439-f084-491d-9f5d-197871a639ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:37.301373 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 551/1108] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:37.325427 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da631bcb-fd39-4495-80ee-c966f294cada None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:37.335488 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:37.427528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da631bcb-fd39-4495-80ee-c966f294cada None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:37.460565 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a138383-fb1b-4e89-9caa-c4beb201ed59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:37.461287 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a138383-fb1b-4e89-9caa-c4beb201ed59 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:37.461574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a138383-fb1b-4e89-9caa-c4beb201ed59 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:37.461853 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a138383-fb1b-4e89-9caa-c4beb201ed59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:37.463035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a138383-fb1b-4e89-9caa-c4beb201ed59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:37.464471 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a138383-fb1b-4e89-9caa-c4beb201ed59 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:37.466047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 558/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:37.472300 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b52439-f084-491d-9f5d-197871a639ae None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:37.504556 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:37.568993 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b52439-f084-491d-9f5d-197871a639ae None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:37.602368 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b0cb3-6700-4956-981e-686b7c2e20c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:37.603072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b0cb3-6700-4956-981e-686b7c2e20c2 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:37.603359 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b0cb3-6700-4956-981e-686b7c2e20c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:37.603637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b0cb3-6700-4956-981e-686b7c2e20c2 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:37.604349 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b0cb3-6700-4956-981e-686b7c2e20c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:37.606053 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b0cb3-6700-4956-981e-686b7c2e20c2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:37.625336 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 552/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Mon May 23 12:20:37 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:20:39.826952 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451dcf5-1232-4fb2-bdaa-0a684f5a0451 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:39.827512 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451dcf5-1232-4fb2-bdaa-0a684f5a0451 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:39.827512 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d451dcf5-1232-4fb2-bdaa-0a684f5a0451 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:39.828873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 559/1111] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:39.834553 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed493d-4b29-40c4-be78-f729bb42d24e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:39.834998 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed493d-4b29-40c4-be78-f729bb42d24e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:39.835124 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed493d-4b29-40c4-be78-f729bb42d24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:39.852109 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-42ed493d-4b29-40c4-be78-f729bb42d24e None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:39.853300 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-42ed493d-4b29-40c4-be78-f729bb42d24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:39.917448 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 553/1112] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:39.940481 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451dcf5-1232-4fb2-bdaa-0a684f5a0451 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:40.015343 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:40.045748 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d451dcf5-1232-4fb2-bdaa-0a684f5a0451 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:40.079029 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a93efb-970d-4ddc-9581-4d249173bad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:40.079811 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a93efb-970d-4ddc-9581-4d249173bad9 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:40.080099 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a93efb-970d-4ddc-9581-4d249173bad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:40.080378 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a93efb-970d-4ddc-9581-4d249173bad9 None admin] PATH_INFO: `/v3/roles/d9ac3d950cc243aaa45c802dd5f3d844` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:40.081879 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a93efb-970d-4ddc-9581-4d249173bad9 None admin] RBAC: Authorizing `identity:get_role(role_id=d9ac3d950cc243aaa45c802dd5f3d844)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:40.083289 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a93efb-970d-4ddc-9581-4d249173bad9 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:40.084653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 560/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:20:39 2022] GET /identity/v3/roles/d9ac3d950cc243aaa45c802dd5f3d844 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:40.090521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed493d-4b29-40c4-be78-f729bb42d24e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:40.111875 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:40.189847 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed493d-4b29-40c4-be78-f729bb42d24e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:40.222418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e6144-c212-4eee-8ecd-b3487fdcfff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:40.223300 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e6144-c212-4eee-8ecd-b3487fdcfff9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:40.223679 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e6144-c212-4eee-8ecd-b3487fdcfff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:40.223956 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e6144-c212-4eee-8ecd-b3487fdcfff9 None admin] PATH_INFO: `/v3/users/de464930a939429282b038dfdeb42e2d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:40.236809 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e6144-c212-4eee-8ecd-b3487fdcfff9 None admin] RBAC: Authorizing `identity:get_user(user_id=de464930a939429282b038dfdeb42e2d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:40.238997 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e6144-c212-4eee-8ecd-b3487fdcfff9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:40.240611 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 554/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:20:40 2022] GET /identity/v3/users/de464930a939429282b038dfdeb42e2d => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:40.246334 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a93efb-970d-4ddc-9581-4d249173bad9 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:40.343450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a93efb-970d-4ddc-9581-4d249173bad9 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:40.376587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d14d8c-e06f-488b-9354-d67846b85e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:40.377225 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d14d8c-e06f-488b-9354-d67846b85e10 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:40.377513 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d14d8c-e06f-488b-9354-d67846b85e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:40.377792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d14d8c-e06f-488b-9354-d67846b85e10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:40.389897 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:40.443880 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d14d8c-e06f-488b-9354-d67846b85e10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:40.445324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d14d8c-e06f-488b-9354-d67846b85e10 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:40.540078 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 561/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:20:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:20:40.545936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e6144-c212-4eee-8ecd-b3487fdcfff9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:40.620816 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:40.641811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e6144-c212-4eee-8ecd-b3487fdcfff9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:40.673928 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf8434-bd43-42a8-9c3f-46ff4fa291d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:40.674809 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf8434-bd43-42a8-9c3f-46ff4fa291d1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:40.675097 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf8434-bd43-42a8-9c3f-46ff4fa291d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:40.675893 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf8434-bd43-42a8-9c3f-46ff4fa291d1 None admin] PATH_INFO: `/v3/projects/ca76ebf8fe31456bbc15d0fe395e4676` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:40.677151 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf8434-bd43-42a8-9c3f-46ff4fa291d1 None admin] RBAC: Authorizing `identity:get_project(project_id=ca76ebf8fe31456bbc15d0fe395e4676)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:40.678654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf8434-bd43-42a8-9c3f-46ff4fa291d1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:40.680317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 555/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:20:40 2022] GET /identity/v3/projects/ca76ebf8fe31456bbc15d0fe395e4676 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:40.686287 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d14d8c-e06f-488b-9354-d67846b85e10 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:40.727755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:40.783055 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d14d8c-e06f-488b-9354-d67846b85e10 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:40.816526 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedc318-fa96-4491-a293-df44b2a50685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:40.817164 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedc318-fa96-4491-a293-df44b2a50685 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:40.817453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedc318-fa96-4491-a293-df44b2a50685 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:40.817732 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedc318-fa96-4491-a293-df44b2a50685 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:40.818568 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedc318-fa96-4491-a293-df44b2a50685 None admin] RBAC: Adding query filter params (role.id=d9ac3d950cc243aaa45c802dd5f3d844, scope.project.id=ca76ebf8fe31456bbc15d0fe395e4676, user.id=de464930a939429282b038dfdeb42e2d) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:40.818878 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedc318-fa96-4491-a293-df44b2a50685 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:40.820304 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedc318-fa96-4491-a293-df44b2a50685 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:40.825613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 562/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:20:40 2022] GET /identity/v3/role_assignments?user.id=de464930a939429282b038dfdeb42e2d&scope.project.id=ca76ebf8fe31456bbc15d0fe395e4676&role.id=d9ac3d950cc243aaa45c802dd5f3d844 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:42.985983 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85cee2-d4f2-4cb6-acd5-5dde4c87ad75 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:42.986555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85cee2-d4f2-4cb6-acd5-5dde4c87ad75 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:42.986555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85cee2-d4f2-4cb6-acd5-5dde4c87ad75 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:42.988464 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 556/1118] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:42.993698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff405be5-e806-415c-9bc5-9f35a40351c4 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:42.994079 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff405be5-e806-415c-9bc5-9f35a40351c4 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:42.994258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff405be5-e806-415c-9bc5-9f35a40351c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:43.011177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-ff405be5-e806-415c-9bc5-9f35a40351c4 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:43.012355 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ff405be5-e806-415c-9bc5-9f35a40351c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:43.075178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 563/1119] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:43.096606 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85cee2-d4f2-4cb6-acd5-5dde4c87ad75 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:43.198024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85cee2-d4f2-4cb6-acd5-5dde4c87ad75 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:43.231642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2351186-51b4-4418-bbcd-0a8ed45c9ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:43.232479 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2351186-51b4-4418-bbcd-0a8ed45c9ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:43.232762 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2351186-51b4-4418-bbcd-0a8ed45c9ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:43.233042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2351186-51b4-4418-bbcd-0a8ed45c9ba3 None admin] PATH_INFO: `/v3/roles/d9ac3d950cc243aaa45c802dd5f3d844` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:43.234527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2351186-51b4-4418-bbcd-0a8ed45c9ba3 None admin] RBAC: Authorizing `identity:get_role(role_id=d9ac3d950cc243aaa45c802dd5f3d844)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:43.235907 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2351186-51b4-4418-bbcd-0a8ed45c9ba3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:43.237297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 557/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:20:43 2022] GET /identity/v3/roles/d9ac3d950cc243aaa45c802dd5f3d844 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:43.243094 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff405be5-e806-415c-9bc5-9f35a40351c4 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:43.277625 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:43.340523 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff405be5-e806-415c-9bc5-9f35a40351c4 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:43.372978 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d03df-3943-460e-a31b-8f280a6aedca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:43.373829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d03df-3943-460e-a31b-8f280a6aedca None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:43.374118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d03df-3943-460e-a31b-8f280a6aedca None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:43.374399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d03df-3943-460e-a31b-8f280a6aedca None admin] PATH_INFO: `/v3/users/de464930a939429282b038dfdeb42e2d` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:43.375610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d03df-3943-460e-a31b-8f280a6aedca None admin] RBAC: Authorizing `identity:get_user(user_id=de464930a939429282b038dfdeb42e2d)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:43.377048 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d03df-3943-460e-a31b-8f280a6aedca None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:43.379207 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 564/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:20:43 2022] GET /identity/v3/users/de464930a939429282b038dfdeb42e2d => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:43.385220 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2351186-51b4-4418-bbcd-0a8ed45c9ba3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:43.401146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:43.482047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2351186-51b4-4418-bbcd-0a8ed45c9ba3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:43.515128 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5221cb8-454e-43bb-b309-c7a596b7c0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:43.515906 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5221cb8-454e-43bb-b309-c7a596b7c0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:43.516189 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5221cb8-454e-43bb-b309-c7a596b7c0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:43.516462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5221cb8-454e-43bb-b309-c7a596b7c0c3 None admin] PATH_INFO: `/v3/projects/ca76ebf8fe31456bbc15d0fe395e4676` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:43.517625 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5221cb8-454e-43bb-b309-c7a596b7c0c3 None admin] RBAC: Authorizing `identity:get_project(project_id=ca76ebf8fe31456bbc15d0fe395e4676)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:43.519112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5221cb8-454e-43bb-b309-c7a596b7c0c3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:43.520768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 558/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:20:43 2022] GET /identity/v3/projects/ca76ebf8fe31456bbc15d0fe395e4676 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:43.526549 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d03df-3943-460e-a31b-8f280a6aedca None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:43.623467 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d03df-3943-460e-a31b-8f280a6aedca None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:43.625794 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:43.657085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8079a-51a6-4678-aac7-90e1d11ecb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:43.657959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8079a-51a6-4678-aac7-90e1d11ecb8a None admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:43.658248 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8079a-51a6-4678-aac7-90e1d11ecb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:43.658551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8079a-51a6-4678-aac7-90e1d11ecb8a None admin] PATH_INFO: `/v3/projects/ca76ebf8fe31456bbc15d0fe395e4676/users/de464930a939429282b038dfdeb42e2d/roles/d9ac3d950cc243aaa45c802dd5f3d844` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:43.660732 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8079a-51a6-4678-aac7-90e1d11ecb8a None admin] RBAC: Authorizing `identity:create_grant(project_id=ca76ebf8fe31456bbc15d0fe395e4676, user_id=de464930a939429282b038dfdeb42e2d, role_id=d9ac3d950cc243aaa45c802dd5f3d844)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:43.662168 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8079a-51a6-4678-aac7-90e1d11ecb8a None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:43.674332 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 565/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:20:43 2022] PUT /identity/v3/projects/ca76ebf8fe31456bbc15d0fe395e4676/users/de464930a939429282b038dfdeb42e2d/roles/d9ac3d950cc243aaa45c802dd5f3d844 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:20:45.829982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df3b64-3383-4a89-9ab7-0b95c41079a3 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:45.830542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df3b64-3383-4a89-9ab7-0b95c41079a3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:45.830542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df3b64-3383-4a89-9ab7-0b95c41079a3 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:45.831942 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 559/1124] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:45.837121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee38c41-82bd-4a46-a3c1-60c50573e67c None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:45.837531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee38c41-82bd-4a46-a3c1-60c50573e67c None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:45.837682 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee38c41-82bd-4a46-a3c1-60c50573e67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:45.853969 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-2ee38c41-82bd-4a46-a3c1-60c50573e67c None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:45.855439 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-2ee38c41-82bd-4a46-a3c1-60c50573e67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:45.920079 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 566/1125] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:45.943368 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df3b64-3383-4a89-9ab7-0b95c41079a3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:46.026107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:46.045692 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df3b64-3383-4a89-9ab7-0b95c41079a3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:46.078559 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a27835-7a4c-45ee-8c06-51b9dd48ca38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:46.079404 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a27835-7a4c-45ee-8c06-51b9dd48ca38 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:46.079689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a27835-7a4c-45ee-8c06-51b9dd48ca38 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:46.079966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a27835-7a4c-45ee-8c06-51b9dd48ca38 None admin] PATH_INFO: `/v3/roles/d9ac3d950cc243aaa45c802dd5f3d844` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:46.081491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a27835-7a4c-45ee-8c06-51b9dd48ca38 None admin] RBAC: Authorizing `identity:get_role(role_id=d9ac3d950cc243aaa45c802dd5f3d844)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:46.083477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a27835-7a4c-45ee-8c06-51b9dd48ca38 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:46.084830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 560/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:20:45 2022] GET /identity/v3/roles/d9ac3d950cc243aaa45c802dd5f3d844 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:46.090558 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee38c41-82bd-4a46-a3c1-60c50573e67c None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:46.182339 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:46.189609 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee38c41-82bd-4a46-a3c1-60c50573e67c None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:46.223536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb3bcf-6c80-4337-a59c-e6ae1be0a7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:46.224396 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb3bcf-6c80-4337-a59c-e6ae1be0a7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:46.224684 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb3bcf-6c80-4337-a59c-e6ae1be0a7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:46.224964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb3bcf-6c80-4337-a59c-e6ae1be0a7e4 None admin] PATH_INFO: `/v3/users/de464930a939429282b038dfdeb42e2d` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:46.226139 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb3bcf-6c80-4337-a59c-e6ae1be0a7e4 None admin] RBAC: Authorizing `identity:get_user(user_id=de464930a939429282b038dfdeb42e2d)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:46.227602 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb3bcf-6c80-4337-a59c-e6ae1be0a7e4 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:46.229227 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 567/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:20:46 2022] GET /identity/v3/users/de464930a939429282b038dfdeb42e2d => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:46.235204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a27835-7a4c-45ee-8c06-51b9dd48ca38 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:46.331029 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a27835-7a4c-45ee-8c06-51b9dd48ca38 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:46.364167 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526340b-5c34-4b0a-9cba-d5fb43418fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:46.364803 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526340b-5c34-4b0a-9cba-d5fb43418fed None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:46.365091 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526340b-5c34-4b0a-9cba-d5fb43418fed None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:46.365373 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526340b-5c34-4b0a-9cba-d5fb43418fed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:46.383388 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:46.431310 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526340b-5c34-4b0a-9cba-d5fb43418fed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:46.432765 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526340b-5c34-4b0a-9cba-d5fb43418fed None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:46.527604 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 561/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:20:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:20:46.533351 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb3bcf-6c80-4337-a59c-e6ae1be0a7e4 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:46.630870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb3bcf-6c80-4337-a59c-e6ae1be0a7e4 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:46.663382 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbe063-614e-4c3b-b4f4-77d4c2d783fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:46.664216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbe063-614e-4c3b-b4f4-77d4c2d783fd None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:46.664504 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbe063-614e-4c3b-b4f4-77d4c2d783fd None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:46.664783 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbe063-614e-4c3b-b4f4-77d4c2d783fd None admin] PATH_INFO: `/v3/projects/ca76ebf8fe31456bbc15d0fe395e4676` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:46.665947 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbe063-614e-4c3b-b4f4-77d4c2d783fd None admin] RBAC: Authorizing `identity:get_project(project_id=ca76ebf8fe31456bbc15d0fe395e4676)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:46.667417 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbe063-614e-4c3b-b4f4-77d4c2d783fd None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:46.669068 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 568/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:20:46 2022] GET /identity/v3/projects/ca76ebf8fe31456bbc15d0fe395e4676 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:46.674956 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526340b-5c34-4b0a-9cba-d5fb43418fed None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:46.722807 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:46.771083 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526340b-5c34-4b0a-9cba-d5fb43418fed None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:46.803413 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5322cf8-0028-4141-bb89-2e5bc2b7c8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:46.804052 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5322cf8-0028-4141-bb89-2e5bc2b7c8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:46.804337 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5322cf8-0028-4141-bb89-2e5bc2b7c8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:46.804615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5322cf8-0028-4141-bb89-2e5bc2b7c8a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:46.805432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5322cf8-0028-4141-bb89-2e5bc2b7c8a4 None admin] RBAC: Adding query filter params (role.id=d9ac3d950cc243aaa45c802dd5f3d844, scope.project.id=ca76ebf8fe31456bbc15d0fe395e4676, user.id=de464930a939429282b038dfdeb42e2d) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:46.805743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5322cf8-0028-4141-bb89-2e5bc2b7c8a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:46.807207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5322cf8-0028-4141-bb89-2e5bc2b7c8a4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:46.812824 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 562/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:20:46 2022] GET /identity/v3/role_assignments?user.id=de464930a939429282b038dfdeb42e2d&scope.project.id=ca76ebf8fe31456bbc15d0fe395e4676&role.id=d9ac3d950cc243aaa45c802dd5f3d844 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:49.046717 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb923a3-78e3-48c8-9aff-72099ad110e0 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:49.047252 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb923a3-78e3-48c8-9aff-72099ad110e0 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:49.047370 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb923a3-78e3-48c8-9aff-72099ad110e0 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:49.048634 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 569/1131] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:49.053968 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4536a-9e8f-4ead-b89a-d0436ea2ed9a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:49.054372 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4536a-9e8f-4ead-b89a-d0436ea2ed9a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:49.054546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4536a-9e8f-4ead-b89a-d0436ea2ed9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:49.071711 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-04a4536a-9e8f-4ead-b89a-d0436ea2ed9a None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:49.072911 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-04a4536a-9e8f-4ead-b89a-d0436ea2ed9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:49.138127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 563/1132] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:49.161826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb923a3-78e3-48c8-9aff-72099ad110e0 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:49.191286 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:49.261603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb923a3-78e3-48c8-9aff-72099ad110e0 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:49.296655 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708083f-ae41-4d8f-a20c-71c2ee8edaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:49.297825 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708083f-ae41-4d8f-a20c-71c2ee8edaaf None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:49.298197 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708083f-ae41-4d8f-a20c-71c2ee8edaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:49.298648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708083f-ae41-4d8f-a20c-71c2ee8edaaf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:49.300356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708083f-ae41-4d8f-a20c-71c2ee8edaaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:49.302655 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708083f-ae41-4d8f-a20c-71c2ee8edaaf None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:49.305084 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 570/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:49.311051 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4536a-9e8f-4ead-b89a-d0436ea2ed9a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:49.362691 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:49.415201 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4536a-9e8f-4ead-b89a-d0436ea2ed9a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:49.449066 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d7a37-1b35-4bff-8909-601e2e40aad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:49.449720 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d7a37-1b35-4bff-8909-601e2e40aad7 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:49.450007 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d7a37-1b35-4bff-8909-601e2e40aad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:49.450285 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d7a37-1b35-4bff-8909-601e2e40aad7 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:49.451030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d7a37-1b35-4bff-8909-601e2e40aad7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:49.452479 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d7a37-1b35-4bff-8909-601e2e40aad7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:49.476981 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 564/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Mon May 23 12:20:49 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:20:51.694785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b6ecd-935e-43ee-bce0-fbb500e399c4 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:51.695353 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b6ecd-935e-43ee-bce0-fbb500e399c4 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:51.695353 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b6ecd-935e-43ee-bce0-fbb500e399c4 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:51.696701 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 571/1135] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:51.701995 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90946df-9c30-49aa-9d3f-3d046f0b1cec None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:51.702389 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90946df-9c30-49aa-9d3f-3d046f0b1cec None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:51.702583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90946df-9c30-49aa-9d3f-3d046f0b1cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:51.719523 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b90946df-9c30-49aa-9d3f-3d046f0b1cec None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:51.720706 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b90946df-9c30-49aa-9d3f-3d046f0b1cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:51.784703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 565/1136] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:51.809334 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b6ecd-935e-43ee-bce0-fbb500e399c4 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:51.905385 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:51.910625 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b6ecd-935e-43ee-bce0-fbb500e399c4 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:51.945653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115937d3-2328-4eac-a49d-71f081066af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:51.946369 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115937d3-2328-4eac-a49d-71f081066af7 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:51.946689 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115937d3-2328-4eac-a49d-71f081066af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:51.946974 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115937d3-2328-4eac-a49d-71f081066af7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:51.948135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115937d3-2328-4eac-a49d-71f081066af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:51.949569 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115937d3-2328-4eac-a49d-71f081066af7 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:51.951221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 572/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:20:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:51.956891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90946df-9c30-49aa-9d3f-3d046f0b1cec None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:51.983098 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:52.055711 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90946df-9c30-49aa-9d3f-3d046f0b1cec None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:52.087808 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011c173-bf41-484f-9099-87fd22fc26b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:52.088469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011c173-bf41-484f-9099-87fd22fc26b1 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:52.088756 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011c173-bf41-484f-9099-87fd22fc26b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:52.089036 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011c173-bf41-484f-9099-87fd22fc26b1 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:52.089739 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011c173-bf41-484f-9099-87fd22fc26b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:52.091221 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011c173-bf41-484f-9099-87fd22fc26b1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:52.111011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 566/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Mon May 23 12:20:51 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:20:54.338841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbacd27-2842-4191-878c-8ca5846fda3d None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:54.339367 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbacd27-2842-4191-878c-8ca5846fda3d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:54.339840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbacd27-2842-4191-878c-8ca5846fda3d None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:54.341929 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 573/1139] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:20:54.352164 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf3cb7-4426-4553-8234-a3871c4da776 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:54.352699 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf3cb7-4426-4553-8234-a3871c4da776 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:54.353244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf3cb7-4426-4553-8234-a3871c4da776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:54.371686 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-bddf3cb7-4426-4553-8234-a3871c4da776 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:54.373396 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bddf3cb7-4426-4553-8234-a3871c4da776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:54.440174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 567/1140] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:54.464592 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbacd27-2842-4191-878c-8ca5846fda3d None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:54.562378 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbacd27-2842-4191-878c-8ca5846fda3d None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:54.595587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b44e17-2312-4993-a45c-aa412752185d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:54.596359 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b44e17-2312-4993-a45c-aa412752185d None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:54.596646 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b44e17-2312-4993-a45c-aa412752185d None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:54.596923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b44e17-2312-4993-a45c-aa412752185d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:54.607018 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b44e17-2312-4993-a45c-aa412752185d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:20:54.614513 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-16b44e17-2312-4993-a45c-aa412752185d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:20:54.614513 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:54.614513 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:54.614513 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:54.614513 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:54.614513 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:54.614513 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:54.614513 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:54.614513 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:54.614513 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:54.614513 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:54.614513 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:54.614513 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:20:54.614513 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:20:54.614513 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:20:54.614513 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:20:54.615688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:20:54.615688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:20:54.615688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:20:54.615688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:20:54.615688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:54.615688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:54.615688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:54.615688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:54.615688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:54.615688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:54.615688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:54.615688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:54.615688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:54.615688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:54.615688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:54.615688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:54.616764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:54.616764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:54.616764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:54.616764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:54.616764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:20:54.616764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:20:54.616764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:20:54.616764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:20:54.616764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:20:54.616764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:20:54.616764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:20:54.616764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:54.616764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 574/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:20:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:54.621532 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf3cb7-4426-4553-8234-a3871c4da776 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:54.635760 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:54.724538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf3cb7-4426-4553-8234-a3871c4da776 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:54.757824 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414dbed5-5cd5-4c3a-bcdd-97caa7ffff80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:54.758482 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dbed5-5cd5-4c3a-bcdd-97caa7ffff80 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:54.758797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dbed5-5cd5-4c3a-bcdd-97caa7ffff80 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:54.759075 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dbed5-5cd5-4c3a-bcdd-97caa7ffff80 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:54.759819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414dbed5-5cd5-4c3a-bcdd-97caa7ffff80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:54.760127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414dbed5-5cd5-4c3a-bcdd-97caa7ffff80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:54.761508 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414dbed5-5cd5-4c3a-bcdd-97caa7ffff80 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:54.769246 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 568/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:20:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:54.775410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b44e17-2312-4993-a45c-aa412752185d None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:54.803212 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:54.874874 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b44e17-2312-4993-a45c-aa412752185d None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:54.907420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f452b3-836c-4015-a417-646cd4a74cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:54.908268 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f452b3-836c-4015-a417-646cd4a74cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:54.908557 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f452b3-836c-4015-a417-646cd4a74cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:54.908836 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f452b3-836c-4015-a417-646cd4a74cb3 None admin] PATH_INFO: `/v3/users/3bf656a24e8549149f789e83b97fc0e3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:54.921660 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f452b3-836c-4015-a417-646cd4a74cb3 None admin] RBAC: Authorizing `identity:get_user(user_id=3bf656a24e8549149f789e83b97fc0e3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:54.923139 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f452b3-836c-4015-a417-646cd4a74cb3 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:54.924757 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 575/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:20:54 2022] GET /identity/v3/users/3bf656a24e8549149f789e83b97fc0e3 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:54.930887 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414dbed5-5cd5-4c3a-bcdd-97caa7ffff80 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:55.003744 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:55.028290 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414dbed5-5cd5-4c3a-bcdd-97caa7ffff80 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:55.060829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d8340-bbe5-44a9-8989-fbfcdb5c0b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:55.061461 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d8340-bbe5-44a9-8989-fbfcdb5c0b7e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:55.061748 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d8340-bbe5-44a9-8989-fbfcdb5c0b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:55.062025 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d8340-bbe5-44a9-8989-fbfcdb5c0b7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:55.126380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d8340-bbe5-44a9-8989-fbfcdb5c0b7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:55.127873 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d8340-bbe5-44a9-8989-fbfcdb5c0b7e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:55.198004 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:55.222989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 569/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:20:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:20:55.228801 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f452b3-836c-4015-a417-646cd4a74cb3 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:55.310482 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:55.326021 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f452b3-836c-4015-a417-646cd4a74cb3 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:55.359039 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8b12e-1fc8-460b-9061-aa00b9b740a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:55.359886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8b12e-1fc8-460b-9061-aa00b9b740a8 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:55.360173 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8b12e-1fc8-460b-9061-aa00b9b740a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:55.360455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8b12e-1fc8-460b-9061-aa00b9b740a8 None admin] PATH_INFO: `/v3/projects/1b37092fc13944c091c451ed6dc65c5a` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:55.361625 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8b12e-1fc8-460b-9061-aa00b9b740a8 None admin] RBAC: Authorizing `identity:get_project(project_id=1b37092fc13944c091c451ed6dc65c5a)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:55.363119 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8b12e-1fc8-460b-9061-aa00b9b740a8 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:55.364844 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 576/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:20:55 2022] GET /identity/v3/projects/1b37092fc13944c091c451ed6dc65c5a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:55.370843 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d8340-bbe5-44a9-8989-fbfcdb5c0b7e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:55.467494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d8340-bbe5-44a9-8989-fbfcdb5c0b7e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:55.500598 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6727e-46b9-42a8-b56a-2631b47b772b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:55.501234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6727e-46b9-42a8-b56a-2631b47b772b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:55.501521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6727e-46b9-42a8-b56a-2631b47b772b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:55.501799 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6727e-46b9-42a8-b56a-2631b47b772b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:55.502648 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6727e-46b9-42a8-b56a-2631b47b772b None admin] RBAC: Adding query filter params (role.id=3ae7c5e54e084ac4a1f94da93a667583, scope.project.id=1b37092fc13944c091c451ed6dc65c5a, user.id=3bf656a24e8549149f789e83b97fc0e3) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:55.502963 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6727e-46b9-42a8-b56a-2631b47b772b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:55.504565 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6727e-46b9-42a8-b56a-2631b47b772b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:55.509946 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 570/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:20:55 2022] GET /identity/v3/role_assignments?user.id=3bf656a24e8549149f789e83b97fc0e3&scope.project.id=1b37092fc13944c091c451ed6dc65c5a&role.id=3ae7c5e54e084ac4a1f94da93a667583 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:57.627150 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c43653-3d28-494b-9540-61437a3cdd3e None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:57.627685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c43653-3d28-494b-9540-61437a3cdd3e None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:57.627795 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c43653-3d28-494b-9540-61437a3cdd3e None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:57.629064 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 577/1147] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:20:57.634160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069c24f-1494-4ca8-bdfe-2cf6bb8da81a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:57.634566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069c24f-1494-4ca8-bdfe-2cf6bb8da81a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:57.634757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069c24f-1494-4ca8-bdfe-2cf6bb8da81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:57.651855 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f069c24f-1494-4ca8-bdfe-2cf6bb8da81a None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:20:57.653043 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f069c24f-1494-4ca8-bdfe-2cf6bb8da81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:20:57.682042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:57.718882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 571/1148] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:20:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:20:57.741270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c43653-3d28-494b-9540-61437a3cdd3e None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:57.839674 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c43653-3d28-494b-9540-61437a3cdd3e None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:57.874004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd043d-73c9-4202-be5e-7229d632bdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:57.874801 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd043d-73c9-4202-be5e-7229d632bdb5 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:57.875090 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd043d-73c9-4202-be5e-7229d632bdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:57.875369 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd043d-73c9-4202-be5e-7229d632bdb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:57.886188 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd043d-73c9-4202-be5e-7229d632bdb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:20:57.893827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-19dd043d-73c9-4202-be5e-7229d632bdb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:20:57.893827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:20:57.893827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:20:57.893827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:20:57.893827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:20:57.893827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:20:57.893827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:20:57.893827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:20:57.893827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:20:57.893827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:20:57.893827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:20:57.893827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:20:57.893827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:20:57.893827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:20:57.893827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:20:57.893827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:20:57.895410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:20:57.895410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:20:57.895410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:20:57.895410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:20:57.895410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:20:57.895410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:20:57.895410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:20:57.895410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:20:57.895410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:20:57.895410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:20:57.895410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:20:57.895410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:20:57.895410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:20:57.895410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:20:57.895410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:20:57.895410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:20:57.896443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:20:57.896443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:20:57.896443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:20:57.896443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:20:57.896443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:20:57.896443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:20:57.896443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:20:57.896443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:20:57.896443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:20:57.896443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:20:57.896443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:20:57.896443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:20:57.896443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 578/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:20:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:20:57.901284 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069c24f-1494-4ca8-bdfe-2cf6bb8da81a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:58.007747 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069c24f-1494-4ca8-bdfe-2cf6bb8da81a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:58.042897 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3a72b-cd05-4fd0-aec4-29aed8469972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:58.043570 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3a72b-cd05-4fd0-aec4-29aed8469972 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:58.043859 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3a72b-cd05-4fd0-aec4-29aed8469972 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:58.044136 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3a72b-cd05-4fd0-aec4-29aed8469972 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:58.044889 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3a72b-cd05-4fd0-aec4-29aed8469972 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:20:58.045197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3a72b-cd05-4fd0-aec4-29aed8469972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:58.046608 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3a72b-cd05-4fd0-aec4-29aed8469972 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:58.054791 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 572/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:20:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:58.060706 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd043d-73c9-4202-be5e-7229d632bdb5 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:58.077106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:58.163848 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd043d-73c9-4202-be5e-7229d632bdb5 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:58.198146 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f9d4d-8286-4df6-b752-a4da0bc0688a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:58.199144 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f9d4d-8286-4df6-b752-a4da0bc0688a None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:58.199437 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f9d4d-8286-4df6-b752-a4da0bc0688a None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:58.199717 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f9d4d-8286-4df6-b752-a4da0bc0688a None admin] PATH_INFO: `/v3/users/3bf656a24e8549149f789e83b97fc0e3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:58.200891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f9d4d-8286-4df6-b752-a4da0bc0688a None admin] RBAC: Authorizing `identity:get_user(user_id=3bf656a24e8549149f789e83b97fc0e3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:58.202335 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f9d4d-8286-4df6-b752-a4da0bc0688a None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:58.203987 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 579/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:20:58 2022] GET /identity/v3/users/3bf656a24e8549149f789e83b97fc0e3 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:58.210377 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3a72b-cd05-4fd0-aec4-29aed8469972 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:58.240508 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:58.307746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3a72b-cd05-4fd0-aec4-29aed8469972 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:58.340535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c79b8-0592-454c-afa6-6fee754ea66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:58.341381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c79b8-0592-454c-afa6-6fee754ea66e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:58.341669 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c79b8-0592-454c-afa6-6fee754ea66e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:58.341978 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c79b8-0592-454c-afa6-6fee754ea66e None admin] PATH_INFO: `/v3/projects/1b37092fc13944c091c451ed6dc65c5a` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:58.343157 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c79b8-0592-454c-afa6-6fee754ea66e None admin] RBAC: Authorizing `identity:get_project(project_id=1b37092fc13944c091c451ed6dc65c5a)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:58.344599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c79b8-0592-454c-afa6-6fee754ea66e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:58.346268 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 573/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:20:58 2022] GET /identity/v3/projects/1b37092fc13944c091c451ed6dc65c5a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:20:58.352307 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f9d4d-8286-4df6-b752-a4da0bc0688a None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:20:58.431781 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:20:58.451141 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f9d4d-8286-4df6-b752-a4da0bc0688a None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:20:58.483584 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af38e4-f3c7-4081-91a6-44b3eafe6e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:20:58.484462 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af38e4-f3c7-4081-91a6-44b3eafe6e27 None admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:20:58.484749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af38e4-f3c7-4081-91a6-44b3eafe6e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:20:58.485034 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af38e4-f3c7-4081-91a6-44b3eafe6e27 None admin] PATH_INFO: `/v3/projects/1b37092fc13944c091c451ed6dc65c5a/users/3bf656a24e8549149f789e83b97fc0e3/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:20:58.486978 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af38e4-f3c7-4081-91a6-44b3eafe6e27 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b37092fc13944c091c451ed6dc65c5a, user_id=3bf656a24e8549149f789e83b97fc0e3, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:20:58.489092 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af38e4-f3c7-4081-91a6-44b3eafe6e27 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:20:58.501631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 580/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:20:58 2022] PUT /identity/v3/projects/1b37092fc13944c091c451ed6dc65c5a/users/3bf656a24e8549149f789e83b97fc0e3/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:21:00.659257 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726efff0-6bf3-4cb8-b86e-f796b56cfe9c None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:00.659828 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726efff0-6bf3-4cb8-b86e-f796b56cfe9c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:00.659828 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726efff0-6bf3-4cb8-b86e-f796b56cfe9c None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:00.661212 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 574/1154] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:21:00.666511 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac0f24-9b4b-468f-a6f2-48531cf47014 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:00.666908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac0f24-9b4b-468f-a6f2-48531cf47014 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:00.667097 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac0f24-9b4b-468f-a6f2-48531cf47014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:00.684578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-5eac0f24-9b4b-468f-a6f2-48531cf47014 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:21:00.685770 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-5eac0f24-9b4b-468f-a6f2-48531cf47014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:21:00.751380 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 581/1155] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:21:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:21:00.775205 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726efff0-6bf3-4cb8-b86e-f796b56cfe9c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:00.872087 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:00.877186 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726efff0-6bf3-4cb8-b86e-f796b56cfe9c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:00.912436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b663274-58a8-408d-b8e1-214b59431cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:00.913151 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b663274-58a8-408d-b8e1-214b59431cab None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:00.913441 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b663274-58a8-408d-b8e1-214b59431cab None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:00.913722 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b663274-58a8-408d-b8e1-214b59431cab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:00.924156 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b663274-58a8-408d-b8e1-214b59431cab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:21:00.932664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-8b663274-58a8-408d-b8e1-214b59431cab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:21:00.932664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:21:00.932664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:21:00.932664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:21:00.932664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:21:00.932664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:21:00.932664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:21:00.932664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:21:00.932664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:21:00.932664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:21:00.932664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:21:00.932664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:21:00.932664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:21:00.932664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:21:00.932664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:21:00.932664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:21:00.933882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:21:00.933882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:21:00.933882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:21:00.933882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:21:00.933882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:21:00.933882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:21:00.933882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:21:00.933882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:21:00.933882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:21:00.933882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:21:00.933882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:21:00.933882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:21:00.933882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:21:00.933882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:21:00.933882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:21:00.933882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:21:00.934802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:21:00.934802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:21:00.934802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:21:00.934802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:21:00.934802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:21:00.934802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:21:00.934802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:21:00.934802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:21:00.934802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:21:00.934802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:21:00.934802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:21:00.934802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:21:00.934802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 575/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:21:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:21:00.939683 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac0f24-9b4b-468f-a6f2-48531cf47014 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:01.007016 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:01.038010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac0f24-9b4b-468f-a6f2-48531cf47014 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:01.070346 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad88f7e-1f8e-4c9a-bea8-57ff3ed78c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:01.071024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad88f7e-1f8e-4c9a-bea8-57ff3ed78c23 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:01.071307 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad88f7e-1f8e-4c9a-bea8-57ff3ed78c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:01.071578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad88f7e-1f8e-4c9a-bea8-57ff3ed78c23 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:01.072308 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad88f7e-1f8e-4c9a-bea8-57ff3ed78c23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:21:01.072614 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad88f7e-1f8e-4c9a-bea8-57ff3ed78c23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:01.073968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad88f7e-1f8e-4c9a-bea8-57ff3ed78c23 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:01.081775 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 582/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:21:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:21:01.087298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b663274-58a8-408d-b8e1-214b59431cab None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:01.184426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b663274-58a8-408d-b8e1-214b59431cab None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:01.216347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0744e3-88da-455d-968a-489d871baf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:01.217201 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0744e3-88da-455d-968a-489d871baf78 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:01.217485 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0744e3-88da-455d-968a-489d871baf78 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:01.217761 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0744e3-88da-455d-968a-489d871baf78 None admin] PATH_INFO: `/v3/users/3bf656a24e8549149f789e83b97fc0e3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:01.218959 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0744e3-88da-455d-968a-489d871baf78 None admin] RBAC: Authorizing `identity:get_user(user_id=3bf656a24e8549149f789e83b97fc0e3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:01.220434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0744e3-88da-455d-968a-489d871baf78 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:01.222035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 576/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:21:01 2022] GET /identity/v3/users/3bf656a24e8549149f789e83b97fc0e3 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:21:01.228282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad88f7e-1f8e-4c9a-bea8-57ff3ed78c23 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:01.324829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad88f7e-1f8e-4c9a-bea8-57ff3ed78c23 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:01.352690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:01.358017 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d7baf-a100-4266-b016-f2fd16715e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:01.358686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d7baf-a100-4266-b016-f2fd16715e97 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:01.358975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d7baf-a100-4266-b016-f2fd16715e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:01.359256 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d7baf-a100-4266-b016-f2fd16715e97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:01.424127 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d7baf-a100-4266-b016-f2fd16715e97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:01.425565 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d7baf-a100-4266-b016-f2fd16715e97 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:01.520629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 583/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:21:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:21:01.526319 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0744e3-88da-455d-968a-489d871baf78 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:01.554739 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:01.626125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0744e3-88da-455d-968a-489d871baf78 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:01.658140 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10c452-458d-465f-aa19-2c825841b4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:01.659009 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10c452-458d-465f-aa19-2c825841b4bb None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:01.659295 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10c452-458d-465f-aa19-2c825841b4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:01.659829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10c452-458d-465f-aa19-2c825841b4bb None admin] PATH_INFO: `/v3/projects/1b37092fc13944c091c451ed6dc65c5a` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:01.661267 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10c452-458d-465f-aa19-2c825841b4bb None admin] RBAC: Authorizing `identity:get_project(project_id=1b37092fc13944c091c451ed6dc65c5a)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:01.662735 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10c452-458d-465f-aa19-2c825841b4bb None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:01.664388 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 577/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:21:01 2022] GET /identity/v3/projects/1b37092fc13944c091c451ed6dc65c5a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:21:01.670248 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d7baf-a100-4266-b016-f2fd16715e97 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:01.699593 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:01.766892 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d7baf-a100-4266-b016-f2fd16715e97 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:01.799441 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d42afc-0754-4823-9007-b3820a4809a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:01.800019 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d42afc-0754-4823-9007-b3820a4809a6 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:01.800306 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d42afc-0754-4823-9007-b3820a4809a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:01.800584 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d42afc-0754-4823-9007-b3820a4809a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:01.801426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d42afc-0754-4823-9007-b3820a4809a6 None admin] RBAC: Adding query filter params (role.id=3ae7c5e54e084ac4a1f94da93a667583, scope.project.id=1b37092fc13944c091c451ed6dc65c5a, user.id=3bf656a24e8549149f789e83b97fc0e3) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:21:01.801739 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d42afc-0754-4823-9007-b3820a4809a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:01.803210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d42afc-0754-4823-9007-b3820a4809a6 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:01.808811 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 584/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:21:01 2022] GET /identity/v3/role_assignments?user.id=3bf656a24e8549149f789e83b97fc0e3&scope.project.id=1b37092fc13944c091c451ed6dc65c5a&role.id=3ae7c5e54e084ac4a1f94da93a667583 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:21:04.011894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa73aa-c58a-4c6b-9cff-1df6d9a5f7d4 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:04.012428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa73aa-c58a-4c6b-9cff-1df6d9a5f7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:04.012428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa73aa-c58a-4c6b-9cff-1df6d9a5f7d4 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:04.013797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 578/1162] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:21:04.019045 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2fe9c-c425-4284-9f22-24ac1c984683 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:04.019420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2fe9c-c425-4284-9f22-24ac1c984683 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:04.020198 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2fe9c-c425-4284-9f22-24ac1c984683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:04.036779 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-2fc2fe9c-c425-4284-9f22-24ac1c984683 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:21:04.038043 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-2fc2fe9c-c425-4284-9f22-24ac1c984683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:21:04.105167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 585/1163] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:21:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:21:04.127420 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa73aa-c58a-4c6b-9cff-1df6d9a5f7d4 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:04.225845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:04.233859 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa73aa-c58a-4c6b-9cff-1df6d9a5f7d4 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:04.267726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efe013-7eb2-4037-87f9-124a94203a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:04.268305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efe013-7eb2-4037-87f9-124a94203a4d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:04.268592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efe013-7eb2-4037-87f9-124a94203a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:04.268867 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efe013-7eb2-4037-87f9-124a94203a4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:04.334070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efe013-7eb2-4037-87f9-124a94203a4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:04.335570 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efe013-7eb2-4037-87f9-124a94203a4d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:04.428238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:04.436003 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 579/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:21:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:21:04.442097 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2fe9c-c425-4284-9f22-24ac1c984683 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:04.470662 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:04.542206 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2fe9c-c425-4284-9f22-24ac1c984683 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:04.574973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ec22f-9f70-4735-812e-1d56f838d3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:04.575755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ec22f-9f70-4735-812e-1d56f838d3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:04.576037 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ec22f-9f70-4735-812e-1d56f838d3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:04.576310 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ec22f-9f70-4735-812e-1d56f838d3a0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:04.583252 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ec22f-9f70-4735-812e-1d56f838d3a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:04.584681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ec22f-9f70-4735-812e-1d56f838d3a0 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:04.598695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-119ec22f-9f70-4735-812e-1d56f838d3a0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 23 12:21:04.598695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:21:04.598695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 23 12:21:04.598695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 23 12:21:04.598695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:21:04.598695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:21:04.598695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:21:04.598695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:21:04.598695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 23 12:21:04.598695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:21:04.598695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:21:04.598695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:21:04.598695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:21:04.598695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:21:04.598695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:21:04.598695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:21:04.598695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:21:04.599915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:21:04.599915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:21:04.599915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:21:04.599915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:21:04.599915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:21:04.599915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:21:04.599915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:21:04.599915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:21:04.599915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:21:04.599915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:21:04.599915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:21:04.599915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:21:04.599915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:21:04.599915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:21:04.599915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:21:04.599915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:21:04.600946 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:21:04.600946 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:21:04.600946 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:21:04.600946 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:21:04.600946 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:21:04.600946 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:21:04.600946 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:21:04.600946 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:21:04.600946 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:21:04.600946 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:21:04.600946 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 23 12:21:04.600946 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:21:04.600946 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 23 12:21:04.600946 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:21:04.600946 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 586/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Mon May 23 12:21:04 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:21:04.606003 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efe013-7eb2-4037-87f9-124a94203a4d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:04.703340 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efe013-7eb2-4037-87f9-124a94203a4d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:04.749521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12b9ce-4886-410a-93fc-d58bcd0c5118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:04.750674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12b9ce-4886-410a-93fc-d58bcd0c5118 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:04.751180 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12b9ce-4886-410a-93fc-d58bcd0c5118 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:04.751673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12b9ce-4886-410a-93fc-d58bcd0c5118 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:04.752543 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12b9ce-4886-410a-93fc-d58bcd0c5118 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:21:04.752859 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12b9ce-4886-410a-93fc-d58bcd0c5118 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:04.754838 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12b9ce-4886-410a-93fc-d58bcd0c5118 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:04.763834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 580/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Mon May 23 12:21:04 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:21:06.899816 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97423d5-e03d-4e79-83f8-2badd22c2002 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:06.900376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97423d5-e03d-4e79-83f8-2badd22c2002 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:06.900376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97423d5-e03d-4e79-83f8-2badd22c2002 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:06.901734 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 587/1167] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:21:06.907040 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0ee35-567e-4bd3-b6e0-82d85c49c916 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:06.907437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0ee35-567e-4bd3-b6e0-82d85c49c916 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:06.907607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0ee35-567e-4bd3-b6e0-82d85c49c916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:06.924946 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0ef0ee35-567e-4bd3-b6e0-82d85c49c916 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:21:06.926216 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0ef0ee35-567e-4bd3-b6e0-82d85c49c916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:21:06.977567 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:06.991523 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 581/1168] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:21:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:21:07.014211 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97423d5-e03d-4e79-83f8-2badd22c2002 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:07.102186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:07.118728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97423d5-e03d-4e79-83f8-2badd22c2002 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:07.150728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ba34e-5837-4ad7-9781-acd39a3318aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:07.151325 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ba34e-5837-4ad7-9781-acd39a3318aa None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:07.151611 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ba34e-5837-4ad7-9781-acd39a3318aa None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:07.151890 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ba34e-5837-4ad7-9781-acd39a3318aa None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:07.152632 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ba34e-5837-4ad7-9781-acd39a3318aa None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:07.154005 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ba34e-5837-4ad7-9781-acd39a3318aa None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:07.168322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 588/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Mon May 23 12:21:07 2022] POST /identity/v3/domains => generated 267 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:21:09.361950 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f61ae3-46fb-4ec9-9815-c498cfb87b60 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:09.362519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f61ae3-46fb-4ec9-9815-c498cfb87b60 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:09.362519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f61ae3-46fb-4ec9-9815-c498cfb87b60 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:09.364045 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 582/1170] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:21:09.369776 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd07b8-0ec4-4b94-8053-0a40837a75cd None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:09.370197 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd07b8-0ec4-4b94-8053-0a40837a75cd None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:09.370341 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd07b8-0ec4-4b94-8053-0a40837a75cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:09.387006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-25dd07b8-0ec4-4b94-8053-0a40837a75cd None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:21:09.388195 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-25dd07b8-0ec4-4b94-8053-0a40837a75cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:21:09.476535 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 589/1171] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:21:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:21:09.500322 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f61ae3-46fb-4ec9-9815-c498cfb87b60 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:09.601474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f61ae3-46fb-4ec9-9815-c498cfb87b60 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:09.634301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f693e-6858-4f53-ae1a-fc07f2e6e204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:09.635189 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f693e-6858-4f53-ae1a-fc07f2e6e204 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:09.635476 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f693e-6858-4f53-ae1a-fc07f2e6e204 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:09.635751 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f693e-6858-4f53-ae1a-fc07f2e6e204 None admin] PATH_INFO: `/v3/domains/ca7e7feefe374dbd89333a85dd5c3add` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:09.646562 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f693e-6858-4f53-ae1a-fc07f2e6e204 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ca7e7feefe374dbd89333a85dd5c3add)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:09.648025 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f693e-6858-4f53-ae1a-fc07f2e6e204 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:09.649650 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 583/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Mon May 23 12:21:09 2022] GET /identity/v3/domains/ca7e7feefe374dbd89333a85dd5c3add => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:21:09.655403 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd07b8-0ec4-4b94-8053-0a40837a75cd None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:09.740691 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:09.766103 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd07b8-0ec4-4b94-8053-0a40837a75cd None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:09.807147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4c6d8-db90-4b46-aa2b-afef3e6cc38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:09.807800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4c6d8-db90-4b46-aa2b-afef3e6cc38f None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:09.808084 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4c6d8-db90-4b46-aa2b-afef3e6cc38f None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:09.808361 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4c6d8-db90-4b46-aa2b-afef3e6cc38f None admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:09.809067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4c6d8-db90-4b46-aa2b-afef3e6cc38f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:09.810527 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4c6d8-db90-4b46-aa2b-afef3e6cc38f None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:09.834767 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 590/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Mon May 23 12:21:09 2022] POST /identity/v3/projects => generated 361 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:21:12.018076 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9756c40-b4b9-47e0-a2be-1da924619646 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:12.018644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9756c40-b4b9-47e0-a2be-1da924619646 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:12.018754 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9756c40-b4b9-47e0-a2be-1da924619646 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:12.020044 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 584/1174] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:21:12.025234 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9ba04-ac34-4647-8890-9c5d405fdee7 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:12.025660 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9ba04-ac34-4647-8890-9c5d405fdee7 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:12.025804 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9ba04-ac34-4647-8890-9c5d405fdee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:12.042334 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-0fc9ba04-ac34-4647-8890-9c5d405fdee7 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:21:12.043545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-0fc9ba04-ac34-4647-8890-9c5d405fdee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:21:12.107607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 591/1175] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:21:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:21:12.133313 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9756c40-b4b9-47e0-a2be-1da924619646 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:12.182072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:12.234382 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9756c40-b4b9-47e0-a2be-1da924619646 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:12.267408 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48792cd-0c9a-408a-8b9a-f804d0486c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:12.268313 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48792cd-0c9a-408a-8b9a-f804d0486c35 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:12.268547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48792cd-0c9a-408a-8b9a-f804d0486c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:12.268827 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48792cd-0c9a-408a-8b9a-f804d0486c35 None admin] PATH_INFO: `/v3/domains/ca7e7feefe374dbd89333a85dd5c3add` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:12.270674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48792cd-0c9a-408a-8b9a-f804d0486c35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ca7e7feefe374dbd89333a85dd5c3add)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:12.272126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48792cd-0c9a-408a-8b9a-f804d0486c35 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:12.273728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 585/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Mon May 23 12:21:12 2022] GET /identity/v3/domains/ca7e7feefe374dbd89333a85dd5c3add => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:21:12.279576 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9ba04-ac34-4647-8890-9c5d405fdee7 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:12.335598 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:12.376047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9ba04-ac34-4647-8890-9c5d405fdee7 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:12.409530 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9194bc2-13be-484f-a7b6-26d359f1266c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:12.410208 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9194bc2-13be-484f-a7b6-26d359f1266c None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:12.410494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9194bc2-13be-484f-a7b6-26d359f1266c None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:12.410801 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9194bc2-13be-484f-a7b6-26d359f1266c None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:12.411487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9194bc2-13be-484f-a7b6-26d359f1266c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:12.412921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9194bc2-13be-484f-a7b6-26d359f1266c None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:12.432417 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 592/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Mon May 23 12:21:12 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:21:14.630966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e40cc-4fb0-41f4-8adc-4a3772ff79e2 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:14.631486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e40cc-4fb0-41f4-8adc-4a3772ff79e2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:14.631602 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e40cc-4fb0-41f4-8adc-4a3772ff79e2 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:14.632886 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 586/1178] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:21:14.638257 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c91b12-1aab-489e-b8f3-ee9b007e4c0f None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:14.638674 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c91b12-1aab-489e-b8f3-ee9b007e4c0f None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:14.638856 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c91b12-1aab-489e-b8f3-ee9b007e4c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:14.655741 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-e4c91b12-1aab-489e-b8f3-ee9b007e4c0f None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:21:14.656910 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e4c91b12-1aab-489e-b8f3-ee9b007e4c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:21:14.721152 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 593/1179] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:21:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:21:14.744095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e40cc-4fb0-41f4-8adc-4a3772ff79e2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:14.842115 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e40cc-4fb0-41f4-8adc-4a3772ff79e2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:14.858011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:14.875496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c1ca1-1027-4444-91be-034fc02e86ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:14.876321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c1ca1-1027-4444-91be-034fc02e86ef None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:14.876605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c1ca1-1027-4444-91be-034fc02e86ef None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:14.876881 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c1ca1-1027-4444-91be-034fc02e86ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:14.887351 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c1ca1-1027-4444-91be-034fc02e86ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:21:14.895301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-383c1ca1-1027-4444-91be-034fc02e86ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:21:14.895301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:21:14.895301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:21:14.895301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:21:14.895301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:21:14.895301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:21:14.895301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:21:14.895301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:21:14.895301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:21:14.895301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:21:14.895301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:21:14.895301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:21:14.895301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:21:14.895301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:21:14.895301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:21:14.895301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:21:14.896380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:21:14.896380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:21:14.896380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:21:14.896380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:21:14.896380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:21:14.896380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:21:14.896380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:21:14.896380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:21:14.896380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:21:14.896380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:21:14.896380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:21:14.896380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:21:14.896380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:21:14.896380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:21:14.896380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:21:14.896380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:21:14.897417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:21:14.897417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:21:14.897417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:21:14.897417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:21:14.897417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:21:14.897417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:21:14.897417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:21:14.897417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:21:14.897417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:21:14.897417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:21:14.897417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:21:14.897417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:21:14.897417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 587/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:21:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:21:14.902392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c91b12-1aab-489e-b8f3-ee9b007e4c0f None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:14.946582 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:14.999059 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c91b12-1aab-489e-b8f3-ee9b007e4c0f None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:15.031678 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84754e26-e72e-4424-aa0b-f0b1295122a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:15.032331 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84754e26-e72e-4424-aa0b-f0b1295122a3 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:15.032617 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84754e26-e72e-4424-aa0b-f0b1295122a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:15.032896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84754e26-e72e-4424-aa0b-f0b1295122a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:15.033630 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84754e26-e72e-4424-aa0b-f0b1295122a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:21:15.033939 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84754e26-e72e-4424-aa0b-f0b1295122a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:15.035361 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84754e26-e72e-4424-aa0b-f0b1295122a3 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:15.043136 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 594/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:21:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:21:15.048784 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c1ca1-1027-4444-91be-034fc02e86ef None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:15.147504 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c1ca1-1027-4444-91be-034fc02e86ef None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:15.180589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35257a55-3229-4c36-b076-87bf11626678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:15.181455 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35257a55-3229-4c36-b076-87bf11626678 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:15.181743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35257a55-3229-4c36-b076-87bf11626678 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:15.182028 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35257a55-3229-4c36-b076-87bf11626678 None admin] PATH_INFO: `/v3/users/da0c867b1c724f48959fb2f5a56f77d0` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:15.196761 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35257a55-3229-4c36-b076-87bf11626678 None admin] RBAC: Authorizing `identity:get_user(user_id=da0c867b1c724f48959fb2f5a56f77d0)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:15.198238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35257a55-3229-4c36-b076-87bf11626678 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:15.199939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 588/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:21:15 2022] GET /identity/v3/users/da0c867b1c724f48959fb2f5a56f77d0 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:21:15.205651 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84754e26-e72e-4424-aa0b-f0b1295122a3 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:15.302362 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84754e26-e72e-4424-aa0b-f0b1295122a3 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:15.308969 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:15.334793 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7016ede-e84d-4a84-b515-7a7a563bd63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:15.335423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7016ede-e84d-4a84-b515-7a7a563bd63d None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:15.335710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7016ede-e84d-4a84-b515-7a7a563bd63d None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:15.335991 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7016ede-e84d-4a84-b515-7a7a563bd63d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:15.400508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7016ede-e84d-4a84-b515-7a7a563bd63d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:15.401889 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7016ede-e84d-4a84-b515-7a7a563bd63d None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:15.505154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 595/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:21:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:21:15.511109 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35257a55-3229-4c36-b076-87bf11626678 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:15.544373 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:15.608432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35257a55-3229-4c36-b076-87bf11626678 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:15.640824 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a6ae4-3f54-4a77-8eac-69efd28ee81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:15.641670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a6ae4-3f54-4a77-8eac-69efd28ee81e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:15.641952 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a6ae4-3f54-4a77-8eac-69efd28ee81e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:15.642224 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a6ae4-3f54-4a77-8eac-69efd28ee81e None admin] PATH_INFO: `/v3/projects/11c996f6e3834fb89f1498c7f3dba0c1` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:15.643420 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a6ae4-3f54-4a77-8eac-69efd28ee81e None admin] RBAC: Authorizing `identity:get_project(project_id=11c996f6e3834fb89f1498c7f3dba0c1)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:15.645389 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a6ae4-3f54-4a77-8eac-69efd28ee81e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:15.647074 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 589/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:21:15 2022] GET /identity/v3/projects/11c996f6e3834fb89f1498c7f3dba0c1 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:21:15.653081 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7016ede-e84d-4a84-b515-7a7a563bd63d None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:15.661501 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:15.750476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7016ede-e84d-4a84-b515-7a7a563bd63d None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:15.783532 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c19b08-add4-433d-ac71-119a24ca20ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:15.784170 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c19b08-add4-433d-ac71-119a24ca20ca None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:15.784457 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c19b08-add4-433d-ac71-119a24ca20ca None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:15.785326 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c19b08-add4-433d-ac71-119a24ca20ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:15.786149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c19b08-add4-433d-ac71-119a24ca20ca None admin] RBAC: Adding query filter params (role.id=3ae7c5e54e084ac4a1f94da93a667583, scope.project.id=11c996f6e3834fb89f1498c7f3dba0c1, user.id=da0c867b1c724f48959fb2f5a56f77d0) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:21:15.786463 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c19b08-add4-433d-ac71-119a24ca20ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:15.787926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c19b08-add4-433d-ac71-119a24ca20ca None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:15.793199 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 596/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:21:15 2022] GET /identity/v3/role_assignments?user.id=da0c867b1c724f48959fb2f5a56f77d0&scope.project.id=11c996f6e3834fb89f1498c7f3dba0c1&role.id=3ae7c5e54e084ac4a1f94da93a667583 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:21:17.940650 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50b55e-143a-4128-aea3-ea5829057ab6 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:17.941207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50b55e-143a-4128-aea3-ea5829057ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:17.941363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50b55e-143a-4128-aea3-ea5829057ab6 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:17.942766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 590/1186] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:21:17.948011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c581c-3775-4474-845b-32c9b479a261 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:17.948411 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c581c-3775-4474-845b-32c9b479a261 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:17.948570 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c581c-3775-4474-845b-32c9b479a261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:17.965558 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-619c581c-3775-4474-845b-32c9b479a261 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:21:17.966775 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-619c581c-3775-4474-845b-32c9b479a261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:21:18.027216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:18.032155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 597/1187] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:21:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:21:18.055929 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50b55e-143a-4128-aea3-ea5829057ab6 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:18.157287 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50b55e-143a-4128-aea3-ea5829057ab6 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:18.159202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:18.193141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f2d44-3b58-4eef-a55c-c05e52d50b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:18.193888 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f2d44-3b58-4eef-a55c-c05e52d50b2f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:18.194174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f2d44-3b58-4eef-a55c-c05e52d50b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:18.194452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f2d44-3b58-4eef-a55c-c05e52d50b2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:18.204490 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f2d44-3b58-4eef-a55c-c05e52d50b2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:21:18.212589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-6d1f2d44-3b58-4eef-a55c-c05e52d50b2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:21:18.212589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:21:18.212589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:21:18.212589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:21:18.212589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:21:18.212589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:21:18.212589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:21:18.212589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:21:18.212589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:21:18.212589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:21:18.212589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:21:18.212589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:21:18.212589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:21:18.212589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:21:18.212589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:21:18.212589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:21:18.213684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:21:18.213684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:21:18.213684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:21:18.213684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:21:18.213684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:21:18.213684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:21:18.213684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:21:18.213684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:21:18.213684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:21:18.213684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:21:18.213684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:21:18.213684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:21:18.213684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:21:18.213684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:21:18.213684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:21:18.213684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:21:18.214596 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:21:18.214596 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:21:18.214596 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:21:18.214596 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:21:18.214596 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:21:18.214596 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:21:18.214596 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:21:18.214596 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:21:18.214596 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:21:18.214596 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:21:18.214596 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:21:18.214596 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:21:18.214596 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 591/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:21:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:21:18.219757 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c581c-3775-4474-845b-32c9b479a261 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:18.320903 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c581c-3775-4474-845b-32c9b479a261 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:18.353035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dfe4d-ef23-4ac5-9923-e5e4f0b25898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:18.353680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dfe4d-ef23-4ac5-9923-e5e4f0b25898 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:18.354224 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dfe4d-ef23-4ac5-9923-e5e4f0b25898 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:18.354485 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dfe4d-ef23-4ac5-9923-e5e4f0b25898 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:18.355244 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362dfe4d-ef23-4ac5-9923-e5e4f0b25898 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:21:18.355545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362dfe4d-ef23-4ac5-9923-e5e4f0b25898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:18.356898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362dfe4d-ef23-4ac5-9923-e5e4f0b25898 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:18.364604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 598/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:21:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:21:18.370470 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f2d44-3b58-4eef-a55c-c05e52d50b2f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:18.468463 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f2d44-3b58-4eef-a55c-c05e52d50b2f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:18.500900 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb09487-476b-4cc3-aff4-f21dff3a967f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:18.501792 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb09487-476b-4cc3-aff4-f21dff3a967f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:18.502079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb09487-476b-4cc3-aff4-f21dff3a967f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:18.502357 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb09487-476b-4cc3-aff4-f21dff3a967f None admin] PATH_INFO: `/v3/users/da0c867b1c724f48959fb2f5a56f77d0` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:18.504160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb09487-476b-4cc3-aff4-f21dff3a967f None admin] RBAC: Authorizing `identity:get_user(user_id=da0c867b1c724f48959fb2f5a56f77d0)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:18.505836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb09487-476b-4cc3-aff4-f21dff3a967f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:18.507331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 592/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:21:18 2022] GET /identity/v3/users/da0c867b1c724f48959fb2f5a56f77d0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:21:18.513765 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dfe4d-ef23-4ac5-9923-e5e4f0b25898 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:18.576689 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:18.614604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dfe4d-ef23-4ac5-9923-e5e4f0b25898 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:18.646984 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68207caf-a5b0-4b8e-9721-182dc343db9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:18.647822 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68207caf-a5b0-4b8e-9721-182dc343db9c None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:18.648103 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68207caf-a5b0-4b8e-9721-182dc343db9c None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:18.648375 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68207caf-a5b0-4b8e-9721-182dc343db9c None admin] PATH_INFO: `/v3/projects/11c996f6e3834fb89f1498c7f3dba0c1` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:18.649512 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68207caf-a5b0-4b8e-9721-182dc343db9c None admin] RBAC: Authorizing `identity:get_project(project_id=11c996f6e3834fb89f1498c7f3dba0c1)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:18.651021 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68207caf-a5b0-4b8e-9721-182dc343db9c None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:18.652662 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 599/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:21:18 2022] GET /identity/v3/projects/11c996f6e3834fb89f1498c7f3dba0c1 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:21:18.658586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb09487-476b-4cc3-aff4-f21dff3a967f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:18.688885 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:18.755816 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb09487-476b-4cc3-aff4-f21dff3a967f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:18.788223 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93260a-eee0-4486-a4f3-f6435ae015d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:18.789088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93260a-eee0-4486-a4f3-f6435ae015d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:18.789368 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93260a-eee0-4486-a4f3-f6435ae015d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:18.789641 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93260a-eee0-4486-a4f3-f6435ae015d0 None admin] PATH_INFO: `/v3/projects/11c996f6e3834fb89f1498c7f3dba0c1/users/da0c867b1c724f48959fb2f5a56f77d0/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:18.791702 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93260a-eee0-4486-a4f3-f6435ae015d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=11c996f6e3834fb89f1498c7f3dba0c1, user_id=da0c867b1c724f48959fb2f5a56f77d0, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:18.793214 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93260a-eee0-4486-a4f3-f6435ae015d0 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:18.805950 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 593/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:21:18 2022] PUT /identity/v3/projects/11c996f6e3834fb89f1498c7f3dba0c1/users/da0c867b1c724f48959fb2f5a56f77d0/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:21:21.072691 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee903c8a-5996-4dd7-a3cb-2090e1045297 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:21.073219 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee903c8a-5996-4dd7-a3cb-2090e1045297 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:21.073335 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee903c8a-5996-4dd7-a3cb-2090e1045297 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:21.074845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 600/1193] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:21:21.080081 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f911b-14d0-4895-b11d-ab60a8aabbb5 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:21.080501 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f911b-14d0-4895-b11d-ab60a8aabbb5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:21.080640 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f911b-14d0-4895-b11d-ab60a8aabbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:21.098126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d47f911b-14d0-4895-b11d-ab60a8aabbb5 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:21:21.099327 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d47f911b-14d0-4895-b11d-ab60a8aabbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:21:21.164609 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 594/1194] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:21:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 12:21:21.188023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee903c8a-5996-4dd7-a3cb-2090e1045297 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:21.287986 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee903c8a-5996-4dd7-a3cb-2090e1045297 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:21.314561 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:21.320918 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993539e6-b662-48e7-9180-5eabee389d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:21.321689 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993539e6-b662-48e7-9180-5eabee389d38 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:21.321971 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993539e6-b662-48e7-9180-5eabee389d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:21.322247 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993539e6-b662-48e7-9180-5eabee389d38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:21.333258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993539e6-b662-48e7-9180-5eabee389d38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:21:21.340567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-993539e6-b662-48e7-9180-5eabee389d38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:21:21.340567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:21:21.340567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:21:21.340567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:21:21.340567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:21:21.340567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:21:21.340567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:21:21.340567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:21:21.340567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:21:21.340567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:21:21.340567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:21:21.340567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:21:21.340567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:21:21.340567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:21:21.340567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:21:21.340567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:21:21.341613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:21:21.341613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:21:21.341613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:21:21.341613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:21:21.341613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:21:21.341613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:21:21.341613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:21:21.341613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:21:21.341613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:21:21.341613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:21:21.341613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:21:21.341613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:21:21.341613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:21:21.341613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:21:21.341613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:21:21.341613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:21:21.342470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:21:21.342470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:21:21.342470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:21:21.342470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:21:21.342470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:21:21.342470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:21:21.342470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:21:21.342470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:21:21.342470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:21:21.342470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:21:21.342470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:21:21.342470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:21:21.342470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 601/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:21:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:21:21.348062 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f911b-14d0-4895-b11d-ab60a8aabbb5 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:21.368967 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:21.444224 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f911b-14d0-4895-b11d-ab60a8aabbb5 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:21.477033 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854146d-3e9c-46de-b326-ba5537bc07ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:21.477680 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854146d-3e9c-46de-b326-ba5537bc07ed None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:21.477960 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854146d-3e9c-46de-b326-ba5537bc07ed None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:21.478232 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854146d-3e9c-46de-b326-ba5537bc07ed None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:21.479267 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854146d-3e9c-46de-b326-ba5537bc07ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:21:21.479570 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854146d-3e9c-46de-b326-ba5537bc07ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:21.480942 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854146d-3e9c-46de-b326-ba5537bc07ed None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:21.488956 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 595/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:21:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:21:21.494623 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993539e6-b662-48e7-9180-5eabee389d38 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:21.591235 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993539e6-b662-48e7-9180-5eabee389d38 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:21.624928 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda8b78-3c5b-468f-b865-66b7f5eddfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:21.625769 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda8b78-3c5b-468f-b865-66b7f5eddfac None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:21.626059 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda8b78-3c5b-468f-b865-66b7f5eddfac None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:21.626340 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda8b78-3c5b-468f-b865-66b7f5eddfac None admin] PATH_INFO: `/v3/users/da0c867b1c724f48959fb2f5a56f77d0` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:21.627540 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda8b78-3c5b-468f-b865-66b7f5eddfac None admin] RBAC: Authorizing `identity:get_user(user_id=da0c867b1c724f48959fb2f5a56f77d0)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:21.629570 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda8b78-3c5b-468f-b865-66b7f5eddfac None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:21.631193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 602/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Mon May 23 12:21:21 2022] GET /identity/v3/users/da0c867b1c724f48959fb2f5a56f77d0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:21:21.636644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854146d-3e9c-46de-b326-ba5537bc07ed None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:21.715908 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:21.733563 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854146d-3e9c-46de-b326-ba5537bc07ed None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:21.766205 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ca2dc-7d82-420c-90f8-4f308f0ea994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:21.766863 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ca2dc-7d82-420c-90f8-4f308f0ea994 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:21.767151 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ca2dc-7d82-420c-90f8-4f308f0ea994 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:21.767428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ca2dc-7d82-420c-90f8-4f308f0ea994 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:21.831282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ca2dc-7d82-420c-90f8-4f308f0ea994 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:21.832736 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ca2dc-7d82-420c-90f8-4f308f0ea994 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:21.914786 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:21.933604 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 596/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:21:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:21:21.939489 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda8b78-3c5b-468f-b865-66b7f5eddfac None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:21.997993 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:22.039025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda8b78-3c5b-468f-b865-66b7f5eddfac None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:22.071727 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a337c5-3829-4929-9305-30f50d2d629b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:22.072594 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a337c5-3829-4929-9305-30f50d2d629b None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:22.072881 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a337c5-3829-4929-9305-30f50d2d629b None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:22.073413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a337c5-3829-4929-9305-30f50d2d629b None admin] PATH_INFO: `/v3/projects/11c996f6e3834fb89f1498c7f3dba0c1` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:22.074333 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a337c5-3829-4929-9305-30f50d2d629b None admin] RBAC: Authorizing `identity:get_project(project_id=11c996f6e3834fb89f1498c7f3dba0c1)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:22.075792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a337c5-3829-4929-9305-30f50d2d629b None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:22.077454 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 603/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Mon May 23 12:21:21 2022] GET /identity/v3/projects/11c996f6e3834fb89f1498c7f3dba0c1 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:21:22.083556 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ca2dc-7d82-420c-90f8-4f308f0ea994 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:21:22.206135 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ca2dc-7d82-420c-90f8-4f308f0ea994 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:21:22.250988 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa50022-1d45-4856-af1b-82032b4bf01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:21:22.251642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa50022-1d45-4856-af1b-82032b4bf01e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:21:22.251930 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa50022-1d45-4856-af1b-82032b4bf01e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:21:22.252209 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa50022-1d45-4856-af1b-82032b4bf01e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:21:22.253038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa50022-1d45-4856-af1b-82032b4bf01e None admin] RBAC: Adding query filter params (role.id=3ae7c5e54e084ac4a1f94da93a667583, scope.project.id=11c996f6e3834fb89f1498c7f3dba0c1, user.id=da0c867b1c724f48959fb2f5a56f77d0) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:21:22.255202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa50022-1d45-4856-af1b-82032b4bf01e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:21:22.259103 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa50022-1d45-4856-af1b-82032b4bf01e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:21:22.266063 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 597/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:21:22 2022] GET /identity/v3/role_assignments?user.id=da0c867b1c724f48959fb2f5a56f77d0&scope.project.id=11c996f6e3834fb89f1498c7f3dba0c1&role.id=3ae7c5e54e084ac4a1f94da93a667583 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:21:32.067677 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=37 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:21:32.263400 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=77 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:23.377066 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4618e5-08a2-476d-95be-1f40acb829ac None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:23.377066 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4618e5-08a2-476d-95be-1f40acb829ac None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:23.377066 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4618e5-08a2-476d-95be-1f40acb829ac None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:23.377066 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 604/1201] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:22:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:22:23.388638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61a15a-5b1c-4b78-84b7-954b996f0487 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:23.389268 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61a15a-5b1c-4b78-84b7-954b996f0487 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:23.389524 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61a15a-5b1c-4b78-84b7-954b996f0487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:23.414226 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2b61a15a-5b1c-4b78-84b7-954b996f0487 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:22:23.415598 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2b61a15a-5b1c-4b78-84b7-954b996f0487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:22:23.517315 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 598/1202] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:22:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:22:23.543274 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4618e5-08a2-476d-95be-1f40acb829ac None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:23.722049 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4618e5-08a2-476d-95be-1f40acb829ac None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:23.770130 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d83d28-d89c-460d-b83d-761f55d245a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:23.771021 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d83d28-d89c-460d-b83d-761f55d245a8 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:23.771300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d83d28-d89c-460d-b83d-761f55d245a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:23.771616 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d83d28-d89c-460d-b83d-761f55d245a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:23.787492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d83d28-d89c-460d-b83d-761f55d245a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:23.789343 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d83d28-d89c-460d-b83d-761f55d245a8 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:23.816520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-d9d83d28-d89c-460d-b83d-761f55d245a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:23.816520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:23.816520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:23.816520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:23.816520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:23.816520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:23.816520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:23.816520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:23.816520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:23.816520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:23.816520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:23.816520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:23.816520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:22:23.816520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:22:23.816520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:22:23.818056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:22:23.818056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:23.818056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:23.818056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:23.818056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:23.818056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:23.818056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:23.818056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:23.818056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:22:23.818056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:23.818056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:23.818056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:23.818056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:23.818056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:23.818056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:23.818056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:23.818056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:23.819087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:22:23.819087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:22:23.819087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:23.819087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:22:23.823283 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 605/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:22:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:23.824812 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61a15a-5b1c-4b78-84b7-954b996f0487 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:23.956784 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61a15a-5b1c-4b78-84b7-954b996f0487 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:23.995759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:24.004613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518880b-4882-4c99-b3df-9376a8194309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:24.005343 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518880b-4882-4c99-b3df-9376a8194309 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:24.005589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518880b-4882-4c99-b3df-9376a8194309 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:24.005890 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518880b-4882-4c99-b3df-9376a8194309 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:24.006920 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518880b-4882-4c99-b3df-9376a8194309 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:24.007328 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518880b-4882-4c99-b3df-9376a8194309 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:24.009015 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518880b-4882-4c99-b3df-9376a8194309 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:24.026658 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 599/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:22:24.030702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d83d28-d89c-460d-b83d-761f55d245a8 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:24.110154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:24.176067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d83d28-d89c-460d-b83d-761f55d245a8 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:24.227944 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50813f51-2b38-40bf-81b5-f79240ecf841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:24.229166 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50813f51-2b38-40bf-81b5-f79240ecf841 None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:24.229736 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50813f51-2b38-40bf-81b5-f79240ecf841 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:24.230299 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50813f51-2b38-40bf-81b5-f79240ecf841 None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:24.231370 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50813f51-2b38-40bf-81b5-f79240ecf841 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:24.233080 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50813f51-2b38-40bf-81b5-f79240ecf841 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:24.262108 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 606/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Mon May 23 12:22:24 2022] POST /identity/v3/users => generated 251 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:22:26.843019 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38f031-abfe-485c-aa7b-1a172082daaa None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:26.843714 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38f031-abfe-485c-aa7b-1a172082daaa None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:26.843714 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38f031-abfe-485c-aa7b-1a172082daaa None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:26.845691 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 600/1206] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:22:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:22:26.852210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5375c-16b8-40bc-b41f-d2ff98808163 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:26.858220 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5375c-16b8-40bc-b41f-d2ff98808163 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:26.858220 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5375c-16b8-40bc-b41f-d2ff98808163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:26.871393 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-29f5375c-16b8-40bc-b41f-d2ff98808163 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:22:26.872828 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-29f5375c-16b8-40bc-b41f-d2ff98808163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:22:26.960527 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 607/1207] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:22:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:22:26.987586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38f031-abfe-485c-aa7b-1a172082daaa None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:27.110828 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38f031-abfe-485c-aa7b-1a172082daaa None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:27.149384 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a83773-2779-4ae8-9073-17d016905aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:27.150214 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a83773-2779-4ae8-9073-17d016905aea None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:27.150581 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a83773-2779-4ae8-9073-17d016905aea None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:27.150874 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a83773-2779-4ae8-9073-17d016905aea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:27.162949 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a83773-2779-4ae8-9073-17d016905aea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:22:27.171473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-41a83773-2779-4ae8-9073-17d016905aea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:22:27.171473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:27.171473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:27.171473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:27.171473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:27.171473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:27.171473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:27.171473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:27.171473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:27.171473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:27.171473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:27.171473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:27.171473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:22:27.171473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:22:27.171473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:22:27.171473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:22:27.175204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:22:27.175204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:22:27.175204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:22:27.175204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:22:27.175204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:27.175204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:27.175204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:27.175204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:27.175204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:27.175204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:27.175204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:27.175204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:22:27.175204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:27.175204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:27.175204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:27.175204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:27.176122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:27.176122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:27.176122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:27.176122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:27.176122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:22:27.176122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:22:27.176122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:22:27.176122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:22:27.176122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:22:27.176122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:22:27.176122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:22:27.176122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:22:27.176122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 601/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:22:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:27.180818 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5375c-16b8-40bc-b41f-d2ff98808163 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:27.225880 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:27.300884 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5375c-16b8-40bc-b41f-d2ff98808163 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:27.340354 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8bc1c8-3ecc-4121-a6e6-c5b269090c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:27.341081 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bc1c8-3ecc-4121-a6e6-c5b269090c19 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:27.341396 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bc1c8-3ecc-4121-a6e6-c5b269090c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:27.341643 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bc1c8-3ecc-4121-a6e6-c5b269090c19 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:27.342437 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8bc1c8-3ecc-4121-a6e6-c5b269090c19 None admin] RBAC: Adding query filter params (name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:27.342787 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8bc1c8-3ecc-4121-a6e6-c5b269090c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:27.344803 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8bc1c8-3ecc-4121-a6e6-c5b269090c19 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:27.360750 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 608/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Mon May 23 12:22:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:27.362173 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a83773-2779-4ae8-9073-17d016905aea None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:27.419226 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:27.489183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a83773-2779-4ae8-9073-17d016905aea None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:27.539556 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e0774-493e-43aa-8bfa-b56401cdaff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:27.540366 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e0774-493e-43aa-8bfa-b56401cdaff1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:27.540658 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e0774-493e-43aa-8bfa-b56401cdaff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:27.540963 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e0774-493e-43aa-8bfa-b56401cdaff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:27.555509 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e0774-493e-43aa-8bfa-b56401cdaff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:27.557259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e0774-493e-43aa-8bfa-b56401cdaff1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:27.582104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-786e0774-493e-43aa-8bfa-b56401cdaff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:27.582104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:27.582104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:27.582104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:27.582104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:27.582104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:27.582104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:27.582104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:27.582104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:27.582104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:27.582104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:27.582104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:27.582104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:22:27.582104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:22:27.582104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:22:27.583303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:22:27.583303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:27.583303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:27.583303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:27.583303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:27.583303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:27.583303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:27.583303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:27.583303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:22:27.583303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:27.583303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:27.583303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:27.583303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:27.583303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:27.583303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:27.583303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:27.583303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:27.584314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:22:27.584314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:22:27.584314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:27.584314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:22:27.584314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 602/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:22:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:27.585094 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8bc1c8-3ecc-4121-a6e6-c5b269090c19 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:27.700838 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:27.704575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8bc1c8-3ecc-4121-a6e6-c5b269090c19 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:27.746797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf9986-0586-4cb9-97e0-2d034162f719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:27.747492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf9986-0586-4cb9-97e0-2d034162f719 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:27.747818 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf9986-0586-4cb9-97e0-2d034162f719 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:27.748100 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf9986-0586-4cb9-97e0-2d034162f719 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:27.748888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf9986-0586-4cb9-97e0-2d034162f719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:27.749235 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf9986-0586-4cb9-97e0-2d034162f719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:27.750705 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf9986-0586-4cb9-97e0-2d034162f719 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:27.766421 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 609/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:27.772616 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e0774-493e-43aa-8bfa-b56401cdaff1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:27.906007 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e0774-493e-43aa-8bfa-b56401cdaff1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:27.908652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:27.949846 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14b0f6-fed7-4cfe-be22-ae1655ffaa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:27.950779 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14b0f6-fed7-4cfe-be22-ae1655ffaa70 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:27.951157 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14b0f6-fed7-4cfe-be22-ae1655ffaa70 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:27.951391 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14b0f6-fed7-4cfe-be22-ae1655ffaa70 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:27.961146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14b0f6-fed7-4cfe-be22-ae1655ffaa70 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:27.962906 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14b0f6-fed7-4cfe-be22-ae1655ffaa70 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:27.980653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-1a14b0f6-fed7-4cfe-be22-ae1655ffaa70 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 12:22:27.980653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:27.980653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:27.980653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:27.980653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:27.980653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:27.980653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:27.980653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:27.980653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:27.980653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:27.980653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:27.980653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:27.980653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:22:27.980653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:22:27.980653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:22:27.980653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:22:27.981727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:27.981727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:27.981727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:22:27.981727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:22:27.981727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:22:27.981727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:22:27.981727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:27.981727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:27.981727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:27.981727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:27.981727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:27.981727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:22:27.981727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:27.981727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:27.981727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:27.981727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:27.981727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:27.981727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:27.982736 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:27.982736 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:27.982736 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:22:27.982736 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:22:27.982736 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:22:27.982736 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:22:27.982736 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:22:27.982736 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:22:27.982736 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 12:22:27.982736 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:22:27.982736 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 603/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:22:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:22:27.993399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf9986-0586-4cb9-97e0-2d034162f719 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:28.130817 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf9986-0586-4cb9-97e0-2d034162f719 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:28.171227 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03abb74-2383-446e-b7b8-0afdfe46b9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:28.172482 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03abb74-2383-446e-b7b8-0afdfe46b9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:28.175643 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03abb74-2383-446e-b7b8-0afdfe46b9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:28.175643 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03abb74-2383-446e-b7b8-0afdfe46b9b1 None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:28.175643 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03abb74-2383-446e-b7b8-0afdfe46b9b1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:28.175643 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03abb74-2383-446e-b7b8-0afdfe46b9b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:28.175972 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03abb74-2383-446e-b7b8-0afdfe46b9b1 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:28.198062 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 610/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Mon May 23 12:22:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:28.204333 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14b0f6-fed7-4cfe-be22-ae1655ffaa70 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:28.331721 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14b0f6-fed7-4cfe-be22-ae1655ffaa70 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:28.376443 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e49a1-f581-4c16-8b45-80f350b78fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:28.377239 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e49a1-f581-4c16-8b45-80f350b78fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:28.377634 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e49a1-f581-4c16-8b45-80f350b78fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:28.377911 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e49a1-f581-4c16-8b45-80f350b78fd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:28.414881 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:28.462656 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e49a1-f581-4c16-8b45-80f350b78fd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:28.464531 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e49a1-f581-4c16-8b45-80f350b78fd0 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:28.590573 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 604/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:22:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:22:28.597955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03abb74-2383-446e-b7b8-0afdfe46b9b1 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:28.621301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:28.717458 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03abb74-2383-446e-b7b8-0afdfe46b9b1 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:28.757238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedddd94-2cd9-424c-b3f7-ef6e83badfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:28.758042 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedddd94-2cd9-424c-b3f7-ef6e83badfd8 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:28.758328 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedddd94-2cd9-424c-b3f7-ef6e83badfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:28.758632 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedddd94-2cd9-424c-b3f7-ef6e83badfd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:28.770363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedddd94-2cd9-424c-b3f7-ef6e83badfd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:28.771877 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedddd94-2cd9-424c-b3f7-ef6e83badfd8 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:28.790789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-dedddd94-2cd9-424c-b3f7-ef6e83badfd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:28.790789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:28.790789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:28.790789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:28.790789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:28.790789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:28.790789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:28.790789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:28.790789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:28.790789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:28.790789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:28.790789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:28.790789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:22:28.790789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:22:28.790789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:22:28.791942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:22:28.791942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:28.791942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:28.791942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:28.791942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:28.791942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:28.791942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:28.791942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:28.791942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:22:28.791942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:28.791942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:28.791942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:28.791942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:28.791942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:28.791942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:28.791942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:28.791942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:28.792880 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:22:28.792880 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:22:28.792880 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:28.792880 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:22:28.792880 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 611/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:22:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:28.798350 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e49a1-f581-4c16-8b45-80f350b78fd0 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:28.868269 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:28.914168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e49a1-f581-4c16-8b45-80f350b78fd0 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:28.952519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d107c65-14b5-4597-9096-446e5072e9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:28.954386 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d107c65-14b5-4597-9096-446e5072e9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:28.954386 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d107c65-14b5-4597-9096-446e5072e9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:28.954733 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d107c65-14b5-4597-9096-446e5072e9f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:28.955258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d107c65-14b5-4597-9096-446e5072e9f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:28.955579 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d107c65-14b5-4597-9096-446e5072e9f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:28.957037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d107c65-14b5-4597-9096-446e5072e9f2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:28.971314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 605/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:22:28.978563 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedddd94-2cd9-424c-b3f7-ef6e83badfd8 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:29.074773 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:29.132519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedddd94-2cd9-424c-b3f7-ef6e83badfd8 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:29.171012 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bc006-c629-4f0d-9aa6-ef8c88c677eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:29.171889 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bc006-c629-4f0d-9aa6-ef8c88c677eb None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:29.172193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bc006-c629-4f0d-9aa6-ef8c88c677eb None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:29.172432 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bc006-c629-4f0d-9aa6-ef8c88c677eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:29.180541 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661bc006-c629-4f0d-9aa6-ef8c88c677eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:29.182065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661bc006-c629-4f0d-9aa6-ef8c88c677eb None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:29.200829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-661bc006-c629-4f0d-9aa6-ef8c88c677eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:22:29.200829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:29.200829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:29.200829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:29.200829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:29.200829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:29.200829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:29.200829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:29.200829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:29.200829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:29.200829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:29.200829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:29.200829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:22:29.200829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:22:29.200829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:22:29.201875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:22:29.201875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:29.201875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:29.201875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:29.201875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:29.201875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:29.201875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:29.201875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:29.201875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:22:29.201875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:29.201875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:29.201875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:29.201875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:29.201875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:29.201875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:29.201875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:29.201875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:29.202954 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:22:29.202954 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:22:29.202954 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:22:29.202954 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:22:29.202954 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:22:29.202954 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:22:29.202954 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:22:29.202954 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:22:29.202954 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 612/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:22:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:29.209027 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d107c65-14b5-4597-9096-446e5072e9f2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:29.336117 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d107c65-14b5-4597-9096-446e5072e9f2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:29.366740 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:29.392743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ddd0b-fb46-45d2-b3d5-b6404f31b9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:29.393419 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ddd0b-fb46-45d2-b3d5-b6404f31b9da None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:29.393722 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ddd0b-fb46-45d2-b3d5-b6404f31b9da None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:29.393997 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ddd0b-fb46-45d2-b3d5-b6404f31b9da None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:29.394832 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ddd0b-fb46-45d2-b3d5-b6404f31b9da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:29.395144 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ddd0b-fb46-45d2-b3d5-b6404f31b9da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:29.396652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ddd0b-fb46-45d2-b3d5-b6404f31b9da None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:29.416780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 606/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:22:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:22:29.423342 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bc006-c629-4f0d-9aa6-ef8c88c677eb None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:29.548914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bc006-c629-4f0d-9aa6-ef8c88c677eb None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:29.583598 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:29.594447 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122fe5b-6d62-47eb-a6e8-67e9d793f7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:29.595514 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122fe5b-6d62-47eb-a6e8-67e9d793f7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:29.596003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122fe5b-6d62-47eb-a6e8-67e9d793f7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:29.596515 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122fe5b-6d62-47eb-a6e8-67e9d793f7d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:29.597646 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122fe5b-6d62-47eb-a6e8-67e9d793f7d1 None admin] RBAC: Adding query filter params (role.id=e344e91a09be4d10834ea5f942345beb, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=a3fde90ab1e0490ebb7cb514173d984e) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:29.598202 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122fe5b-6d62-47eb-a6e8-67e9d793f7d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:29.600029 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122fe5b-6d62-47eb-a6e8-67e9d793f7d1 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:29.618546 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 613/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:22:29 2022] GET /identity/v3/role_assignments?user.id=a3fde90ab1e0490ebb7cb514173d984e&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=e344e91a09be4d10834ea5f942345beb => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:31.844564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4ae38-e0bc-4e1e-91eb-4d8e066ed578 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:31.845152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4ae38-e0bc-4e1e-91eb-4d8e066ed578 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:31.845152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4ae38-e0bc-4e1e-91eb-4d8e066ed578 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:31.846518 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 607/1220] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:22:31.852495 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53859bcf-8986-4744-afe8-e27aeb32c3e5 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:31.853010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53859bcf-8986-4744-afe8-e27aeb32c3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:31.853100 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53859bcf-8986-4744-afe8-e27aeb32c3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:31.870974 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-53859bcf-8986-4744-afe8-e27aeb32c3e5 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:22:31.872173 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-53859bcf-8986-4744-afe8-e27aeb32c3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:22:31.993127 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 614/1221] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:22:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:22:32.017750 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4ae38-e0bc-4e1e-91eb-4d8e066ed578 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:32.166734 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4ae38-e0bc-4e1e-91eb-4d8e066ed578 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:32.207509 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e9e94-0370-4263-a3f5-89464b14dbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:32.208357 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e9e94-0370-4263-a3f5-89464b14dbac None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:32.208707 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e9e94-0370-4263-a3f5-89464b14dbac None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:32.209014 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e9e94-0370-4263-a3f5-89464b14dbac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:32.221636 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e9e94-0370-4263-a3f5-89464b14dbac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:22:32.230275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-e12e9e94-0370-4263-a3f5-89464b14dbac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:22:32.230275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:32.230275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:32.230275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:32.230275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:32.230275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:32.230275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:32.230275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:32.230275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:32.230275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:32.230275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:32.230275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:32.230275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:22:32.230275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:22:32.230275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:22:32.230275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:22:32.236433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:22:32.236433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:22:32.236433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:22:32.236433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:22:32.236433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:32.236433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:32.236433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:32.236433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:32.236433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:32.236433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:32.236433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:32.236433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:22:32.236433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:32.236433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:32.236433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:32.236433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:32.238181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:32.238181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:32.238181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:32.238181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:32.238181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:22:32.238181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:22:32.238181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:22:32.238181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:22:32.238181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:22:32.238181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:22:32.238181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:22:32.238181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:22:32.238181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 608/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:22:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:32.239507 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53859bcf-8986-4744-afe8-e27aeb32c3e5 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:32.354900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53859bcf-8986-4744-afe8-e27aeb32c3e5 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:32.381772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:32.395432 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c68190-4d31-4c70-bb29-5b4117ca2db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:32.396203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c68190-4d31-4c70-bb29-5b4117ca2db8 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:32.396489 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c68190-4d31-4c70-bb29-5b4117ca2db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:32.396765 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c68190-4d31-4c70-bb29-5b4117ca2db8 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:32.397587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c68190-4d31-4c70-bb29-5b4117ca2db8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:32.397916 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c68190-4d31-4c70-bb29-5b4117ca2db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:32.399402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c68190-4d31-4c70-bb29-5b4117ca2db8 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:32.410714 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 615/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Mon May 23 12:22:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:32.417434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e9e94-0370-4263-a3f5-89464b14dbac None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:32.470125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:32.542603 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e9e94-0370-4263-a3f5-89464b14dbac None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:32.579851 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60779253-42cb-412a-a6f5-9df3a7e8680d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:32.580700 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60779253-42cb-412a-a6f5-9df3a7e8680d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:32.581006 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60779253-42cb-412a-a6f5-9df3a7e8680d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:32.581277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60779253-42cb-412a-a6f5-9df3a7e8680d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:32.592252 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60779253-42cb-412a-a6f5-9df3a7e8680d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:32.594300 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60779253-42cb-412a-a6f5-9df3a7e8680d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:32.612561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-60779253-42cb-412a-a6f5-9df3a7e8680d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:32.612561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:32.612561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:32.612561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:32.612561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:32.612561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:32.612561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:32.612561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:32.612561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:32.612561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:32.612561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:32.612561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:32.612561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:22:32.612561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:22:32.612561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:22:32.613797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:22:32.613797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:32.613797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:32.613797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:32.613797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:32.613797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:32.613797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:32.613797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:32.613797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:22:32.613797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:32.613797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:32.613797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:32.613797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:32.613797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:32.613797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:32.613797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:32.613797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:32.614921 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:22:32.614921 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:22:32.614921 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:32.614921 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:22:32.618927 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 609/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:22:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:32.620099 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c68190-4d31-4c70-bb29-5b4117ca2db8 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:32.741538 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c68190-4d31-4c70-bb29-5b4117ca2db8 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:32.781522 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fb7eb-b7ae-475f-a25a-6cbd217baf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:32.782186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fb7eb-b7ae-475f-a25a-6cbd217baf54 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:32.782470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fb7eb-b7ae-475f-a25a-6cbd217baf54 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:32.782773 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fb7eb-b7ae-475f-a25a-6cbd217baf54 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:32.783511 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fb7eb-b7ae-475f-a25a-6cbd217baf54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:32.783816 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fb7eb-b7ae-475f-a25a-6cbd217baf54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:32.785532 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fb7eb-b7ae-475f-a25a-6cbd217baf54 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:32.798781 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 616/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:32.804545 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60779253-42cb-412a-a6f5-9df3a7e8680d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:32.915200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:32.924149 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60779253-42cb-412a-a6f5-9df3a7e8680d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:32.965924 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d201b-5990-4f59-bf6e-eb8db81c94ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:32.966759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d201b-5990-4f59-bf6e-eb8db81c94ac None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:32.967055 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d201b-5990-4f59-bf6e-eb8db81c94ac None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:32.967316 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d201b-5990-4f59-bf6e-eb8db81c94ac None admin] PATH_INFO: `/v3/users/placement` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:32.976772 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d201b-5990-4f59-bf6e-eb8db81c94ac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:32.978417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d201b-5990-4f59-bf6e-eb8db81c94ac None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:32.995644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-ee8d201b-5990-4f59-bf6e-eb8db81c94ac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 12:22:32.995644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:32.995644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:32.995644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:32.995644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:32.995644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:32.995644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:32.995644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:32.995644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:32.995644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:32.995644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:32.995644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:32.995644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:22:32.995644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:22:32.995644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:22:32.995644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:22:32.996865 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:32.996865 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:32.996865 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:22:32.996865 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:22:32.996865 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:22:32.996865 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:22:32.996865 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:32.996865 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:32.996865 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:32.996865 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:32.996865 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:32.996865 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:22:32.996865 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:32.996865 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:32.996865 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:32.996865 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:32.996865 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:32.996865 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:32.998218 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:32.998218 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:32.998218 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:22:32.998218 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:22:32.998218 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:22:32.998218 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:22:32.998218 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:22:32.998218 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:22:32.998218 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 12:22:32.998218 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:22:32.998218 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 610/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:22:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:33.003129 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fb7eb-b7ae-475f-a25a-6cbd217baf54 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:33.058492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:33.124158 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fb7eb-b7ae-475f-a25a-6cbd217baf54 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:33.164907 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9eb5e-fa9c-48e3-9e48-ad07851734ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:33.165586 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9eb5e-fa9c-48e3-9e48-ad07851734ee None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:33.165929 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9eb5e-fa9c-48e3-9e48-ad07851734ee None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:33.166213 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9eb5e-fa9c-48e3-9e48-ad07851734ee None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:33.167117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9eb5e-fa9c-48e3-9e48-ad07851734ee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:33.168935 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9eb5e-fa9c-48e3-9e48-ad07851734ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:33.168935 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9eb5e-fa9c-48e3-9e48-ad07851734ee None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:33.195647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 617/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Mon May 23 12:22:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:33.201872 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d201b-5990-4f59-bf6e-eb8db81c94ac None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:33.323461 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d201b-5990-4f59-bf6e-eb8db81c94ac None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:33.364279 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812bcd9-3dfe-495b-8984-8c4252f45d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:33.365085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812bcd9-3dfe-495b-8984-8c4252f45d61 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:33.365467 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812bcd9-3dfe-495b-8984-8c4252f45d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:33.365864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812bcd9-3dfe-495b-8984-8c4252f45d61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:33.379438 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812bcd9-3dfe-495b-8984-8c4252f45d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:33.380949 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812bcd9-3dfe-495b-8984-8c4252f45d61 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:33.405082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-2812bcd9-3dfe-495b-8984-8c4252f45d61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:33.405082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:33.405082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:33.405082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:33.405082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:33.405082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:33.405082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:33.405082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:33.405082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:33.405082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:33.405082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:33.405082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:33.405082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:22:33.405082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:22:33.405082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:22:33.406821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:22:33.406821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:33.406821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:33.406821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:33.406821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:33.406821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:33.406821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:33.406821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:33.406821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:22:33.406821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:33.406821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:33.406821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:33.406821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:33.406821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:33.406821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:33.406821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:33.406821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:33.408075 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:22:33.408075 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:22:33.408075 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:33.408075 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:22:33.408075 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 611/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:22:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:33.413997 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9eb5e-fa9c-48e3-9e48-ad07851734ee None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:33.534860 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9eb5e-fa9c-48e3-9e48-ad07851734ee None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:33.537608 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:33.576750 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ee618-98f9-47cb-960b-bf9136520ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:33.577334 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ee618-98f9-47cb-960b-bf9136520ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:33.577628 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ee618-98f9-47cb-960b-bf9136520ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:33.578388 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ee618-98f9-47cb-960b-bf9136520ea5 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:33.579322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ee618-98f9-47cb-960b-bf9136520ea5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:33.579448 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ee618-98f9-47cb-960b-bf9136520ea5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:33.580902 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ee618-98f9-47cb-960b-bf9136520ea5 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:33.592997 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 618/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:33.599597 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812bcd9-3dfe-495b-8984-8c4252f45d61 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:33.609989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:33.731338 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812bcd9-3dfe-495b-8984-8c4252f45d61 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:33.774979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f0162-0069-4ac6-bcdd-ac4ef18bf396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:33.776369 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f0162-0069-4ac6-bcdd-ac4ef18bf396 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:33.776758 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f0162-0069-4ac6-bcdd-ac4ef18bf396 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:33.777048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f0162-0069-4ac6-bcdd-ac4ef18bf396 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:33.784732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f0162-0069-4ac6-bcdd-ac4ef18bf396 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:33.786222 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f0162-0069-4ac6-bcdd-ac4ef18bf396 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:33.800819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-5e9f0162-0069-4ac6-bcdd-ac4ef18bf396 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:22:33.800819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:33.800819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:33.800819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:33.800819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:33.800819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:33.800819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:33.800819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:33.800819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:33.800819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:33.800819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:33.800819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:33.800819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:22:33.800819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:22:33.800819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:22:33.801780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:22:33.801780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:33.801780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:33.801780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:33.801780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:33.801780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:33.801780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:33.801780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:33.801780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:22:33.801780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:33.801780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:33.801780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:33.801780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:33.801780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:33.801780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:33.801780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:33.801780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:33.802759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:22:33.802759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:22:33.802759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:22:33.802759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:22:33.802759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:22:33.802759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:22:33.802759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:22:33.802759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:22:33.802759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 612/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:22:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:22:33.808043 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ee618-98f9-47cb-960b-bf9136520ea5 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:33.921139 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ee618-98f9-47cb-960b-bf9136520ea5 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:33.961933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e5eb9-5906-474b-9f27-621ebc24c6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:33.962637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e5eb9-5906-474b-9f27-621ebc24c6cc None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:33.962925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e5eb9-5906-474b-9f27-621ebc24c6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:33.963201 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e5eb9-5906-474b-9f27-621ebc24c6cc None admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:33.963987 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e5eb9-5906-474b-9f27-621ebc24c6cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:33.964299 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e5eb9-5906-474b-9f27-621ebc24c6cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:33.965747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e5eb9-5906-474b-9f27-621ebc24c6cc None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:33.980257 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 619/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:22:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:33.986594 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f0162-0069-4ac6-bcdd-ac4ef18bf396 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:34.075321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:34.113524 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f0162-0069-4ac6-bcdd-ac4ef18bf396 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:34.154614 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5ae68-1f1c-4892-8339-ea492449b17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:34.155522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5ae68-1f1c-4892-8339-ea492449b17c None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:34.155860 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5ae68-1f1c-4892-8339-ea492449b17c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:34.156641 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5ae68-1f1c-4892-8339-ea492449b17c None admin] PATH_INFO: `/v3/projects/402397b981be4f0c9e778a2771c41937/users/a3fde90ab1e0490ebb7cb514173d984e/roles/e344e91a09be4d10834ea5f942345beb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:34.181066 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5ae68-1f1c-4892-8339-ea492449b17c None admin] RBAC: Authorizing `identity:create_grant(project_id=402397b981be4f0c9e778a2771c41937, user_id=a3fde90ab1e0490ebb7cb514173d984e, role_id=e344e91a09be4d10834ea5f942345beb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:34.183240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5ae68-1f1c-4892-8339-ea492449b17c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:34.202352 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 613/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:22:33 2022] PUT /identity/v3/projects/402397b981be4f0c9e778a2771c41937/users/a3fde90ab1e0490ebb7cb514173d984e/roles/e344e91a09be4d10834ea5f942345beb => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:22:36.540826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e920c-99cf-46f6-b8f4-da893f7b9af6 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:36.541464 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e920c-99cf-46f6-b8f4-da893f7b9af6 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:36.541464 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e920c-99cf-46f6-b8f4-da893f7b9af6 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:36.542741 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 620/1233] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:22:36.548889 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edeccd-5c06-4843-934a-f2cd7aa068fe None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:36.549418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edeccd-5c06-4843-934a-f2cd7aa068fe None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:36.549525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edeccd-5c06-4843-934a-f2cd7aa068fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:36.568019 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-51edeccd-5c06-4843-934a-f2cd7aa068fe None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:22:36.569474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-51edeccd-5c06-4843-934a-f2cd7aa068fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:22:36.645940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 614/1234] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:22:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:22:36.671062 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e920c-99cf-46f6-b8f4-da893f7b9af6 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:36.704430 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:36.817782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e920c-99cf-46f6-b8f4-da893f7b9af6 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:36.860614 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6f4d4-04ec-4d0a-bffe-a05ef05a6441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:36.861492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6f4d4-04ec-4d0a-bffe-a05ef05a6441 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:36.861727 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6f4d4-04ec-4d0a-bffe-a05ef05a6441 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:36.861980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6f4d4-04ec-4d0a-bffe-a05ef05a6441 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:36.873555 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6f4d4-04ec-4d0a-bffe-a05ef05a6441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:22:36.881900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-05b6f4d4-04ec-4d0a-bffe-a05ef05a6441 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 12:22:36.881900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:36.881900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:36.881900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:36.881900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:36.881900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:36.881900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:36.881900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:36.881900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:36.881900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:36.881900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:36.881900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:36.881900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:22:36.881900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:22:36.881900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:22:36.881900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:22:36.883216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:22:36.883216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:22:36.883216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:22:36.883216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:22:36.883216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:36.883216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:36.883216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:36.883216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:36.883216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:36.883216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:36.883216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:36.883216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:22:36.883216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:36.883216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:36.883216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:36.883216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:36.884077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:36.884077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:36.884077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:36.884077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:36.884077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:22:36.884077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:22:36.884077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:22:36.884077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:22:36.884077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:22:36.884077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:22:36.884077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 12:22:36.884077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:22:36.884077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 621/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Mon May 23 12:22:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:36.889448 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edeccd-5c06-4843-934a-f2cd7aa068fe None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:36.950341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:37.015174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edeccd-5c06-4843-934a-f2cd7aa068fe None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:37.051763 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea711d-ae84-4577-9da9-b598a2e5049b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:37.052435 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea711d-ae84-4577-9da9-b598a2e5049b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:37.052718 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea711d-ae84-4577-9da9-b598a2e5049b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:37.053000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea711d-ae84-4577-9da9-b598a2e5049b None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:37.053781 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea711d-ae84-4577-9da9-b598a2e5049b None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:37.054088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea711d-ae84-4577-9da9-b598a2e5049b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:37.055508 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea711d-ae84-4577-9da9-b598a2e5049b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:37.065206 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 615/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Mon May 23 12:22:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:37.069800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6f4d4-04ec-4d0a-bffe-a05ef05a6441 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:37.168626 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:37.190921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6f4d4-04ec-4d0a-bffe-a05ef05a6441 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:37.236960 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b0d50-0f0a-456f-8cdd-0ff3696a653a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:37.237868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b0d50-0f0a-456f-8cdd-0ff3696a653a None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:37.238077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b0d50-0f0a-456f-8cdd-0ff3696a653a None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:37.238320 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b0d50-0f0a-456f-8cdd-0ff3696a653a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:37.250318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b0d50-0f0a-456f-8cdd-0ff3696a653a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:37.251914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b0d50-0f0a-456f-8cdd-0ff3696a653a None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:37.270476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-9c0b0d50-0f0a-456f-8cdd-0ff3696a653a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:37.270476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:37.270476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:37.270476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:37.270476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:37.270476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:37.270476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:37.270476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:37.270476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:37.270476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:37.270476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:37.270476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:37.270476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:22:37.270476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:22:37.270476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:22:37.276909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:22:37.276909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:37.276909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:37.276909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:37.276909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:37.276909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:37.276909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:37.276909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:37.276909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:22:37.276909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:37.276909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:37.276909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:37.276909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:37.276909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:37.276909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:37.276909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:37.276909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:37.278121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:22:37.278121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:22:37.278121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:37.278121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:22:37.278121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 622/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:22:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:37.278471 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea711d-ae84-4577-9da9-b598a2e5049b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:37.404701 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea711d-ae84-4577-9da9-b598a2e5049b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:37.415884 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:37.447518 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb92b70-f781-4a44-bd19-80095dd7cc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:37.448307 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb92b70-f781-4a44-bd19-80095dd7cc9b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:37.448610 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb92b70-f781-4a44-bd19-80095dd7cc9b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:37.448949 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb92b70-f781-4a44-bd19-80095dd7cc9b None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:37.449735 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb92b70-f781-4a44-bd19-80095dd7cc9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:37.450045 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb92b70-f781-4a44-bd19-80095dd7cc9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:37.451515 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb92b70-f781-4a44-bd19-80095dd7cc9b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:37.465542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 616/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:37.471833 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b0d50-0f0a-456f-8cdd-0ff3696a653a None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:37.597714 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b0d50-0f0a-456f-8cdd-0ff3696a653a None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:37.636536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698ee8d-6474-467d-b17a-406185865356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:37.637359 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698ee8d-6474-467d-b17a-406185865356 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:37.637650 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698ee8d-6474-467d-b17a-406185865356 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:37.637941 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698ee8d-6474-467d-b17a-406185865356 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:37.641739 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:37.647360 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698ee8d-6474-467d-b17a-406185865356 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:37.649171 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698ee8d-6474-467d-b17a-406185865356 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:37.665564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-7698ee8d-6474-467d-b17a-406185865356 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 12:22:37.665564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:37.665564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:37.665564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:37.665564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:37.665564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:37.665564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:37.665564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:37.665564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:37.665564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:37.665564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:37.665564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:37.665564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:22:37.665564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:22:37.665564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:22:37.665564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:22:37.666832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:37.666832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:37.666832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:22:37.666832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:22:37.666832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:22:37.666832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:22:37.666832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:37.666832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:37.666832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:37.666832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:37.666832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:37.666832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:22:37.666832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:37.666832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:37.666832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:37.666832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:37.666832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:37.666832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:37.668322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:37.668322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:37.668322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:22:37.668322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:22:37.668322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:22:37.668322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:22:37.668322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:22:37.668322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:22:37.668322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 12:22:37.668322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:22:37.668322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 623/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:22:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:37.673520 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb92b70-f781-4a44-bd19-80095dd7cc9b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:37.806486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb92b70-f781-4a44-bd19-80095dd7cc9b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:37.849857 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67359843-1291-45d5-a5dc-48f67feca2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:37.850779 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67359843-1291-45d5-a5dc-48f67feca2ca None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:37.851033 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67359843-1291-45d5-a5dc-48f67feca2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:37.851585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67359843-1291-45d5-a5dc-48f67feca2ca None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:37.852441 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67359843-1291-45d5-a5dc-48f67feca2ca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:37.852776 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67359843-1291-45d5-a5dc-48f67feca2ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:37.854538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67359843-1291-45d5-a5dc-48f67feca2ca None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:37.876693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 617/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Mon May 23 12:22:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:37.883219 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698ee8d-6474-467d-b17a-406185865356 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:38.014622 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698ee8d-6474-467d-b17a-406185865356 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:38.056346 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a8f32-856f-4166-a45f-28321acf141e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:38.057005 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a8f32-856f-4166-a45f-28321acf141e None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:38.057293 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a8f32-856f-4166-a45f-28321acf141e None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:38.057572 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a8f32-856f-4166-a45f-28321acf141e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:38.135478 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:38.144253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a8f32-856f-4166-a45f-28321acf141e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:38.145927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a8f32-856f-4166-a45f-28321acf141e None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:38.275581 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 624/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:22:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:22:38.281677 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67359843-1291-45d5-a5dc-48f67feca2ca None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:38.321711 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:38.415861 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67359843-1291-45d5-a5dc-48f67feca2ca None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:38.457603 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb104e42-748e-4c48-98a5-71e6a492abca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:38.458519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb104e42-748e-4c48-98a5-71e6a492abca None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:38.458857 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb104e42-748e-4c48-98a5-71e6a492abca None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:38.459138 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb104e42-748e-4c48-98a5-71e6a492abca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:38.470590 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb104e42-748e-4c48-98a5-71e6a492abca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:38.472304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb104e42-748e-4c48-98a5-71e6a492abca None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:38.494251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-fb104e42-748e-4c48-98a5-71e6a492abca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:38.494251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:38.494251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:38.494251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:38.494251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:38.494251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:38.494251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:38.494251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:38.494251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:38.494251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:38.494251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:38.494251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:38.494251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:22:38.494251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:22:38.494251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:22:38.496141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:22:38.496141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:38.496141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:38.496141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:38.496141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:38.496141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:38.496141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:38.496141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:38.496141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:22:38.496141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:38.496141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:38.496141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:38.496141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:38.496141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:38.496141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:38.496141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:38.496141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:38.497305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:22:38.497305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:22:38.497305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:38.497305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:22:38.497305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 618/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:22:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:38.502567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a8f32-856f-4166-a45f-28321acf141e None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:38.612789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:38.620489 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a8f32-856f-4166-a45f-28321acf141e None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:38.659016 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6efac6-d5d7-4095-96d0-1623fa01ee53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:38.659731 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6efac6-d5d7-4095-96d0-1623fa01ee53 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:38.660051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6efac6-d5d7-4095-96d0-1623fa01ee53 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:38.660336 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6efac6-d5d7-4095-96d0-1623fa01ee53 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:38.661105 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6efac6-d5d7-4095-96d0-1623fa01ee53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:38.661460 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6efac6-d5d7-4095-96d0-1623fa01ee53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:38.662935 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6efac6-d5d7-4095-96d0-1623fa01ee53 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:38.678197 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 625/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:38.685731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb104e42-748e-4c48-98a5-71e6a492abca None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:38.782290 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:38.808651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb104e42-748e-4c48-98a5-71e6a492abca None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:38.848898 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85921a72-3205-484c-926b-d2b406148d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:38.849712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85921a72-3205-484c-926b-d2b406148d8a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:38.849993 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85921a72-3205-484c-926b-d2b406148d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:38.850269 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85921a72-3205-484c-926b-d2b406148d8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:38.858056 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85921a72-3205-484c-926b-d2b406148d8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:38.859635 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85921a72-3205-484c-926b-d2b406148d8a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:38.873497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-85921a72-3205-484c-926b-d2b406148d8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:22:38.873497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:38.873497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:38.873497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:38.873497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:38.873497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:38.873497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:38.873497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:38.873497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:38.873497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:38.873497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:38.873497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:38.873497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:22:38.873497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:22:38.873497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:22:38.874588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:22:38.874588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:38.874588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:38.874588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:38.874588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:38.874588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:38.874588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:38.874588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:38.874588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:22:38.874588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:38.874588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:38.874588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:38.874588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:38.874588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:38.874588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:38.874588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:38.874588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:38.875494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:22:38.875494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:22:38.875494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:22:38.875494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:22:38.875494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:22:38.875494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:22:38.875494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:22:38.875494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:22:38.875494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 619/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:22:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:38.881805 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6efac6-d5d7-4095-96d0-1623fa01ee53 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:39.007361 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6efac6-d5d7-4095-96d0-1623fa01ee53 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:39.051127 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76435a-ed87-4460-9519-cdfc472b23e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:39.051805 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76435a-ed87-4460-9519-cdfc472b23e8 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:39.052091 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76435a-ed87-4460-9519-cdfc472b23e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:39.052368 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76435a-ed87-4460-9519-cdfc472b23e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:39.053158 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76435a-ed87-4460-9519-cdfc472b23e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:39.053468 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76435a-ed87-4460-9519-cdfc472b23e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:39.055217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76435a-ed87-4460-9519-cdfc472b23e8 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:39.068702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 626/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:22:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:39.075264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85921a72-3205-484c-926b-d2b406148d8a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:39.198976 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85921a72-3205-484c-926b-d2b406148d8a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:39.237199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805157d2-020b-4e2e-a6b2-acd0f3adf872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:39.237915 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805157d2-020b-4e2e-a6b2-acd0f3adf872 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:39.238230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805157d2-020b-4e2e-a6b2-acd0f3adf872 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:39.238518 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805157d2-020b-4e2e-a6b2-acd0f3adf872 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:39.239439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805157d2-020b-4e2e-a6b2-acd0f3adf872 None admin] RBAC: Adding query filter params (role.id=e344e91a09be4d10834ea5f942345beb, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=a3fde90ab1e0490ebb7cb514173d984e) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:39.239758 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805157d2-020b-4e2e-a6b2-acd0f3adf872 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:39.242612 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805157d2-020b-4e2e-a6b2-acd0f3adf872 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:39.249069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 620/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:22:39 2022] GET /identity/v3/role_assignments?user.id=a3fde90ab1e0490ebb7cb514173d984e&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=e344e91a09be4d10834ea5f942345beb => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:41.725687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc0a25-3291-4ed8-b214-25d91456bf87 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:41.726597 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc0a25-3291-4ed8-b214-25d91456bf87 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:41.726597 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc0a25-3291-4ed8-b214-25d91456bf87 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:41.728078 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 627/1247] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:22:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:22:41.739274 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b1cff-3529-4fca-84a9-4cf70414d310 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:41.739812 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b1cff-3529-4fca-84a9-4cf70414d310 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:41.739926 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b1cff-3529-4fca-84a9-4cf70414d310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:41.745773 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:41.764216 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1b5b1cff-3529-4fca-84a9-4cf70414d310 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:22:41.767099 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1b5b1cff-3529-4fca-84a9-4cf70414d310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:22:41.860028 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 621/1248] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:22:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:22:41.886148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc0a25-3291-4ed8-b214-25d91456bf87 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:41.910168 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:42.019194 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc0a25-3291-4ed8-b214-25d91456bf87 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:42.069078 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5943c1-5371-474d-b881-2fc36323020f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:42.069939 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5943c1-5371-474d-b881-2fc36323020f None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:42.070233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5943c1-5371-474d-b881-2fc36323020f None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:42.070537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5943c1-5371-474d-b881-2fc36323020f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:42.084846 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5943c1-5371-474d-b881-2fc36323020f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:22:42.094406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-2e5943c1-5371-474d-b881-2fc36323020f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:22:42.094406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:42.094406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:42.094406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:42.094406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:42.094406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:42.094406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:42.094406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:42.094406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:42.094406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:42.094406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:42.094406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:42.094406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:22:42.094406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:22:42.094406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:22:42.094406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:22:42.095612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:22:42.095612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:22:42.095612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:22:42.095612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:22:42.095612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:42.095612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:42.095612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:42.095612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:42.095612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:42.095612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:42.095612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:42.095612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:22:42.095612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:42.095612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:42.095612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:42.095612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:42.096550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:42.096550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:42.096550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:42.096550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:42.096550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:22:42.096550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:22:42.096550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:22:42.096550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:22:42.096550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:22:42.096550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:22:42.096550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:22:42.096550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:22:42.096550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 628/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:22:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:22:42.102242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b1cff-3529-4fca-84a9-4cf70414d310 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:42.226731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b1cff-3529-4fca-84a9-4cf70414d310 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:42.265447 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:42.274376 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c64393-5fa0-4342-add1-1b32ce17b9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:42.275407 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c64393-5fa0-4342-add1-1b32ce17b9aa None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:42.275940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c64393-5fa0-4342-add1-1b32ce17b9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:42.276384 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c64393-5fa0-4342-add1-1b32ce17b9aa None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:42.277647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c64393-5fa0-4342-add1-1b32ce17b9aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:42.278088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c64393-5fa0-4342-add1-1b32ce17b9aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:42.279785 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c64393-5fa0-4342-add1-1b32ce17b9aa None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:42.291361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 622/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:22:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:42.298055 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5943c1-5371-474d-b881-2fc36323020f None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:42.409446 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:42.442342 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5943c1-5371-474d-b881-2fc36323020f None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:42.486427 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc10a53-1485-49d2-ac94-bf9dc9b4216b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:42.487751 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc10a53-1485-49d2-ac94-bf9dc9b4216b None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:42.488241 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc10a53-1485-49d2-ac94-bf9dc9b4216b None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:42.488733 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc10a53-1485-49d2-ac94-bf9dc9b4216b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:42.504488 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc10a53-1485-49d2-ac94-bf9dc9b4216b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:42.506042 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc10a53-1485-49d2-ac94-bf9dc9b4216b None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:42.528886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-8fc10a53-1485-49d2-ac94-bf9dc9b4216b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:42.528886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:42.528886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:42.528886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:42.528886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:42.528886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:42.528886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:42.528886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:42.528886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:42.528886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:42.528886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:42.528886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:42.528886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:22:42.528886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:22:42.528886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:22:42.530041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:22:42.530041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:42.530041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:42.530041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:42.530041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:42.530041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:42.530041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:42.530041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:42.530041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:22:42.530041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:42.530041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:42.530041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:42.530041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:42.530041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:42.530041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:42.530041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:42.530041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:42.531122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:22:42.531122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:22:42.531122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:42.531122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:22:42.531122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 629/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:22:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:42.536348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c64393-5fa0-4342-add1-1b32ce17b9aa None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:42.651909 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c64393-5fa0-4342-add1-1b32ce17b9aa None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:42.699162 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db881f-2778-4b1c-b6e7-1f9b256a44a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:42.699833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db881f-2778-4b1c-b6e7-1f9b256a44a5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:42.700121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db881f-2778-4b1c-b6e7-1f9b256a44a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:42.700402 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db881f-2778-4b1c-b6e7-1f9b256a44a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:42.701132 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db881f-2778-4b1c-b6e7-1f9b256a44a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:42.701434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db881f-2778-4b1c-b6e7-1f9b256a44a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:42.702898 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db881f-2778-4b1c-b6e7-1f9b256a44a5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:42.717340 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 623/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:42.724013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc10a53-1485-49d2-ac94-bf9dc9b4216b None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:42.841117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc10a53-1485-49d2-ac94-bf9dc9b4216b None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:42.870107 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:42.879812 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de284a3b-149d-443b-8cce-6e78d928c00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:42.880643 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de284a3b-149d-443b-8cce-6e78d928c00c None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:42.881035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de284a3b-149d-443b-8cce-6e78d928c00c None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:42.881385 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de284a3b-149d-443b-8cce-6e78d928c00c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:42.889996 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de284a3b-149d-443b-8cce-6e78d928c00c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:42.891566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de284a3b-149d-443b-8cce-6e78d928c00c None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:42.906687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-de284a3b-149d-443b-8cce-6e78d928c00c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 12:22:42.906687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:42.906687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:42.906687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:42.906687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:42.906687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:42.906687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:42.906687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:42.906687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:42.906687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:42.906687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:42.906687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:42.906687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:22:42.906687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:22:42.906687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:22:42.906687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:22:42.907826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:42.907826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:42.907826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:22:42.907826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:22:42.907826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:22:42.907826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:22:42.907826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:42.907826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:42.907826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:42.907826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:42.907826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:42.907826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:22:42.907826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:42.907826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:42.907826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:42.907826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:42.907826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:42.907826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:42.908814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:42.908814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:42.908814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:22:42.908814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:22:42.908814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:22:42.908814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:22:42.908814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:22:42.908814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:22:42.908814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 12:22:42.908814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:22:42.908814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 630/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:22:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:42.913900 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db881f-2778-4b1c-b6e7-1f9b256a44a5 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:42.983445 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:43.041222 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db881f-2778-4b1c-b6e7-1f9b256a44a5 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:43.095634 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597028e-d237-47c7-92b7-a4b58ec41bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:43.097068 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597028e-d237-47c7-92b7-a4b58ec41bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:43.097810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597028e-d237-47c7-92b7-a4b58ec41bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:43.098347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597028e-d237-47c7-92b7-a4b58ec41bb6 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:43.099295 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597028e-d237-47c7-92b7-a4b58ec41bb6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:43.099623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597028e-d237-47c7-92b7-a4b58ec41bb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:43.101888 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597028e-d237-47c7-92b7-a4b58ec41bb6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:43.125229 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 624/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Mon May 23 12:22:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:22:43.132145 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de284a3b-149d-443b-8cce-6e78d928c00c None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:43.262310 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de284a3b-149d-443b-8cce-6e78d928c00c None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:43.302832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809b7ac-d7c3-48e8-a325-ae028ec67041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:43.303800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809b7ac-d7c3-48e8-a325-ae028ec67041 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:43.304128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809b7ac-d7c3-48e8-a325-ae028ec67041 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:43.304444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809b7ac-d7c3-48e8-a325-ae028ec67041 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:43.370626 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:43.385705 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809b7ac-d7c3-48e8-a325-ae028ec67041 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:43.387273 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809b7ac-d7c3-48e8-a325-ae028ec67041 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:43.496659 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 631/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:22:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:22:43.503264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597028e-d237-47c7-92b7-a4b58ec41bb6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:43.618966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597028e-d237-47c7-92b7-a4b58ec41bb6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:43.633581 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:43.660068 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ed253-053b-4e1d-8915-cd01683d614e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:43.661184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ed253-053b-4e1d-8915-cd01683d614e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:43.661476 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ed253-053b-4e1d-8915-cd01683d614e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:43.661758 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ed253-053b-4e1d-8915-cd01683d614e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:43.675177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ed253-053b-4e1d-8915-cd01683d614e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:43.677199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ed253-053b-4e1d-8915-cd01683d614e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:43.699642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-943ed253-053b-4e1d-8915-cd01683d614e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:43.699642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:43.699642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:43.699642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:43.699642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:43.699642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:43.699642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:43.699642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:43.699642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:43.699642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:43.699642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:43.699642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:43.699642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:22:43.699642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:22:43.699642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:22:43.701670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:22:43.701670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:43.701670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:43.701670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:43.701670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:43.701670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:43.701670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:43.701670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:43.701670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:22:43.701670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:43.701670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:43.701670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:43.701670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:43.701670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:43.701670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:43.701670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:43.701670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:43.703759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:22:43.703759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:22:43.703759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:43.703759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:22:43.703759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 625/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:22:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:43.708051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809b7ac-d7c3-48e8-a325-ae028ec67041 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:43.808455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:43.822331 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809b7ac-d7c3-48e8-a325-ae028ec67041 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:43.862957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ad7a6-dd8f-41d4-8aa5-8755979664e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:43.863671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ad7a6-dd8f-41d4-8aa5-8755979664e7 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:43.863947 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ad7a6-dd8f-41d4-8aa5-8755979664e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:43.864261 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ad7a6-dd8f-41d4-8aa5-8755979664e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:43.865079 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ad7a6-dd8f-41d4-8aa5-8755979664e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:43.865393 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ad7a6-dd8f-41d4-8aa5-8755979664e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:43.867089 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ad7a6-dd8f-41d4-8aa5-8755979664e7 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:43.884667 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 632/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:43.885971 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ed253-053b-4e1d-8915-cd01683d614e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:44.002462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ed253-053b-4e1d-8915-cd01683d614e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:44.043948 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b00b5-cc08-4724-866f-50e78290b7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:44.045007 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b00b5-cc08-4724-866f-50e78290b7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:44.045343 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b00b5-cc08-4724-866f-50e78290b7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:44.045693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b00b5-cc08-4724-866f-50e78290b7c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:44.053699 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b00b5-cc08-4724-866f-50e78290b7c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:44.055323 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b00b5-cc08-4724-866f-50e78290b7c3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:44.072491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-489b00b5-cc08-4724-866f-50e78290b7c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:22:44.072491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:44.072491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:44.072491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:44.072491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:44.072491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:44.072491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:44.072491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:44.072491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:44.072491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:44.072491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:44.072491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:44.072491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:22:44.072491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:22:44.072491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:22:44.073684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:22:44.073684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:44.073684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:44.073684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:44.073684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:44.073684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:44.073684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:44.073684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:44.073684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:22:44.073684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:44.073684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:44.073684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:44.073684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:44.073684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:44.073684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:44.073684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:44.073684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:44.074840 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:22:44.074840 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:22:44.074840 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:22:44.074840 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:22:44.074840 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:22:44.074840 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:22:44.074840 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:22:44.074840 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:22:44.074840 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 626/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:22:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:44.081325 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ad7a6-dd8f-41d4-8aa5-8755979664e7 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:44.206933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ad7a6-dd8f-41d4-8aa5-8755979664e7 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:44.258149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5dd7d-8b4e-44de-a1cd-1f8753412c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:44.259340 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5dd7d-8b4e-44de-a1cd-1f8753412c66 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:44.259879 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5dd7d-8b4e-44de-a1cd-1f8753412c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:44.260375 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5dd7d-8b4e-44de-a1cd-1f8753412c66 None admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:44.261889 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5dd7d-8b4e-44de-a1cd-1f8753412c66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:44.262444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5dd7d-8b4e-44de-a1cd-1f8753412c66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:44.265831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5dd7d-8b4e-44de-a1cd-1f8753412c66 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:44.289247 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 633/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:22:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:22:44.296737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b00b5-cc08-4724-866f-50e78290b7c3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:44.324693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:44.406643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b00b5-cc08-4724-866f-50e78290b7c3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:44.444785 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9e7e3-580d-4f38-9a23-07d6e076c0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:44.445380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9e7e3-580d-4f38-9a23-07d6e076c0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:44.445668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9e7e3-580d-4f38-9a23-07d6e076c0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:44.445949 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9e7e3-580d-4f38-9a23-07d6e076c0b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:44.446835 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9e7e3-580d-4f38-9a23-07d6e076c0b4 None admin] RBAC: Adding query filter params (role.id=3ae7c5e54e084ac4a1f94da93a667583, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=a3fde90ab1e0490ebb7cb514173d984e) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:44.447151 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9e7e3-580d-4f38-9a23-07d6e076c0b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:44.448624 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9e7e3-580d-4f38-9a23-07d6e076c0b4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:44.466532 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 627/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:22:44 2022] GET /identity/v3/role_assignments?user.id=a3fde90ab1e0490ebb7cb514173d984e&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=3ae7c5e54e084ac4a1f94da93a667583 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:46.674840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d9932-6567-4bef-9e65-e8c59c7e53f1 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:46.675413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d9932-6567-4bef-9e65-e8c59c7e53f1 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:46.675413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d9932-6567-4bef-9e65-e8c59c7e53f1 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:46.676776 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 634/1261] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:22:46.682332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ca992-39cd-4eb7-a91e-88c04fa1fa51 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:46.682759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ca992-39cd-4eb7-a91e-88c04fa1fa51 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:46.682983 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ca992-39cd-4eb7-a91e-88c04fa1fa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:46.703590 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c04ca992-39cd-4eb7-a91e-88c04fa1fa51 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:22:46.704991 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c04ca992-39cd-4eb7-a91e-88c04fa1fa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:22:46.787509 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 628/1262] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:22:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:22:46.814136 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d9932-6567-4bef-9e65-e8c59c7e53f1 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:46.825008 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:46.916266 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d9932-6567-4bef-9e65-e8c59c7e53f1 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:46.949836 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb867e1-f263-4584-8456-fb08d7463d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:46.950575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb867e1-f263-4584-8456-fb08d7463d79 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:46.950866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb867e1-f263-4584-8456-fb08d7463d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:46.951147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb867e1-f263-4584-8456-fb08d7463d79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:46.961669 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb867e1-f263-4584-8456-fb08d7463d79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:22:46.969692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-0bb867e1-f263-4584-8456-fb08d7463d79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:22:46.969692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:46.969692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:46.969692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:46.969692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:46.969692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:46.969692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:46.969692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:46.969692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:46.969692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:46.969692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:46.969692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:46.969692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:22:46.969692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:22:46.969692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:22:46.969692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:22:46.970800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:22:46.970800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:22:46.970800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:22:46.970800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:22:46.970800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:46.970800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:46.970800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:46.970800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:46.970800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:46.970800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:46.970800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:46.970800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:22:46.970800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:46.970800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:46.970800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:46.970800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:46.972067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:46.972067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:46.972067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:46.972067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:46.972067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:22:46.972067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:22:46.972067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:22:46.972067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:22:46.972067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:22:46.972067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:22:46.972067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:22:46.972067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:22:46.972067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 635/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:22:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 12:22:46.977210 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ca992-39cd-4eb7-a91e-88c04fa1fa51 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:46.995167 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:47.074582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ca992-39cd-4eb7-a91e-88c04fa1fa51 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:47.108134 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07ba22-601c-49e3-9d8b-decf01d3b086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:47.109347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07ba22-601c-49e3-9d8b-decf01d3b086 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:47.109689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07ba22-601c-49e3-9d8b-decf01d3b086 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:47.109826 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07ba22-601c-49e3-9d8b-decf01d3b086 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:47.111127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07ba22-601c-49e3-9d8b-decf01d3b086 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:47.111694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07ba22-601c-49e3-9d8b-decf01d3b086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:47.113316 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07ba22-601c-49e3-9d8b-decf01d3b086 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:47.122823 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 629/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:22:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:47.128581 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb867e1-f263-4584-8456-fb08d7463d79 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:47.193807 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:47.227246 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb867e1-f263-4584-8456-fb08d7463d79 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:47.259552 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d6f5c-0148-4ff8-80b4-977a480dc5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:47.260322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d6f5c-0148-4ff8-80b4-977a480dc5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:47.260605 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d6f5c-0148-4ff8-80b4-977a480dc5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:47.260880 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d6f5c-0148-4ff8-80b4-977a480dc5e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:47.271806 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d6f5c-0148-4ff8-80b4-977a480dc5e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:47.273255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d6f5c-0148-4ff8-80b4-977a480dc5e0 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:47.289742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-a44d6f5c-0148-4ff8-80b4-977a480dc5e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:47.289742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:47.289742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:47.289742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:47.289742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:47.289742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:47.289742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:47.289742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:47.289742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:47.289742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:47.289742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:47.289742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:47.289742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:22:47.289742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:22:47.289742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:22:47.290824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:22:47.290824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:47.290824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:47.290824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:47.290824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:47.290824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:47.290824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:47.290824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:47.290824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:22:47.290824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:47.290824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:47.290824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:47.290824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:47.290824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:47.290824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:47.290824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:47.290824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:47.291952 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:22:47.291952 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:22:47.291952 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:47.291952 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:22:47.291952 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 636/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:47.296765 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07ba22-601c-49e3-9d8b-decf01d3b086 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:47.376563 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:47.395934 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07ba22-601c-49e3-9d8b-decf01d3b086 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:47.427547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a17cae-15b8-4316-949b-e400443a9154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:47.428201 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a17cae-15b8-4316-949b-e400443a9154 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:47.428484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a17cae-15b8-4316-949b-e400443a9154 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:47.428761 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a17cae-15b8-4316-949b-e400443a9154 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:47.429475 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a17cae-15b8-4316-949b-e400443a9154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:47.429779 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a17cae-15b8-4316-949b-e400443a9154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:47.431181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a17cae-15b8-4316-949b-e400443a9154 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:47.444313 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 630/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:47.451069 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d6f5c-0148-4ff8-80b4-977a480dc5e0 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:47.548467 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d6f5c-0148-4ff8-80b4-977a480dc5e0 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:47.567792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:47.581977 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3f4f4-2544-4093-baf7-6128cb984372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:47.582793 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3f4f4-2544-4093-baf7-6128cb984372 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:47.583078 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3f4f4-2544-4093-baf7-6128cb984372 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:47.583354 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3f4f4-2544-4093-baf7-6128cb984372 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:47.590546 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3f4f4-2544-4093-baf7-6128cb984372 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:47.591989 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3f4f4-2544-4093-baf7-6128cb984372 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:47.606815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-0ae3f4f4-2544-4093-baf7-6128cb984372 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 12:22:47.606815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:47.606815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:47.606815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:47.606815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:47.606815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:47.606815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:47.606815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:47.606815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:47.606815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:47.606815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:47.606815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:47.606815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:22:47.606815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:22:47.606815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:22:47.606815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:22:47.607926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:47.607926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:47.607926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:22:47.607926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:22:47.607926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:22:47.607926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:22:47.607926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:47.607926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:47.607926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:47.607926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:47.607926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:47.607926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:22:47.607926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:47.607926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:47.607926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:47.607926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:47.607926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:47.607926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:47.609501 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:47.609501 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:47.609501 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:22:47.609501 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:22:47.609501 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:22:47.609501 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:22:47.609501 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:22:47.609501 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:22:47.609501 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 12:22:47.609501 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:22:47.609501 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 637/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:22:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:47.614370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a17cae-15b8-4316-949b-e400443a9154 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:47.713955 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a17cae-15b8-4316-949b-e400443a9154 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:47.751001 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2595d-da65-4e1e-8ab0-0365418d896e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:47.751663 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2595d-da65-4e1e-8ab0-0365418d896e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:47.751947 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2595d-da65-4e1e-8ab0-0365418d896e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:47.752222 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2595d-da65-4e1e-8ab0-0365418d896e None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:47.753049 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2595d-da65-4e1e-8ab0-0365418d896e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:47.753354 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2595d-da65-4e1e-8ab0-0365418d896e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:47.754815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2595d-da65-4e1e-8ab0-0365418d896e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:47.763319 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:47.772851 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 631/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Mon May 23 12:22:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:47.778476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3f4f4-2544-4093-baf7-6128cb984372 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:47.877641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3f4f4-2544-4093-baf7-6128cb984372 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:47.909991 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a874d-a824-41e8-bdb9-0f81ff9b8e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:47.910796 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a874d-a824-41e8-bdb9-0f81ff9b8e47 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:47.911080 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a874d-a824-41e8-bdb9-0f81ff9b8e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:47.911359 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a874d-a824-41e8-bdb9-0f81ff9b8e47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:47.922000 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a874d-a824-41e8-bdb9-0f81ff9b8e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:47.923444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a874d-a824-41e8-bdb9-0f81ff9b8e47 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:47.940317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-1a5a874d-a824-41e8-bdb9-0f81ff9b8e47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:47.940317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:47.940317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:47.940317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:47.940317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:47.940317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:47.940317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:47.940317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:47.940317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:47.940317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:47.940317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:47.940317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:47.940317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:22:47.940317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:22:47.940317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:22:47.941387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:22:47.941387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:47.941387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:47.941387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:47.941387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:47.941387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:47.941387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:47.941387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:47.941387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:22:47.941387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:47.941387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:47.941387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:47.941387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:47.941387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:47.941387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:47.941387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:47.941387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:47.942437 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:22:47.942437 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:22:47.942437 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:47.942437 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:22:47.942437 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 638/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:47.947179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2595d-da65-4e1e-8ab0-0365418d896e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:48.044088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2595d-da65-4e1e-8ab0-0365418d896e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:48.076504 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be432f-4130-4bbb-b442-3938b46d1193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:48.077177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be432f-4130-4bbb-b442-3938b46d1193 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:48.077459 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be432f-4130-4bbb-b442-3938b46d1193 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:48.077734 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be432f-4130-4bbb-b442-3938b46d1193 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:48.078439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be432f-4130-4bbb-b442-3938b46d1193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:48.078770 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be432f-4130-4bbb-b442-3938b46d1193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:48.080141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be432f-4130-4bbb-b442-3938b46d1193 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:48.090918 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 632/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:48.097041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a874d-a824-41e8-bdb9-0f81ff9b8e47 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:48.128783 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:48.198813 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a874d-a824-41e8-bdb9-0f81ff9b8e47 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:48.235123 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f9b83-97dd-436a-8244-666bd16ddda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:48.235917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f9b83-97dd-436a-8244-666bd16ddda0 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:48.236233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f9b83-97dd-436a-8244-666bd16ddda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:48.236511 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f9b83-97dd-436a-8244-666bd16ddda0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:48.243198 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f9b83-97dd-436a-8244-666bd16ddda0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:48.244653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f9b83-97dd-436a-8244-666bd16ddda0 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:48.259122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-527f9b83-97dd-436a-8244-666bd16ddda0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:22:48.259122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:48.259122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:48.259122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:48.259122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:48.259122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:48.259122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:48.259122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:48.259122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:48.259122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:48.259122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:48.259122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:48.259122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:22:48.259122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:22:48.259122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:22:48.260249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:22:48.260249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:48.260249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:48.260249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:48.260249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:48.260249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:48.260249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:48.260249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:48.260249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:22:48.260249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:48.260249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:48.260249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:48.260249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:48.260249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:48.260249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:48.260249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:48.260249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:48.261434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:22:48.261434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:22:48.261434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:22:48.261434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:22:48.261434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:22:48.261434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:22:48.261434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:22:48.261434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:22:48.261434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 639/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:22:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:48.266343 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be432f-4130-4bbb-b442-3938b46d1193 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:48.324843 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:48.368524 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be432f-4130-4bbb-b442-3938b46d1193 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:48.401781 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237b86a-ed6a-43b2-847a-6ed19643653f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:48.402352 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237b86a-ed6a-43b2-847a-6ed19643653f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:48.402668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237b86a-ed6a-43b2-847a-6ed19643653f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:48.402947 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237b86a-ed6a-43b2-847a-6ed19643653f None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:48.403734 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237b86a-ed6a-43b2-847a-6ed19643653f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:48.404043 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237b86a-ed6a-43b2-847a-6ed19643653f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:48.406040 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237b86a-ed6a-43b2-847a-6ed19643653f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:48.419115 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 633/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:22:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:48.425636 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f9b83-97dd-436a-8244-666bd16ddda0 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:48.515222 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:48.523958 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f9b83-97dd-436a-8244-666bd16ddda0 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:48.557717 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a795489-149b-4d4d-9616-bdefa6711756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:48.558702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a795489-149b-4d4d-9616-bdefa6711756 None admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:48.558992 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a795489-149b-4d4d-9616-bdefa6711756 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:48.559272 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a795489-149b-4d4d-9616-bdefa6711756 None admin] PATH_INFO: `/v3/projects/402397b981be4f0c9e778a2771c41937/users/a3fde90ab1e0490ebb7cb514173d984e/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:48.561194 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a795489-149b-4d4d-9616-bdefa6711756 None admin] RBAC: Authorizing `identity:create_grant(project_id=402397b981be4f0c9e778a2771c41937, user_id=a3fde90ab1e0490ebb7cb514173d984e, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:48.562793 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a795489-149b-4d4d-9616-bdefa6711756 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:48.575928 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 640/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Mon May 23 12:22:48 2022] PUT /identity/v3/projects/402397b981be4f0c9e778a2771c41937/users/a3fde90ab1e0490ebb7cb514173d984e/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:22:50.794971 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05c411-cbc3-4e1c-8d5c-90e4e35a582d None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:50.795551 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05c411-cbc3-4e1c-8d5c-90e4e35a582d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:50.795551 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05c411-cbc3-4e1c-8d5c-90e4e35a582d None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:50.797392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 634/1274] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:22:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:22:50.802826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bbff4-a1a8-462d-bc28-0f4b7e0da842 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:50.803272 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bbff4-a1a8-462d-bc28-0f4b7e0da842 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:50.803363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bbff4-a1a8-462d-bc28-0f4b7e0da842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:50.820666 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-f15bbff4-a1a8-462d-bc28-0f4b7e0da842 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:22:50.821861 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-f15bbff4-a1a8-462d-bc28-0f4b7e0da842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:22:50.889018 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 641/1275] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:22:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:22:50.911523 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05c411-cbc3-4e1c-8d5c-90e4e35a582d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:51.015128 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05c411-cbc3-4e1c-8d5c-90e4e35a582d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:51.032882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:51.050743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d94a8-f078-4aea-a5df-f65574b259a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:51.051470 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d94a8-f078-4aea-a5df-f65574b259a1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:51.051754 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d94a8-f078-4aea-a5df-f65574b259a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:51.052032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d94a8-f078-4aea-a5df-f65574b259a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:51.062201 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d94a8-f078-4aea-a5df-f65574b259a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 12:22:51.069789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-148d94a8-f078-4aea-a5df-f65574b259a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:22:51.069789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:51.069789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:51.069789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:51.069789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:51.069789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:51.069789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:51.069789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:51.069789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:51.069789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:51.069789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:51.069789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:51.069789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 12:22:51.069789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 12:22:51.069789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 12:22:51.069789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 12:22:51.070973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 12:22:51.070973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 12:22:51.070973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 12:22:51.070973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 12:22:51.070973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:51.070973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:51.070973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:51.070973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:51.070973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:51.070973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:51.070973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:51.070973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:22:51.070973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:51.070973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:51.070973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:51.070973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:51.071837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:51.071837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:51.071837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:51.071837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:51.071837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 12:22:51.071837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 12:22:51.071837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 12:22:51.071837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 12:22:51.071837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 12:22:51.071837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 12:22:51.071837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 12:22:51.071837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:22:51.071837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 635/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Mon May 23 12:22:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:51.077040 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15bbff4-a1a8-462d-bc28-0f4b7e0da842 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:51.158352 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:51.178376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15bbff4-a1a8-462d-bc28-0f4b7e0da842 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:51.211773 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bce32f-df6f-4b51-8d31-c5c837ed20d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:51.212436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bce32f-df6f-4b51-8d31-c5c837ed20d6 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:51.212718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bce32f-df6f-4b51-8d31-c5c837ed20d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:51.212991 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bce32f-df6f-4b51-8d31-c5c837ed20d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:51.213723 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bce32f-df6f-4b51-8d31-c5c837ed20d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:51.214027 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bce32f-df6f-4b51-8d31-c5c837ed20d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:51.215442 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bce32f-df6f-4b51-8d31-c5c837ed20d6 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:51.224690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 642/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Mon May 23 12:22:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:51.230696 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d94a8-f078-4aea-a5df-f65574b259a1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:51.335082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d94a8-f078-4aea-a5df-f65574b259a1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:51.378851 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dafe8-e78f-49a2-ac55-4b15c7475755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:51.379645 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dafe8-e78f-49a2-ac55-4b15c7475755 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:51.379932 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dafe8-e78f-49a2-ac55-4b15c7475755 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:51.380209 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dafe8-e78f-49a2-ac55-4b15c7475755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:51.392054 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dafe8-e78f-49a2-ac55-4b15c7475755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:51.393703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dafe8-e78f-49a2-ac55-4b15c7475755 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:51.412534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-7f6dafe8-e78f-49a2-ac55-4b15c7475755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:51.412534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:51.412534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:51.412534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:51.412534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:51.412534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:51.412534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:51.412534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:51.412534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:51.412534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:51.412534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:51.412534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:51.412534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:22:51.412534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:22:51.412534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:22:51.413654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:22:51.413654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:51.413654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:51.413654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:51.413654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:51.413654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:51.413654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:51.413654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:51.413654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:22:51.413654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:51.413654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:51.413654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:51.413654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:51.413654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:51.413654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:51.413654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:51.413654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:51.414605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:22:51.414605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:22:51.414605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:51.414605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:22:51.414605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 636/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:22:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:51.419532 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bce32f-df6f-4b51-8d31-c5c837ed20d6 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:51.521196 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bce32f-df6f-4b51-8d31-c5c837ed20d6 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:51.558471 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5fefd-09fa-48e0-9b68-3a2cfe10db23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:51.559165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5fefd-09fa-48e0-9b68-3a2cfe10db23 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:51.559449 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5fefd-09fa-48e0-9b68-3a2cfe10db23 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:51.559725 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5fefd-09fa-48e0-9b68-3a2cfe10db23 None admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:51.560450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5fefd-09fa-48e0-9b68-3a2cfe10db23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:51.560756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5fefd-09fa-48e0-9b68-3a2cfe10db23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:51.562216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5fefd-09fa-48e0-9b68-3a2cfe10db23 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:51.575001 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 643/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:51.583259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dafe8-e78f-49a2-ac55-4b15c7475755 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:51.616962 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:51.689878 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dafe8-e78f-49a2-ac55-4b15c7475755 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:51.732656 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6560077-440b-4bf8-a9d9-924437504c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:51.734353 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6560077-440b-4bf8-a9d9-924437504c44 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:51.734738 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6560077-440b-4bf8-a9d9-924437504c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:51.735149 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6560077-440b-4bf8-a9d9-924437504c44 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:51.746163 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6560077-440b-4bf8-a9d9-924437504c44 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:51.748126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6560077-440b-4bf8-a9d9-924437504c44 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:51.765437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-c6560077-440b-4bf8-a9d9-924437504c44 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 12:22:51.765437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:51.765437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:51.765437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:51.765437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:51.765437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:51.765437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:51.765437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:51.765437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:51.765437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:51.765437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:51.765437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:51.765437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 12:22:51.765437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 12:22:51.765437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 12:22:51.765437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 12:22:51.767577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:51.767577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:51.767577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 12:22:51.767577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:22:51.767577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 12:22:51.767577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 12:22:51.767577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:51.767577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:51.767577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:51.767577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:51.767577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:51.767577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:22:51.767577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:51.767577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:51.767577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:51.767577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:51.767577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:51.767577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:51.768804 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:51.768804 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:51.768804 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 12:22:51.768804 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 12:22:51.768804 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 12:22:51.768804 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 12:22:51.768804 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 12:22:51.768804 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 12:22:51.768804 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 12:22:51.768804 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:22:51.768804 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 637/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:22:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:51.773317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5fefd-09fa-48e0-9b68-3a2cfe10db23 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:51.777541 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:51.885605 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5fefd-09fa-48e0-9b68-3a2cfe10db23 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:51.920036 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a74eb2-42a0-42c8-8db5-977c41f11bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:51.920731 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a74eb2-42a0-42c8-8db5-977c41f11bed None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:51.921019 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a74eb2-42a0-42c8-8db5-977c41f11bed None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:51.921293 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a74eb2-42a0-42c8-8db5-977c41f11bed None admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:51.922122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a74eb2-42a0-42c8-8db5-977c41f11bed None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:51.922426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a74eb2-42a0-42c8-8db5-977c41f11bed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:51.923882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a74eb2-42a0-42c8-8db5-977c41f11bed None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:51.941664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 644/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Mon May 23 12:22:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:51.947541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6560077-440b-4bf8-a9d9-924437504c44 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:52.042152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:52.053261 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6560077-440b-4bf8-a9d9-924437504c44 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:52.086641 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a56e4-fe5a-47f2-9b59-0c4fbd5311c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:52.087293 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a56e4-fe5a-47f2-9b59-0c4fbd5311c7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:52.087580 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a56e4-fe5a-47f2-9b59-0c4fbd5311c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:52.087859 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a56e4-fe5a-47f2-9b59-0c4fbd5311c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:52.168073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a56e4-fe5a-47f2-9b59-0c4fbd5311c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:52.169545 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a56e4-fe5a-47f2-9b59-0c4fbd5311c7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:52.267651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:52.278650 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 638/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Mon May 23 12:22:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 12:22:52.284985 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a74eb2-42a0-42c8-8db5-977c41f11bed None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:52.345129 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:52.382840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a74eb2-42a0-42c8-8db5-977c41f11bed None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:52.416702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d6c07-a98f-4665-a842-28251cf5431a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:52.417488 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d6c07-a98f-4665-a842-28251cf5431a None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:52.417771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d6c07-a98f-4665-a842-28251cf5431a None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:52.418052 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d6c07-a98f-4665-a842-28251cf5431a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:52.428220 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d6c07-a98f-4665-a842-28251cf5431a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:52.429615 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d6c07-a98f-4665-a842-28251cf5431a None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:52.447418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-eb9d6c07-a98f-4665-a842-28251cf5431a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:52.447418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:52.447418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:52.447418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:52.447418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:52.447418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:52.447418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:52.447418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:52.447418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:52.447418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:52.447418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:52.447418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:52.447418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 12:22:52.447418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 12:22:52.447418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 12:22:52.448544 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 12:22:52.448544 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:52.448544 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:52.448544 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:52.448544 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:52.448544 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:52.448544 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:52.448544 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:52.448544 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:22:52.448544 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:52.448544 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:52.448544 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:52.448544 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:52.448544 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:52.448544 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:52.448544 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:52.448544 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:52.449904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 12:22:52.449904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 12:22:52.449904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 12:22:52.449904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:22:52.449904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 645/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:22:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:52.455055 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a56e4-fe5a-47f2-9b59-0c4fbd5311c7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:52.570217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a56e4-fe5a-47f2-9b59-0c4fbd5311c7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:52.604410 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b9a5f-3ea4-4e44-9fbb-8a59268be1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:52.605073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b9a5f-3ea4-4e44-9fbb-8a59268be1bb None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:52.605355 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b9a5f-3ea4-4e44-9fbb-8a59268be1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:52.605632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b9a5f-3ea4-4e44-9fbb-8a59268be1bb None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:52.606354 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b9a5f-3ea4-4e44-9fbb-8a59268be1bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:52.606681 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b9a5f-3ea4-4e44-9fbb-8a59268be1bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:52.608238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b9a5f-3ea4-4e44-9fbb-8a59268be1bb None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:52.619983 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 639/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Mon May 23 12:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:52.626293 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d6c07-a98f-4665-a842-28251cf5431a None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:52.729843 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d6c07-a98f-4665-a842-28251cf5431a None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:52.747427 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:52.768456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05e8f7-a556-4318-bd1a-f87e77f65772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:52.769252 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05e8f7-a556-4318-bd1a-f87e77f65772 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:52.769538 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05e8f7-a556-4318-bd1a-f87e77f65772 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:52.769816 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05e8f7-a556-4318-bd1a-f87e77f65772 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:52.776854 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05e8f7-a556-4318-bd1a-f87e77f65772 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:52.778315 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05e8f7-a556-4318-bd1a-f87e77f65772 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:52.792187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application [None req-cc05e8f7-a556-4318-bd1a-f87e77f65772 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:22:52.792187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:52.792187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:52.792187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:52.792187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:52.792187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:52.792187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:52.792187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:52.792187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:52.792187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:52.792187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:52.792187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:52.792187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 12:22:52.792187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 12:22:52.792187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 12:22:52.793314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 12:22:52.793314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:52.793314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:52.793314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:52.793314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:52.793314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:52.793314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:52.793314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:52.793314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application with Lock( May 23 12:22:52.793314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:52.793314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:52.793314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:52.793314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:52.793314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:52.793314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:52.793314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:52.793314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:52.794426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 12:22:52.794426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 12:22:52.794426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 12:22:52.794426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 12:22:52.794426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 12:22:52.794426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 12:22:52.794426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 12:22:52.794426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: ERROR keystone.server.flask.application May 23 12:22:52.794426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 646/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Mon May 23 12:22:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:52.799946 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b9a5f-3ea4-4e44-9fbb-8a59268be1bb None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:52.849543 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:52.901156 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b9a5f-3ea4-4e44-9fbb-8a59268be1bb None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:52.934596 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4239ca-9800-4139-a21c-9caa9e6967c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:52.935255 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4239ca-9800-4139-a21c-9caa9e6967c0 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:52.935543 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4239ca-9800-4139-a21c-9caa9e6967c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:52.935823 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4239ca-9800-4139-a21c-9caa9e6967c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:52.937167 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4239ca-9800-4139-a21c-9caa9e6967c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:52.937476 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4239ca-9800-4139-a21c-9caa9e6967c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:52.938962 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4239ca-9800-4139-a21c-9caa9e6967c0 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:52.950982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 640/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Mon May 23 12:22:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:52.957033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05e8f7-a556-4318-bd1a-f87e77f65772 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:53.055141 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05e8f7-a556-4318-bd1a-f87e77f65772 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:53.088155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25de83-8323-4db5-a487-b5e28be9c522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:53.088831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25de83-8323-4db5-a487-b5e28be9c522 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:53.089115 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25de83-8323-4db5-a487-b5e28be9c522 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:53.089391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25de83-8323-4db5-a487-b5e28be9c522 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:53.090210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25de83-8323-4db5-a487-b5e28be9c522 None admin] RBAC: Adding query filter params (role.id=3ae7c5e54e084ac4a1f94da93a667583, scope.project.id=402397b981be4f0c9e778a2771c41937, user.id=a3fde90ab1e0490ebb7cb514173d984e) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:53.090543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25de83-8323-4db5-a487-b5e28be9c522 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:53.091986 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25de83-8323-4db5-a487-b5e28be9c522 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:53.098296 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 647/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Mon May 23 12:22:52 2022] GET /identity/v3/role_assignments?user.id=a3fde90ab1e0490ebb7cb514173d984e&scope.project.id=402397b981be4f0c9e778a2771c41937&role.id=3ae7c5e54e084ac4a1f94da93a667583 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:55.308136 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ff5ca-6213-4b31-bce8-35de002551a7 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:55.308690 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ff5ca-6213-4b31-bce8-35de002551a7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:55.308690 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ff5ca-6213-4b31-bce8-35de002551a7 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:55.310058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 641/1288] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:22:55.315135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76b12e-f574-4bd3-b831-f755b96ad7a1 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:55.315559 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76b12e-f574-4bd3-b831-f755b96ad7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:55.315707 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76b12e-f574-4bd3-b831-f755b96ad7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:55.332750 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-eb76b12e-f574-4bd3-b831-f755b96ad7a1 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:22:55.333942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-eb76b12e-f574-4bd3-b831-f755b96ad7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:22:55.363436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:55.401182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 648/1289] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:22:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:22:55.423847 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ff5ca-6213-4b31-bce8-35de002551a7 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:55.546037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ff5ca-6213-4b31-bce8-35de002551a7 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:55.557770 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:55.595335 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f15cb-f5dc-4b19-b37a-fca79479fe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:55.596709 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f15cb-f5dc-4b19-b37a-fca79479fe65 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:55.597195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f15cb-f5dc-4b19-b37a-fca79479fe65 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:55.597689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f15cb-f5dc-4b19-b37a-fca79479fe65 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:55.598938 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f15cb-f5dc-4b19-b37a-fca79479fe65 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:55.601066 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f15cb-f5dc-4b19-b37a-fca79479fe65 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:55.613363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-3c9f15cb-f5dc-4b19-b37a-fca79479fe65 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 12:22:55.613363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:55.613363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:22:55.613363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:22:55.613363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:22:55.613363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:22:55.613363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:22:55.613363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:22:55.613363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 12:22:55.613363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:22:55.613363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:22:55.613363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:22:55.613363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:22:55.613363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:22:55.613363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:22:55.613363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:22:55.613363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:22:55.614668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:22:55.614668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:22:55.614668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:22:55.614668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:22:55.614668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:22:55.614668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:22:55.614668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:22:55.614668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:22:55.614668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:22:55.614668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:22:55.614668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:22:55.614668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:22:55.614668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:22:55.614668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:22:55.614668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:22:55.614668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:22:55.615547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:22:55.615547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:22:55.615547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:22:55.615547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:22:55.615547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:22:55.615547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:22:55.615547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:22:55.615547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:22:55.615547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:22:55.615547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:22:55.615547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:22:55.615547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:22:55.615547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 12:22:55.615547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:22:55.615547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 642/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Mon May 23 12:22:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:22:55.621264 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76b12e-f574-4bd3-b831-f755b96ad7a1 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:55.742080 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76b12e-f574-4bd3-b831-f755b96ad7a1 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:55.784842 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8deb8c-0c73-4cbd-b92b-924643007adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:55.785565 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8deb8c-0c73-4cbd-b92b-924643007adc None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:55.785899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8deb8c-0c73-4cbd-b92b-924643007adc None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:55.786225 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8deb8c-0c73-4cbd-b92b-924643007adc None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:55.787027 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8deb8c-0c73-4cbd-b92b-924643007adc None admin] RBAC: Adding query filter params (name=placement) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:55.787390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8deb8c-0c73-4cbd-b92b-924643007adc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:55.788806 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8deb8c-0c73-4cbd-b92b-924643007adc None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:55.793694 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 649/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Mon May 23 12:22:55 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:55.800138 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f15cb-f5dc-4b19-b37a-fca79479fe65 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:55.917819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f15cb-f5dc-4b19-b37a-fca79479fe65 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:55.952270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af5e7c-c16c-4b0b-b9c4-18e2b0345f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:55.952936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af5e7c-c16c-4b0b-b9c4-18e2b0345f2e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:55.953222 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af5e7c-c16c-4b0b-b9c4-18e2b0345f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:55.953502 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af5e7c-c16c-4b0b-b9c4-18e2b0345f2e None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:55.954207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af5e7c-c16c-4b0b-b9c4-18e2b0345f2e None admin] RBAC: Adding query filter params (type=placement) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:22:55.954537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af5e7c-c16c-4b0b-b9c4-18e2b0345f2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:55.955937 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af5e7c-c16c-4b0b-b9c4-18e2b0345f2e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:55.960407 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 643/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Mon May 23 12:22:55 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:22:58.259413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d820f-9ea1-4fdb-9496-1dc4d3a2691f None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:58.259998 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d820f-9ea1-4fdb-9496-1dc4d3a2691f None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:58.259998 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d820f-9ea1-4fdb-9496-1dc4d3a2691f None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:58.261464 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 650/1293] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:22:58.267146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8d34b-04fc-42b3-b3dd-f705490fb58a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:58.267543 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8d34b-04fc-42b3-b3dd-f705490fb58a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:58.267720 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8d34b-04fc-42b3-b3dd-f705490fb58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:58.284376 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1dc8d34b-04fc-42b3-b3dd-f705490fb58a None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:22:58.285573 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1dc8d34b-04fc-42b3-b3dd-f705490fb58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:22:58.315587 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:58.353455 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 644/1294] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:22:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:22:58.377273 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d820f-9ea1-4fdb-9496-1dc4d3a2691f None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:22:58.408631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:22:58.482661 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d820f-9ea1-4fdb-9496-1dc4d3a2691f None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:22:58.518024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43138a-7b3c-4b1c-9cbe-4ee9bd7c2c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:22:58.519024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43138a-7b3c-4b1c-9cbe-4ee9bd7c2c01 None admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:22:58.519310 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43138a-7b3c-4b1c-9cbe-4ee9bd7c2c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:22:58.519587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43138a-7b3c-4b1c-9cbe-4ee9bd7c2c01 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:22:58.520323 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43138a-7b3c-4b1c-9cbe-4ee9bd7c2c01 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:22:58.521696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43138a-7b3c-4b1c-9cbe-4ee9bd7c2c01 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:22:58.535461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 651/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Mon May 23 12:22:58 2022] POST /identity/v3/services => generated 246 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:23:00.730192 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5607187-9413-4e11-8253-b9b96dccb693 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:23:00.730777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5607187-9413-4e11-8253-b9b96dccb693 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:23:00.730777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5607187-9413-4e11-8253-b9b96dccb693 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:23:00.732162 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 645/1296] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:23:00.738086 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e27a0e-571d-4242-84b5-bb5f64548f46 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:23:00.738482 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e27a0e-571d-4242-84b5-bb5f64548f46 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:23:00.738686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e27a0e-571d-4242-84b5-bb5f64548f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:23:00.755086 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-94e27a0e-571d-4242-84b5-bb5f64548f46 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:23:00.756292 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-94e27a0e-571d-4242-84b5-bb5f64548f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:23:00.835033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 652/1297] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:23:00 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:23:00.858486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5607187-9413-4e11-8253-b9b96dccb693 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:23:00.960229 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5607187-9413-4e11-8253-b9b96dccb693 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:23:00.995041 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa4ab4-bac1-44d4-974b-195ad299979c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:23:00.995755 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa4ab4-bac1-44d4-974b-195ad299979c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:23:00.996040 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa4ab4-bac1-44d4-974b-195ad299979c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:23:00.996321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa4ab4-bac1-44d4-974b-195ad299979c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:23:00.996982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa4ab4-bac1-44d4-974b-195ad299979c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:23:00.998418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa4ab4-bac1-44d4-974b-195ad299979c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:23:01.010278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-50fa4ab4-bac1-44d4-974b-195ad299979c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 12:23:01.010278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:23:01.010278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:23:01.010278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:23:01.010278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:23:01.010278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:23:01.010278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:23:01.010278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:23:01.010278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 12:23:01.010278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:23:01.010278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:23:01.010278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:23:01.010278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:23:01.010278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:23:01.010278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:23:01.010278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:23:01.010278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:23:01.011632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:23:01.011632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:23:01.011632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:23:01.011632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:23:01.011632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:23:01.011632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:23:01.011632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:23:01.011632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:23:01.011632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:23:01.011632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:23:01.011632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:23:01.011632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:23:01.011632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:23:01.011632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:23:01.011632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:23:01.011632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:23:01.012746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:23:01.012746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:23:01.012746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:23:01.012746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:23:01.012746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:23:01.012746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:23:01.012746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:23:01.012746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:23:01.012746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:23:01.012746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:23:01.012746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:23:01.012746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:23:01.012746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 12:23:01.012746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:23:01.012746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 646/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Mon May 23 12:23:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:23:01.017787 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e27a0e-571d-4242-84b5-bb5f64548f46 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:23:01.036409 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:23:01.118753 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e27a0e-571d-4242-84b5-bb5f64548f46 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:23:01.152599 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea489e-69f0-4205-8c53-05c87119d0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:23:01.153261 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea489e-69f0-4205-8c53-05c87119d0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:23:01.153550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea489e-69f0-4205-8c53-05c87119d0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:23:01.153830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea489e-69f0-4205-8c53-05c87119d0a6 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:23:01.154622 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea489e-69f0-4205-8c53-05c87119d0a6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:23:01.155418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea489e-69f0-4205-8c53-05c87119d0a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:23:01.156801 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea489e-69f0-4205-8c53-05c87119d0a6 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:23:01.162044 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 653/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Mon May 23 12:23:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:23:01.168010 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa4ab4-bac1-44d4-974b-195ad299979c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:23:01.199003 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:23:01.274531 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa4ab4-bac1-44d4-974b-195ad299979c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:23:01.312657 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19528bff-6cad-4168-b5c4-5da2ab9d7bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:23:01.313308 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19528bff-6cad-4168-b5c4-5da2ab9d7bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:23:01.313588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19528bff-6cad-4168-b5c4-5da2ab9d7bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:23:01.313860 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19528bff-6cad-4168-b5c4-5da2ab9d7bb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:23:01.314681 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19528bff-6cad-4168-b5c4-5da2ab9d7bb9 None admin] RBAC: Adding query filter params (interface=public, service_id=ace5975db5ac4e9ba5d14d6418bbe922, region_id=RegionOne) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:23:01.314991 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19528bff-6cad-4168-b5c4-5da2ab9d7bb9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:23:01.316380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19528bff-6cad-4168-b5c4-5da2ab9d7bb9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:23:01.321315 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 647/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Mon May 23 12:23:01 2022] GET /identity/v3/endpoints?service_id=ace5975db5ac4e9ba5d14d6418bbe922&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:23:01.327409 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea489e-69f0-4205-8c53-05c87119d0a6 None admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:23:01.406775 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:23:01.424649 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea489e-69f0-4205-8c53-05c87119d0a6 None admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:23:01.458348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e2503-477f-456e-9104-88037a2df6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:23:01.459035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e2503-477f-456e-9104-88037a2df6eb None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:23:01.459318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e2503-477f-456e-9104-88037a2df6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:23:01.459592 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e2503-477f-456e-9104-88037a2df6eb None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:23:01.460261 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e2503-477f-456e-9104-88037a2df6eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:23:01.461624 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e2503-477f-456e-9104-88037a2df6eb None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:23:01.468239 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 654/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Mon May 23 12:23:01 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:23:03.662882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158db4f-166a-4009-8b0e-b8005f48371b None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:23:03.663444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158db4f-166a-4009-8b0e-b8005f48371b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:23:03.663444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158db4f-166a-4009-8b0e-b8005f48371b None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:23:03.664820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 648/1302] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:23:03.669940 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0c54f-a206-437e-b685-0eb842ace77c None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:23:03.670860 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0c54f-a206-437e-b685-0eb842ace77c None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:23:03.671235 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0c54f-a206-437e-b685-0eb842ace77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:23:03.688712 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-13e0c54f-a206-437e-b685-0eb842ace77c None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:23:03.689917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-13e0c54f-a206-437e-b685-0eb842ace77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:23:03.755546 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 655/1303] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:23:03 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 12:23:03.778151 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158db4f-166a-4009-8b0e-b8005f48371b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:23:03.870885 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:23:03.878310 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158db4f-166a-4009-8b0e-b8005f48371b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:23:03.912271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfddb03-a25c-4e4d-9c44-b81255480304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:23:03.913098 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfddb03-a25c-4e4d-9c44-b81255480304 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:23:03.913334 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfddb03-a25c-4e4d-9c44-b81255480304 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:23:03.913605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfddb03-a25c-4e4d-9c44-b81255480304 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:23:03.914251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfddb03-a25c-4e4d-9c44-b81255480304 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:23:03.915653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfddb03-a25c-4e4d-9c44-b81255480304 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:23:03.927318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-0cfddb03-a25c-4e4d-9c44-b81255480304 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 12:23:03.927318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:23:03.927318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 12:23:03.927318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 12:23:03.927318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 12:23:03.927318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 12:23:03.927318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 12:23:03.927318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:23:03.927318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 12:23:03.927318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:23:03.927318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 12:23:03.927318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:23:03.927318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 12:23:03.927318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 12:23:03.927318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 12:23:03.927318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 12:23:03.927318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 12:23:03.928452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 12:23:03.928452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 12:23:03.928452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 12:23:03.928452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 12:23:03.928452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 12:23:03.928452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 12:23:03.928452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 12:23:03.928452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 12:23:03.928452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 12:23:03.928452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 12:23:03.928452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 12:23:03.928452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 12:23:03.928452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 12:23:03.928452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 12:23:03.928452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 12:23:03.928452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( May 23 12:23:03.929321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 12:23:03.929321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( May 23 12:23:03.929321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 12:23:03.929321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() May 23 12:23:03.929321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 12:23:03.929321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 12:23:03.929321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 12:23:03.929321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() May 23 12:23:03.929321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 12:23:03.929321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( May 23 12:23:03.929321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 12:23:03.929321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 12:23:03.929321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 12:23:03.929321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: ERROR keystone.server.flask.application May 23 12:23:03.929321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 649/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Mon May 23 12:23:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 12:23:03.934524 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0c54f-a206-437e-b685-0eb842ace77c None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:23:04.009132 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:23:04.032240 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0c54f-a206-437e-b685-0eb842ace77c None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:23:04.066133 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1d918-bc67-425f-a159-6ef0cec80315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:23:04.066840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1d918-bc67-425f-a159-6ef0cec80315 None admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:23:04.067125 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1d918-bc67-425f-a159-6ef0cec80315 None admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:23:04.067402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1d918-bc67-425f-a159-6ef0cec80315 None admin] PATH_INFO: `/v3/services` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:23:04.068097 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1d918-bc67-425f-a159-6ef0cec80315 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:23:04.068401 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1d918-bc67-425f-a159-6ef0cec80315 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:23:04.069766 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1d918-bc67-425f-a159-6ef0cec80315 None admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:23:04.074779 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 656/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Mon May 23 12:23:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:23:04.080507 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfddb03-a25c-4e4d-9c44-b81255480304 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:23:04.177790 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfddb03-a25c-4e4d-9c44-b81255480304 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:23:04.209985 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744f291-efe2-446e-8488-1b35fac39b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:23:04.210668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744f291-efe2-446e-8488-1b35fac39b3f None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:23:04.210952 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744f291-efe2-446e-8488-1b35fac39b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:23:04.211226 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744f291-efe2-446e-8488-1b35fac39b3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:23:04.211953 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744f291-efe2-446e-8488-1b35fac39b3f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:23:04.213324 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744f291-efe2-446e-8488-1b35fac39b3f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:23:04.233335 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 650/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Mon May 23 12:23:04 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:23:14.072199 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=30 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:23:14.229081 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:24:09.737731 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645b675-8a4f-41e4-9e30-069394fc6871 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:09.738491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645b675-8a4f-41e4-9e30-069394fc6871 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:09.738491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645b675-8a4f-41e4-9e30-069394fc6871 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:09.739822 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 657/1307] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:24:09.745974 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4de17d-0884-4fdf-bbf4-282be44beaa7 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:09.746703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4de17d-0884-4fdf-bbf4-282be44beaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:09.746703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4de17d-0884-4fdf-bbf4-282be44beaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:09.828132 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0d4de17d-0884-4fdf-bbf4-282be44beaa7 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:24:09.829388 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0d4de17d-0884-4fdf-bbf4-282be44beaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:09.940829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 651/1308] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:24:09.993511 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e789f-85c7-4d08-9b23-48a67372bd9f None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:09.993825 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e789f-85c7-4d08-9b23-48a67372bd9f None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:09.994151 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e789f-85c7-4d08-9b23-48a67372bd9f None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:09.996383 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 658/1309] 10.222.0.25 () {54 vars in 964 bytes} [Mon May 23 12:24:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:24:10.002995 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2fa9d-9dd4-40ea-b1dd-14f5e9056be0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:10.003293 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2fa9d-9dd4-40ea-b1dd-14f5e9056be0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:10.003579 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2fa9d-9dd4-40ea-b1dd-14f5e9056be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:10.108749 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c7a2fa9d-9dd4-40ea-b1dd-14f5e9056be0 None None] MFA Rules not processed for user `74674b52807742abb7e144bba3bb6e56`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:24:10.110011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c7a2fa9d-9dd4-40ea-b1dd-14f5e9056be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:10.139540 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:24:10.207731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 652/1310] 10.222.0.25 () {58 vars in 1061 bytes} [Mon May 23 12:24:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:24:10.219113 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e789f-85c7-4d08-9b23-48a67372bd9f None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:24:10.221123 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-fd4e789f-85c7-4d08-9b23-48a67372bd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:10.379196 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e789f-85c7-4d08-9b23-48a67372bd9f None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:24:10.470186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f6147-eaa3-47ee-9ebd-f3877404119c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:24:10.471069 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f6147-eaa3-47ee-9ebd-f3877404119c service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:10.471458 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f6147-eaa3-47ee-9ebd-f3877404119c service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:10.471842 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f6147-eaa3-47ee-9ebd-f3877404119c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:10.473888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-cb7f6147-eaa3-47ee-9ebd-f3877404119c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:10.535534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:24:10.606836 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f6147-eaa3-47ee-9ebd-f3877404119c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:24:10.608461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f6147-eaa3-47ee-9ebd-f3877404119c service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:24:10.632817 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 659/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:24:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:24:13.255289 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28381e89-b8b9-465c-beea-280d0871c87f None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:13.255289 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28381e89-b8b9-465c-beea-280d0871c87f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:13.255891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28381e89-b8b9-465c-beea-280d0871c87f None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:13.256850 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 653/1312] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:24:13.264382 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab7d9b-ca08-4625-86b0-1d41f8de1f6c None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:13.264827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab7d9b-ca08-4625-86b0-1d41f8de1f6c None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:13.264971 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab7d9b-ca08-4625-86b0-1d41f8de1f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:13.378837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-19ab7d9b-ca08-4625-86b0-1d41f8de1f6c None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:24:13.380781 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-19ab7d9b-ca08-4625-86b0-1d41f8de1f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:13.529216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 660/1313] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:24:13.572320 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28381e89-b8b9-465c-beea-280d0871c87f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:24:13.573958 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-28381e89-b8b9-465c-beea-280d0871c87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:13.702153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28381e89-b8b9-465c-beea-280d0871c87f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:24:13.789382 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:24:13.793330 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05556b0d-5dfb-4245-9608-1729e8e8ce83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:24:13.794453 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05556b0d-5dfb-4245-9608-1729e8e8ce83 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:13.794789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05556b0d-5dfb-4245-9608-1729e8e8ce83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:13.795439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05556b0d-5dfb-4245-9608-1729e8e8ce83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:13.797635 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-05556b0d-5dfb-4245-9608-1729e8e8ce83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:13.931322 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05556b0d-5dfb-4245-9608-1729e8e8ce83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:24:13.932993 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05556b0d-5dfb-4245-9608-1729e8e8ce83 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:24:13.955342 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 654/1314] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:24:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:24:16.600979 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7f78e-fe11-4140-a725-b2592e536c77 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:16.601516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7f78e-fe11-4140-a725-b2592e536c77 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:16.601516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7f78e-fe11-4140-a725-b2592e536c77 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:16.602990 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 661/1315] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:24:16.608886 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b486b-f857-43bd-b42e-204af8967b25 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:16.609390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b486b-f857-43bd-b42e-204af8967b25 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:16.609503 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b486b-f857-43bd-b42e-204af8967b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:16.680476 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1e6b486b-f857-43bd-b42e-204af8967b25 None None] MFA Rules not processed for user `1a07c7c0378b48d9b37b3826e79a85c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:24:16.681849 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1e6b486b-f857-43bd-b42e-204af8967b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:16.745787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:24:16.795391 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 655/1316] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:24:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:24:16.834789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7f78e-fe11-4140-a725-b2592e536c77 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:24:16.836325 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-53b7f78e-fe11-4140-a725-b2592e536c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:16.847293 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:24:16.949005 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7f78e-fe11-4140-a725-b2592e536c77 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:24:17.026830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1444f0-be76-43bc-8d06-72f7b353098a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:24:17.027485 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1444f0-be76-43bc-8d06-72f7b353098a service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:17.027834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1444f0-be76-43bc-8d06-72f7b353098a service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:17.028114 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1444f0-be76-43bc-8d06-72f7b353098a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:17.029854 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ef1444f0-be76-43bc-8d06-72f7b353098a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:17.095933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:24:17.147548 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1444f0-be76-43bc-8d06-72f7b353098a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:24:17.149058 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1444f0-be76-43bc-8d06-72f7b353098a service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:24:17.168976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 662/1317] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:24:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:24:20.027676 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dcd2d-b0c6-488d-8ab1-a10e8d8cbf87 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:20.028224 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dcd2d-b0c6-488d-8ab1-a10e8d8cbf87 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:20.028224 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dcd2d-b0c6-488d-8ab1-a10e8d8cbf87 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:20.029622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 656/1318] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:24:20.035542 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b51f5-2bdf-4c31-aaa5-64d17c805d5e None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:20.036023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b51f5-2bdf-4c31-aaa5-64d17c805d5e None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:20.036120 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b51f5-2bdf-4c31-aaa5-64d17c805d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:20.105283 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-f70b51f5-2bdf-4c31-aaa5-64d17c805d5e None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:24:20.106621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-f70b51f5-2bdf-4c31-aaa5-64d17c805d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:20.214446 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 663/1319] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:24:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:24:20.267007 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c5dda-fed6-417d-8d68-74103bbc291d None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:20.267298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c5dda-fed6-417d-8d68-74103bbc291d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:20.267579 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c5dda-fed6-417d-8d68-74103bbc291d None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:20.268958 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 657/1320] 10.222.0.25 () {54 vars in 964 bytes} [Mon May 23 12:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:24:20.275129 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee45ab-c954-4dde-a022-ae4a2b1d79d6 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:20.275421 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee45ab-c954-4dde-a022-ae4a2b1d79d6 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:20.275703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee45ab-c954-4dde-a022-ae4a2b1d79d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:20.297278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:24:20.351830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-73ee45ab-c954-4dde-a022-ae4a2b1d79d6 None None] MFA Rules not processed for user `74674b52807742abb7e144bba3bb6e56`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:24:20.353535 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-73ee45ab-c954-4dde-a022-ae4a2b1d79d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:20.429811 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 664/1321] 10.222.0.25 () {58 vars in 1061 bytes} [Mon May 23 12:24:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:24:20.440196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c5dda-fed6-417d-8d68-74103bbc291d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:24:20.442215 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-076c5dda-fed6-417d-8d68-74103bbc291d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:20.560267 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c5dda-fed6-417d-8d68-74103bbc291d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:24:20.643041 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd43b8-1f35-4c82-a21c-e46aebe4ddbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:24:20.643692 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd43b8-1f35-4c82-a21c-e46aebe4ddbf service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:20.643980 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd43b8-1f35-4c82-a21c-e46aebe4ddbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:20.644258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd43b8-1f35-4c82-a21c-e46aebe4ddbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:20.645955 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-52bd43b8-1f35-4c82-a21c-e46aebe4ddbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:20.654599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:24:20.761553 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd43b8-1f35-4c82-a21c-e46aebe4ddbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:24:20.763064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd43b8-1f35-4c82-a21c-e46aebe4ddbf service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:24:20.782264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 658/1322] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:24:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:24:24.295472 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087b208-09f7-4127-9345-15e70ad417ec None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:24.296005 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087b208-09f7-4127-9345-15e70ad417ec None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:24.296463 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087b208-09f7-4127-9345-15e70ad417ec None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:24.299054 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 665/1323] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:24:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:24:24.307389 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d527e-006e-4a56-928d-c0f640beb1ae None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:24.308143 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d527e-006e-4a56-928d-c0f640beb1ae None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:24.308143 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d527e-006e-4a56-928d-c0f640beb1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:24.380338 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-424d527e-006e-4a56-928d-c0f640beb1ae None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:24:24.381605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-424d527e-006e-4a56-928d-c0f640beb1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:24.442348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:24:24.498386 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 659/1324] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:24:24.540729 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087b208-09f7-4127-9345-15e70ad417ec None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:24:24.542555 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-a087b208-09f7-4127-9345-15e70ad417ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:24.656234 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087b208-09f7-4127-9345-15e70ad417ec None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:24:24.669459 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:24:24.745521 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42114c86-1605-4e21-8d57-33b5befedca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:24:24.746194 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42114c86-1605-4e21-8d57-33b5befedca4 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:24.746480 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42114c86-1605-4e21-8d57-33b5befedca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:24.746786 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42114c86-1605-4e21-8d57-33b5befedca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:24.748511 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-42114c86-1605-4e21-8d57-33b5befedca4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:24.888585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42114c86-1605-4e21-8d57-33b5befedca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:24:24.890050 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42114c86-1605-4e21-8d57-33b5befedca4 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:24:24.909272 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 666/1325] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:24:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:24:27.383184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da109b4-3e4b-4233-a7e4-eb27ba108bbb None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:27.383729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da109b4-3e4b-4233-a7e4-eb27ba108bbb None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:27.383819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da109b4-3e4b-4233-a7e4-eb27ba108bbb None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:27.385778 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 660/1326] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:24:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:24:27.391394 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766abf5-a6ea-4345-869a-f02381f21f3a None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:27.391842 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766abf5-a6ea-4345-869a-f02381f21f3a None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:27.391950 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766abf5-a6ea-4345-869a-f02381f21f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:27.439657 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:24:27.459441 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-e766abf5-a6ea-4345-869a-f02381f21f3a None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:24:27.460683 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e766abf5-a6ea-4345-869a-f02381f21f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:27.571992 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 667/1327] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:24:27.609713 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da109b4-3e4b-4233-a7e4-eb27ba108bbb None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:24:27.611369 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6da109b4-3e4b-4233-a7e4-eb27ba108bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:27.735270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da109b4-3e4b-4233-a7e4-eb27ba108bbb None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:24:27.828572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7511a-8da6-4639-b298-63c3e5d7adc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:24:27.829227 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7511a-8da6-4639-b298-63c3e5d7adc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:27.829513 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7511a-8da6-4639-b298-63c3e5d7adc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:27.829786 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7511a-8da6-4639-b298-63c3e5d7adc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:27.831504 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-92f7511a-8da6-4639-b298-63c3e5d7adc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:27.851902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:24:27.952276 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7511a-8da6-4639-b298-63c3e5d7adc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:24:27.953743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7511a-8da6-4639-b298-63c3e5d7adc8 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:24:27.972635 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 661/1328] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:24:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:24:30.287621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50554639-1ef2-4b01-a26d-0d3b903bb71d None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:30.288550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50554639-1ef2-4b01-a26d-0d3b903bb71d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:30.288550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50554639-1ef2-4b01-a26d-0d3b903bb71d None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:30.289645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 668/1329] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:24:30.295417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6171078-59d9-4b63-a49f-79965c2e5dda None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:30.295942 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6171078-59d9-4b63-a49f-79965c2e5dda None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:30.296059 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6171078-59d9-4b63-a49f-79965c2e5dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:30.374251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d6171078-59d9-4b63-a49f-79965c2e5dda None None] MFA Rules not processed for user `1a07c7c0378b48d9b37b3826e79a85c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:24:30.375515 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d6171078-59d9-4b63-a49f-79965c2e5dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:30.441863 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:24:30.474696 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 662/1330] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:24:30 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:24:30.512370 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50554639-1ef2-4b01-a26d-0d3b903bb71d None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:24:30.514032 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-50554639-1ef2-4b01-a26d-0d3b903bb71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:30.638223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50554639-1ef2-4b01-a26d-0d3b903bb71d None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:24:30.661835 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:24:30.722295 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b837acb-fe8e-40e6-875c-23175857e628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:24:30.723122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b837acb-fe8e-40e6-875c-23175857e628 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:30.723409 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b837acb-fe8e-40e6-875c-23175857e628 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:30.723685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b837acb-fe8e-40e6-875c-23175857e628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:30.725370 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-8b837acb-fe8e-40e6-875c-23175857e628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:30.845136 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b837acb-fe8e-40e6-875c-23175857e628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:24:30.846922 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b837acb-fe8e-40e6-875c-23175857e628 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:24:30.867372 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 669/1331] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:24:30 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:24:33.400691 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd50e6-0f5f-45d3-af93-cf37fe9f1efc None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:33.401247 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd50e6-0f5f-45d3-af93-cf37fe9f1efc None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:33.401247 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd50e6-0f5f-45d3-af93-cf37fe9f1efc None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:33.402701 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 663/1332] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:24:33.408648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe1f22-41e4-43cb-b566-0dfa23d9ea7f None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:33.409165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe1f22-41e4-43cb-b566-0dfa23d9ea7f None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:33.409265 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe1f22-41e4-43cb-b566-0dfa23d9ea7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:33.480595 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:24:33.483478 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-63fe1f22-41e4-43cb-b566-0dfa23d9ea7f None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:24:33.485259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-63fe1f22-41e4-43cb-b566-0dfa23d9ea7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:33.594212 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 670/1333] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:24:33.630309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd50e6-0f5f-45d3-af93-cf37fe9f1efc None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:24:33.631950 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-56fd50e6-0f5f-45d3-af93-cf37fe9f1efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:33.749358 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd50e6-0f5f-45d3-af93-cf37fe9f1efc None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:24:33.830222 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d974a22-407d-4497-a729-8687a0d598cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:24:33.830914 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d974a22-407d-4497-a729-8687a0d598cd service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:33.831200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d974a22-407d-4497-a729-8687a0d598cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:33.831476 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d974a22-407d-4497-a729-8687a0d598cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:33.833145 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9d974a22-407d-4497-a729-8687a0d598cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:33.864050 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:24:33.963155 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d974a22-407d-4497-a729-8687a0d598cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:24:33.966203 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d974a22-407d-4497-a729-8687a0d598cd service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:24:33.988425 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 664/1334] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:24:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:24:36.279782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2d19f-ccb4-4f5c-87ec-851da40d634b None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:36.280273 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2d19f-ccb4-4f5c-87ec-851da40d634b None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:36.280397 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2d19f-ccb4-4f5c-87ec-851da40d634b None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:36.281863 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 671/1335] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:24:36.287577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a389c8d-67a0-41d6-895c-ae440007db15 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:36.288053 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a389c8d-67a0-41d6-895c-ae440007db15 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:36.288156 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a389c8d-67a0-41d6-895c-ae440007db15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:36.354475 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9a389c8d-67a0-41d6-895c-ae440007db15 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:24:36.355735 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9a389c8d-67a0-41d6-895c-ae440007db15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:36.435459 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:24:36.458682 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 665/1336] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:24:36.498909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2d19f-ccb4-4f5c-87ec-851da40d634b None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:24:36.500461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-dae2d19f-ccb4-4f5c-87ec-851da40d634b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:36.610991 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2d19f-ccb4-4f5c-87ec-851da40d634b None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:24:36.640790 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:24:36.687848 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86643bc5-24e2-4891-8577-ae67c91a1628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:24:36.688496 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86643bc5-24e2-4891-8577-ae67c91a1628 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:36.688783 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86643bc5-24e2-4891-8577-ae67c91a1628 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:36.689084 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86643bc5-24e2-4891-8577-ae67c91a1628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:36.690776 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-86643bc5-24e2-4891-8577-ae67c91a1628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:36.802680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86643bc5-24e2-4891-8577-ae67c91a1628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:24:36.804144 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86643bc5-24e2-4891-8577-ae67c91a1628 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:24:36.823805 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 672/1337] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:24:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:24:39.460038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1dea3-e0a9-4e26-9350-f900615de702 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:39.460587 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1dea3-e0a9-4e26-9350-f900615de702 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:39.460678 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1dea3-e0a9-4e26-9350-f900615de702 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:39.462014 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 666/1338] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:24:39.467521 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1453eb6-1098-461e-ab95-fdd9bdcae9c5 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:39.468015 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1453eb6-1098-461e-ab95-fdd9bdcae9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:39.468124 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1453eb6-1098-461e-ab95-fdd9bdcae9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:39.534093 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-d1453eb6-1098-461e-ab95-fdd9bdcae9c5 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:24:39.535328 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-d1453eb6-1098-461e-ab95-fdd9bdcae9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:39.543848 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:24:39.634207 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 673/1339] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:24:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:24:39.670746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1dea3-e0a9-4e26-9350-f900615de702 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:24:39.672642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0ff1dea3-e0a9-4e26-9350-f900615de702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:39.798274 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1dea3-e0a9-4e26-9350-f900615de702 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:24:39.876751 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee0dd5-0e4d-4f56-afb8-a5375217e575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:24:39.877395 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee0dd5-0e4d-4f56-afb8-a5375217e575 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:39.877677 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee0dd5-0e4d-4f56-afb8-a5375217e575 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:39.877949 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee0dd5-0e4d-4f56-afb8-a5375217e575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:39.880031 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0eee0dd5-0e4d-4f56-afb8-a5375217e575 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:39.917727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:24:39.994345 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee0dd5-0e4d-4f56-afb8-a5375217e575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:24:39.995835 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee0dd5-0e4d-4f56-afb8-a5375217e575 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:24:40.016109 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 667/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:24:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:24:44.334003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbcb1c-0523-46be-9fdc-5a68da6214b7 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:44.334542 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbcb1c-0523-46be-9fdc-5a68da6214b7 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:44.334542 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbcb1c-0523-46be-9fdc-5a68da6214b7 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:44.336069 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 674/1341] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:24:44.341462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffbba3-3300-477e-b1d7-b9fa113c78de None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:44.341996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffbba3-3300-477e-b1d7-b9fa113c78de None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:44.342094 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffbba3-3300-477e-b1d7-b9fa113c78de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:44.393679 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-12ffbba3-3300-477e-b1d7-b9fa113c78de None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:24:44.394869 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-12ffbba3-3300-477e-b1d7-b9fa113c78de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:44.479761 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 668/1342] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:24:44.527303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbcb1c-0523-46be-9fdc-5a68da6214b7 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:24:44.527303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-66bbcb1c-0523-46be-9fdc-5a68da6214b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:44.577688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbcb1c-0523-46be-9fdc-5a68da6214b7 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:24:44.581342 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7070e-9291-4d8d-936d-69f63fec6568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:24:44.581987 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7070e-9291-4d8d-936d-69f63fec6568 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:44.582268 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7070e-9291-4d8d-936d-69f63fec6568 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:44.582593 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7070e-9291-4d8d-936d-69f63fec6568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:44.593088 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7070e-9291-4d8d-936d-69f63fec6568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:24:44.594476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7070e-9291-4d8d-936d-69f63fec6568 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:24:44.605682 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 675/1343] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:24:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:24:47.503354 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de093c0-bea9-48da-8e41-274d3367bc5e None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:47.503890 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de093c0-bea9-48da-8e41-274d3367bc5e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:47.503890 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de093c0-bea9-48da-8e41-274d3367bc5e None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:47.505443 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 669/1344] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:24:47.513436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cff3a-dac6-49c4-b6b3-714f105df9f1 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:47.513992 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cff3a-dac6-49c4-b6b3-714f105df9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:47.514165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cff3a-dac6-49c4-b6b3-714f105df9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:47.544255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-6c9cff3a-dac6-49c4-b6b3-714f105df9f1 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:24:47.545462 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-6c9cff3a-dac6-49c4-b6b3-714f105df9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:47.553489 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 676/1345] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:24:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:24:47.590993 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de093c0-bea9-48da-8e41-274d3367bc5e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:24:47.602837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de093c0-bea9-48da-8e41-274d3367bc5e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:24:47.606385 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a753956-d127-465e-a577-0751584f2821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:24:47.607159 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a753956-d127-465e-a577-0751584f2821 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:47.607343 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a753956-d127-465e-a577-0751584f2821 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:47.607622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a753956-d127-465e-a577-0751584f2821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:47.617531 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a753956-d127-465e-a577-0751584f2821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:24:47.619042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a753956-d127-465e-a577-0751584f2821 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:24:47.630881 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 670/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:24:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:24:51.956641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d2b89-7040-4da9-8ee8-faeee02978c6 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:51.957194 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d2b89-7040-4da9-8ee8-faeee02978c6 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:51.957194 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d2b89-7040-4da9-8ee8-faeee02978c6 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:51.958617 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 677/1347] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:24:51.964202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c72bd1-da2b-4c07-9f59-2647a7303108 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:51.964647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c72bd1-da2b-4c07-9f59-2647a7303108 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:51.964761 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c72bd1-da2b-4c07-9f59-2647a7303108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:51.983814 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-33c72bd1-da2b-4c07-9f59-2647a7303108 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:24:51.985120 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-33c72bd1-da2b-4c07-9f59-2647a7303108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:51.995095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 671/1348] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:24:52.032291 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d2b89-7040-4da9-8ee8-faeee02978c6 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:24:52.043829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d2b89-7040-4da9-8ee8-faeee02978c6 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:24:52.047380 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67e50d-6b89-4252-8c0a-602053b470fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:24:52.048030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67e50d-6b89-4252-8c0a-602053b470fc service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:52.048320 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67e50d-6b89-4252-8c0a-602053b470fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:52.048602 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67e50d-6b89-4252-8c0a-602053b470fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:52.058787 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67e50d-6b89-4252-8c0a-602053b470fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:24:52.060267 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67e50d-6b89-4252-8c0a-602053b470fc service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:24:52.070164 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 678/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:24:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:24:57.708447 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd46a4-e740-4f11-9b91-1ec9b5da1813 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:57.709891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd46a4-e740-4f11-9b91-1ec9b5da1813 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:57.710540 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd46a4-e740-4f11-9b91-1ec9b5da1813 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:57.713620 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 672/1350] 10.222.0.25 () {54 vars in 921 bytes} [Mon May 23 12:24:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:24:57.735516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47059764-f1cd-4d98-8b1b-df9e08153c42 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:24:57.736991 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47059764-f1cd-4d98-8b1b-df9e08153c42 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:24:57.737383 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47059764-f1cd-4d98-8b1b-df9e08153c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:24:57.852273 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-47059764-f1cd-4d98-8b1b-df9e08153c42 None None] MFA Rules not processed for user `a3fde90ab1e0490ebb7cb514173d984e`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:24:57.853715 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-47059764-f1cd-4d98-8b1b-df9e08153c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:24:57.886118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:24:57.943042 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 679/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Mon May 23 12:24:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:25:01.978381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=93 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:25:02.775166 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb67db-c27d-4809-98f9-6085875a009d None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:02.775348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb67db-c27d-4809-98f9-6085875a009d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:02.775630 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb67db-c27d-4809-98f9-6085875a009d None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:02.777262 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 673/1352] 10.222.0.25 () {54 vars in 921 bytes} [Mon May 23 12:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:25:02.782799 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1541ef-ebc7-4034-908b-d48ebfd0db98 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:02.783367 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1541ef-ebc7-4034-908b-d48ebfd0db98 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:02.783367 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1541ef-ebc7-4034-908b-d48ebfd0db98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:02.803797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-ff1541ef-ebc7-4034-908b-d48ebfd0db98 None None] MFA Rules not processed for user `a3fde90ab1e0490ebb7cb514173d984e`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:02.805114 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ff1541ef-ebc7-4034-908b-d48ebfd0db98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:02.814574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 680/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Mon May 23 12:25:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:25:04.268613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89342662-ab35-40c7-840f-56fbbc7f54f6 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:04.269140 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89342662-ab35-40c7-840f-56fbbc7f54f6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:04.269235 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89342662-ab35-40c7-840f-56fbbc7f54f6 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:04.270556 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 674/1354] 10.222.0.25 () {54 vars in 921 bytes} [Mon May 23 12:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:25:04.276264 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81405736-75ce-4ac7-bef6-750e90a3757a None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:04.276742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81405736-75ce-4ac7-bef6-750e90a3757a None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:04.276987 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81405736-75ce-4ac7-bef6-750e90a3757a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:04.296181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-81405736-75ce-4ac7-bef6-750e90a3757a None None] MFA Rules not processed for user `a3fde90ab1e0490ebb7cb514173d984e`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:04.297402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-81405736-75ce-4ac7-bef6-750e90a3757a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:04.314119 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 681/1355] 10.222.0.25 () {58 vars in 1018 bytes} [Mon May 23 12:25:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:25:08.329343 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847259c-2afb-4a37-a406-565361067a24 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:08.329899 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847259c-2afb-4a37-a406-565361067a24 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:08.329899 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847259c-2afb-4a37-a406-565361067a24 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:08.331190 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 675/1356] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:25:08.338729 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8474ab-2763-4665-9f23-4b7fbfbf076b None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:08.339248 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8474ab-2763-4665-9f23-4b7fbfbf076b None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:08.339654 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8474ab-2763-4665-9f23-4b7fbfbf076b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:08.372098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-bd8474ab-2763-4665-9f23-4b7fbfbf076b None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:08.374021 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-bd8474ab-2763-4665-9f23-4b7fbfbf076b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:08.387242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 682/1357] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:25:08.457130 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f5132-67d2-47f4-b575-e1fe17626563 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:08.457778 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f5132-67d2-47f4-b575-e1fe17626563 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:08.459167 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f5132-67d2-47f4-b575-e1fe17626563 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:08.463178 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 676/1358] 10.222.0.25 () {54 vars in 961 bytes} [Mon May 23 12:25:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:25:08.482716 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee664ab-7397-48e7-9c56-8d902a50afab None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:08.483262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee664ab-7397-48e7-9c56-8d902a50afab None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:08.483719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee664ab-7397-48e7-9c56-8d902a50afab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:08.554196 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-3ee664ab-7397-48e7-9c56-8d902a50afab None None] MFA Rules not processed for user `d49997b9108145b78eb4db1d8823bf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:08.555536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-3ee664ab-7397-48e7-9c56-8d902a50afab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:08.660828 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 683/1359] 10.222.0.25 () {58 vars in 1058 bytes} [Mon May 23 12:25:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:25:08.670252 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f5132-67d2-47f4-b575-e1fe17626563 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:25:08.685458 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f5132-67d2-47f4-b575-e1fe17626563 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:25:08.692182 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e5bf4-a3d8-4e67-9abb-f2dece16894c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:25:08.693045 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e5bf4-a3d8-4e67-9abb-f2dece16894c service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:08.693435 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e5bf4-a3d8-4e67-9abb-f2dece16894c service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:08.693816 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e5bf4-a3d8-4e67-9abb-f2dece16894c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:08.703100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e5bf4-a3d8-4e67-9abb-f2dece16894c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:25:08.705113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e5bf4-a3d8-4e67-9abb-f2dece16894c service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:25:08.718465 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 677/1360] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:25:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:25:11.262346 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ddeb7-1715-45ad-8c46-0cd25bf9fd8c None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:11.262973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ddeb7-1715-45ad-8c46-0cd25bf9fd8c None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:11.262973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ddeb7-1715-45ad-8c46-0cd25bf9fd8c None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:11.264372 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 684/1361] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:25:11.269733 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446136a-ea2e-4c63-a02c-bdff90beabe0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:11.270256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446136a-ea2e-4c63-a02c-bdff90beabe0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:11.270348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446136a-ea2e-4c63-a02c-bdff90beabe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:11.290096 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2446136a-ea2e-4c63-a02c-bdff90beabe0 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:11.290491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2446136a-ea2e-4c63-a02c-bdff90beabe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:11.298935 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 678/1362] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:25:11.344552 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ddeb7-1715-45ad-8c46-0cd25bf9fd8c None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:25:11.359406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ddeb7-1715-45ad-8c46-0cd25bf9fd8c None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:25:11.365100 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b00fb-02ca-4a75-b870-ccfaaf54a9e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:25:11.365749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b00fb-02ca-4a75-b870-ccfaaf54a9e9 service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:11.366037 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b00fb-02ca-4a75-b870-ccfaaf54a9e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:11.366316 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b00fb-02ca-4a75-b870-ccfaaf54a9e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:11.375901 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b00fb-02ca-4a75-b870-ccfaaf54a9e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:25:11.377645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b00fb-02ca-4a75-b870-ccfaaf54a9e9 service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:25:11.388797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 685/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:25:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:25:14.000836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590a0ee-5bbd-4a06-af4e-0cce6c380984 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:14.001386 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590a0ee-5bbd-4a06-af4e-0cce6c380984 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:14.001386 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590a0ee-5bbd-4a06-af4e-0cce6c380984 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:14.002988 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 679/1364] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:25:14.008953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f11226-3357-4834-b080-e21077ab492b None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:14.009421 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f11226-3357-4834-b080-e21077ab492b None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:14.009546 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f11226-3357-4834-b080-e21077ab492b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:14.030074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-64f11226-3357-4834-b080-e21077ab492b None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:14.031759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-64f11226-3357-4834-b080-e21077ab492b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:14.041369 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 686/1365] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:25:14.096283 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa5a90-0005-4e68-8838-e517ccf68843 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:14.096590 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa5a90-0005-4e68-8838-e517ccf68843 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:14.096885 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa5a90-0005-4e68-8838-e517ccf68843 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:14.098321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 680/1366] 10.222.0.25 () {54 vars in 961 bytes} [Mon May 23 12:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:25:14.104519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0748b-55fb-41b3-a8f6-3d3d36eaafac None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:14.104832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0748b-55fb-41b3-a8f6-3d3d36eaafac None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:14.105111 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0748b-55fb-41b3-a8f6-3d3d36eaafac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:14.125840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-f5b0748b-55fb-41b3-a8f6-3d3d36eaafac None None] MFA Rules not processed for user `d49997b9108145b78eb4db1d8823bf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:14.127782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-f5b0748b-55fb-41b3-a8f6-3d3d36eaafac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:14.154868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 687/1367] 10.222.0.25 () {58 vars in 1058 bytes} [Mon May 23 12:25:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:25:14.173439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa5a90-0005-4e68-8838-e517ccf68843 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:25:14.197068 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa5a90-0005-4e68-8838-e517ccf68843 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:25:14.202843 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964bbdb-198c-42e3-912d-35004a50bbe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:25:14.203501 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964bbdb-198c-42e3-912d-35004a50bbe4 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:14.203785 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964bbdb-198c-42e3-912d-35004a50bbe4 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:14.204063 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964bbdb-198c-42e3-912d-35004a50bbe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:14.214911 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964bbdb-198c-42e3-912d-35004a50bbe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:25:14.216560 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964bbdb-198c-42e3-912d-35004a50bbe4 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:25:14.229475 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 681/1368] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:25:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:25:16.565285 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad379f29-73fd-4cc5-817b-ecd56a0e56c2 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:16.565799 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad379f29-73fd-4cc5-817b-ecd56a0e56c2 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:16.565799 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad379f29-73fd-4cc5-817b-ecd56a0e56c2 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:16.567183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 688/1369] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:25:16.573061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e9800-b77b-481f-a6f3-6937c76d656b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:16.574004 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e9800-b77b-481f-a6f3-6937c76d656b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:16.574299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e9800-b77b-481f-a6f3-6937c76d656b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:16.595553 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ef3e9800-b77b-481f-a6f3-6937c76d656b None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:16.596214 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ef3e9800-b77b-481f-a6f3-6937c76d656b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:16.605415 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 682/1370] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:25:16.650151 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad379f29-73fd-4cc5-817b-ecd56a0e56c2 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:25:16.665684 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad379f29-73fd-4cc5-817b-ecd56a0e56c2 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:25:16.671314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d51271-289b-4c50-9561-d48acf5e22ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:25:16.672183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d51271-289b-4c50-9561-d48acf5e22ba service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:16.672646 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d51271-289b-4c50-9561-d48acf5e22ba service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:16.673069 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d51271-289b-4c50-9561-d48acf5e22ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:16.682961 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d51271-289b-4c50-9561-d48acf5e22ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:25:16.684738 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d51271-289b-4c50-9561-d48acf5e22ba service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:25:16.694993 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 689/1371] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:25:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:25:16.955145 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b73237-9eba-4dbc-8b51-79b144303aa6 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:16.955484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b73237-9eba-4dbc-8b51-79b144303aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:16.955703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b73237-9eba-4dbc-8b51-79b144303aa6 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:16.957643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 683/1372] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:25:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:25:16.963982 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4df852-29ca-448c-9ef8-6e9559e7ef0d None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:16.964285 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4df852-29ca-448c-9ef8-6e9559e7ef0d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:16.964717 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4df852-29ca-448c-9ef8-6e9559e7ef0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:16.991641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-8e4df852-29ca-448c-9ef8-6e9559e7ef0d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:16.992970 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-8e4df852-29ca-448c-9ef8-6e9559e7ef0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:17.001431 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 690/1373] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:25:17.308647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4a289-b9b1-4610-bf06-3a8e529df9ed None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:17.308647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4a289-b9b1-4610-bf06-3a8e529df9ed None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:17.308647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4a289-b9b1-4610-bf06-3a8e529df9ed None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:17.310994 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 684/1374] 10.222.0.25 () {54 vars in 963 bytes} [Mon May 23 12:25:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:25:17.316054 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053a51c-04c0-4efc-9522-e604836bc191 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:17.316371 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053a51c-04c0-4efc-9522-e604836bc191 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:17.316653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053a51c-04c0-4efc-9522-e604836bc191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:17.325802 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:25:17.376601 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-5053a51c-04c0-4efc-9522-e604836bc191 None None] MFA Rules not processed for user `3a3f520fcbe544c9be7e33a64eb1dc20`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:17.377847 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-5053a51c-04c0-4efc-9522-e604836bc191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:17.450707 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 691/1375] 10.222.0.25 () {58 vars in 1060 bytes} [Mon May 23 12:25:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:25:17.459664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4a289-b9b1-4610-bf06-3a8e529df9ed None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:25:17.471907 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4a289-b9b1-4610-bf06-3a8e529df9ed None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:25:17.476261 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0e156-13e0-44b1-a0e4-0a5b34c29926 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:25:17.476990 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0e156-13e0-44b1-a0e4-0a5b34c29926 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:17.477352 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0e156-13e0-44b1-a0e4-0a5b34c29926 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:17.477705 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0e156-13e0-44b1-a0e4-0a5b34c29926 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:17.490444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0e156-13e0-44b1-a0e4-0a5b34c29926 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:25:17.492045 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0e156-13e0-44b1-a0e4-0a5b34c29926 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:25:17.502486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 685/1376] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:25:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:25:19.029332 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11a6d2-fe98-4f34-a266-fc731d11d861 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:19.029964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11a6d2-fe98-4f34-a266-fc731d11d861 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:19.029964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11a6d2-fe98-4f34-a266-fc731d11d861 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:19.031437 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 692/1377] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:25:19.037644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bad54b-fd72-4e75-9bd5-42129f19dee4 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:19.038283 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bad54b-fd72-4e75-9bd5-42129f19dee4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:19.038283 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bad54b-fd72-4e75-9bd5-42129f19dee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:19.057932 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f9bad54b-fd72-4e75-9bd5-42129f19dee4 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:19.059252 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f9bad54b-fd72-4e75-9bd5-42129f19dee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:19.068425 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 686/1378] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:25:19.117537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11a6d2-fe98-4f34-a266-fc731d11d861 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:25:19.134663 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11a6d2-fe98-4f34-a266-fc731d11d861 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:25:19.140495 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9253e41-60bc-49a3-97c0-9bd5296a66fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:25:19.141083 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9253e41-60bc-49a3-97c0-9bd5296a66fe service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:19.141605 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9253e41-60bc-49a3-97c0-9bd5296a66fe service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:19.142192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9253e41-60bc-49a3-97c0-9bd5296a66fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:19.151885 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9253e41-60bc-49a3-97c0-9bd5296a66fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:25:19.153550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9253e41-60bc-49a3-97c0-9bd5296a66fe service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:25:19.165276 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 693/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:25:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:25:21.471410 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917bdd9-53e8-4dfb-932e-c4903d00596c None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:21.472361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917bdd9-53e8-4dfb-932e-c4903d00596c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:21.472672 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917bdd9-53e8-4dfb-932e-c4903d00596c None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:21.474088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 687/1380] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:25:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:25:21.479707 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f87ed-c234-4c81-9ce2-42661621fcaf None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:21.480289 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f87ed-c234-4c81-9ce2-42661621fcaf None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:21.480289 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f87ed-c234-4c81-9ce2-42661621fcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:21.499275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-a58f87ed-c234-4c81-9ce2-42661621fcaf None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:21.500485 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-a58f87ed-c234-4c81-9ce2-42661621fcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:21.514923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 694/1381] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:25:21.559925 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917bdd9-53e8-4dfb-932e-c4903d00596c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:25:21.576807 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917bdd9-53e8-4dfb-932e-c4903d00596c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:25:21.582672 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb343da4-82e2-4738-8e20-f9d61add59a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:25:21.583443 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb343da4-82e2-4738-8e20-f9d61add59a1 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:21.583844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb343da4-82e2-4738-8e20-f9d61add59a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:21.584481 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb343da4-82e2-4738-8e20-f9d61add59a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:21.595611 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb343da4-82e2-4738-8e20-f9d61add59a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:25:21.598526 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb343da4-82e2-4738-8e20-f9d61add59a1 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:25:21.610456 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 688/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:25:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:25:23.907685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648073e-af45-4d44-9519-09df2c716a92 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:23.908251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648073e-af45-4d44-9519-09df2c716a92 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:23.908251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648073e-af45-4d44-9519-09df2c716a92 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:23.909664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 695/1383] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:25:23.915501 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cccb2-7a67-47da-ab49-3b53a3518fab None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:23.915993 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cccb2-7a67-47da-ab49-3b53a3518fab None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:23.916104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cccb2-7a67-47da-ab49-3b53a3518fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:23.941191 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-8c0cccb2-7a67-47da-ab49-3b53a3518fab None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:23.943423 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8c0cccb2-7a67-47da-ab49-3b53a3518fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:23.952767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 689/1384] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:25:23.999630 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648073e-af45-4d44-9519-09df2c716a92 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:25:24.014831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648073e-af45-4d44-9519-09df2c716a92 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:25:24.021932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30500fd8-0997-494e-ac83-c97685d334a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:25:24.021932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30500fd8-0997-494e-ac83-c97685d334a8 service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:24.021932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30500fd8-0997-494e-ac83-c97685d334a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:24.022599 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30500fd8-0997-494e-ac83-c97685d334a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:24.032419 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30500fd8-0997-494e-ac83-c97685d334a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:25:24.034172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30500fd8-0997-494e-ac83-c97685d334a8 service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:25:24.046558 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 696/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:25:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:25:26.468674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08121297-430d-4159-9f9c-4f137343c41d None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:26.469679 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08121297-430d-4159-9f9c-4f137343c41d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:26.469679 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08121297-430d-4159-9f9c-4f137343c41d None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:26.471579 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 690/1386] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:25:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:25:26.480545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c7aee-da80-4b7f-a4e6-d4370d1ae33c None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:26.481194 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c7aee-da80-4b7f-a4e6-d4370d1ae33c None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:26.481884 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c7aee-da80-4b7f-a4e6-d4370d1ae33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:26.514693 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-b01c7aee-da80-4b7f-a4e6-d4370d1ae33c None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:26.515918 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-b01c7aee-da80-4b7f-a4e6-d4370d1ae33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:26.527045 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 697/1387] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:25:26.577968 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08121297-430d-4159-9f9c-4f137343c41d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:25:26.595964 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08121297-430d-4159-9f9c-4f137343c41d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:25:26.602714 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ce90d-b459-4ba6-a86d-a62bedb6c99c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:25:26.603484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ce90d-b459-4ba6-a86d-a62bedb6c99c service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:26.603769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ce90d-b459-4ba6-a86d-a62bedb6c99c service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:26.604046 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ce90d-b459-4ba6-a86d-a62bedb6c99c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:26.613071 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ce90d-b459-4ba6-a86d-a62bedb6c99c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:25:26.614713 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ce90d-b459-4ba6-a86d-a62bedb6c99c service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:25:26.625577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 691/1388] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:25:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:25:29.050994 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b142038-6a02-4989-a3a3-f7bbdc4a77ae None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:29.052015 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b142038-6a02-4989-a3a3-f7bbdc4a77ae None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:29.052015 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b142038-6a02-4989-a3a3-f7bbdc4a77ae None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:29.052940 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 698/1389] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:25:29.063327 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7a1df-1afe-482a-81dd-01acae7033e5 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:29.063849 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7a1df-1afe-482a-81dd-01acae7033e5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:29.063962 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7a1df-1afe-482a-81dd-01acae7033e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:29.083853 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-dbe7a1df-1afe-482a-81dd-01acae7033e5 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:29.085109 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-dbe7a1df-1afe-482a-81dd-01acae7033e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:29.095826 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 692/1390] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:25:29.146242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b142038-6a02-4989-a3a3-f7bbdc4a77ae None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:25:29.161819 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b142038-6a02-4989-a3a3-f7bbdc4a77ae None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:25:29.167460 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed62ab-8d17-4828-916b-4f770be70f31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:25:29.168112 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed62ab-8d17-4828-916b-4f770be70f31 service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:29.168430 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed62ab-8d17-4828-916b-4f770be70f31 service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:29.168730 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed62ab-8d17-4828-916b-4f770be70f31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:29.178455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed62ab-8d17-4828-916b-4f770be70f31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:25:29.180118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed62ab-8d17-4828-916b-4f770be70f31 service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:25:29.191459 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 699/1391] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:25:31.729662 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba01a5-3078-4e07-9242-242ef502447c None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:31.730269 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba01a5-3078-4e07-9242-242ef502447c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:31.730269 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba01a5-3078-4e07-9242-242ef502447c None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:31.731651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 693/1392] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:25:31.738258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fc30a-d749-4fd4-996d-ef922c53635d None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:31.739133 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fc30a-d749-4fd4-996d-ef922c53635d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:31.739133 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fc30a-d749-4fd4-996d-ef922c53635d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:31.757170 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-556fc30a-d749-4fd4-996d-ef922c53635d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:31.758396 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-556fc30a-d749-4fd4-996d-ef922c53635d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:31.767073 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 700/1393] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:25:31.816206 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba01a5-3078-4e07-9242-242ef502447c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:25:31.830989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba01a5-3078-4e07-9242-242ef502447c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:25:31.837854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cc7ac-0ee3-4d5d-a8ca-3d8a11d9fe87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:25:31.838538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cc7ac-0ee3-4d5d-a8ca-3d8a11d9fe87 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:31.838832 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cc7ac-0ee3-4d5d-a8ca-3d8a11d9fe87 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:31.839110 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cc7ac-0ee3-4d5d-a8ca-3d8a11d9fe87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:31.849025 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cc7ac-0ee3-4d5d-a8ca-3d8a11d9fe87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:25:31.850756 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cc7ac-0ee3-4d5d-a8ca-3d8a11d9fe87 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:25:31.861226 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 694/1394] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:25:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:25:33.691713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948784-72f9-440c-bd28-0b13450d1a2e None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:33.692300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948784-72f9-440c-bd28-0b13450d1a2e None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:33.692300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948784-72f9-440c-bd28-0b13450d1a2e None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:33.694227 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 701/1395] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:25:33.700034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00ee36-9393-4381-8c17-7a2d06854cad None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:33.700531 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00ee36-9393-4381-8c17-7a2d06854cad None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:33.700751 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00ee36-9393-4381-8c17-7a2d06854cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:33.707273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=52 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:25:33.721237 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ea00ee36-9393-4381-8c17-7a2d06854cad None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:33.722998 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ea00ee36-9393-4381-8c17-7a2d06854cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:33.731266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 695/1396] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:25:33.793331 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64281402-20ba-4ff2-b608-4d6a6d37b1f8 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:33.793618 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64281402-20ba-4ff2-b608-4d6a6d37b1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:33.793904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64281402-20ba-4ff2-b608-4d6a6d37b1f8 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:33.795447 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 702/1397] 10.222.0.25 () {54 vars in 962 bytes} [Mon May 23 12:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:25:33.801015 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a3b90-4500-425c-a77c-141160cb1ed3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:33.801452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a3b90-4500-425c-a77c-141160cb1ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:33.802396 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a3b90-4500-425c-a77c-141160cb1ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:33.856690 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-af5a3b90-4500-425c-a77c-141160cb1ed3 None None] MFA Rules not processed for user `8ed824e419544b33a2c4413da4b45aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:33.857915 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-af5a3b90-4500-425c-a77c-141160cb1ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:33.923169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 696/1398] 10.222.0.25 () {58 vars in 1059 bytes} [Mon May 23 12:25:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:25:33.931000 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64281402-20ba-4ff2-b608-4d6a6d37b1f8 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:25:33.943216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64281402-20ba-4ff2-b608-4d6a6d37b1f8 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:25:33.947351 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fe868-3a6d-4e85-87d9-64ac029dc2ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ed824e419544b33a2c4413da4b45aaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:25:33.948028 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fe868-3a6d-4e85-87d9-64ac029dc2ad service glance] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:33.948317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fe868-3a6d-4e85-87d9-64ac029dc2ad service glance] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:33.948598 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fe868-3a6d-4e85-87d9-64ac029dc2ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:33.959654 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482fe868-3a6d-4e85-87d9-64ac029dc2ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:25:33.961150 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482fe868-3a6d-4e85-87d9-64ac029dc2ad service glance] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:25:33.972611 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 703/1399] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:25:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:25:34.143752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcebeb5-743e-4ed6-8f1d-90697347f290 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:34.144057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcebeb5-743e-4ed6-8f1d-90697347f290 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:34.144362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcebeb5-743e-4ed6-8f1d-90697347f290 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:34.145719 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 697/1400] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:25:34.151210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d351e1-0066-4b18-9d92-f9725d4cdb7f None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:34.151503 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d351e1-0066-4b18-9d92-f9725d4cdb7f None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:34.151788 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d351e1-0066-4b18-9d92-f9725d4cdb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:34.170777 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-a4d351e1-0066-4b18-9d92-f9725d4cdb7f None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:34.172012 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-a4d351e1-0066-4b18-9d92-f9725d4cdb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:34.187571 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 704/1401] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:25:34.235063 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcebeb5-743e-4ed6-8f1d-90697347f290 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:25:34.258850 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcebeb5-743e-4ed6-8f1d-90697347f290 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:25:34.264398 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19198f36-bc68-4668-a413-7074ad599e74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:25:34.265139 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19198f36-bc68-4668-a413-7074ad599e74 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:34.265411 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19198f36-bc68-4668-a413-7074ad599e74 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:34.265792 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19198f36-bc68-4668-a413-7074ad599e74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:34.277201 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19198f36-bc68-4668-a413-7074ad599e74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:25:34.278856 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19198f36-bc68-4668-a413-7074ad599e74 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:25:34.288939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 698/1402] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:25:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:25:34.547175 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6b883-4b43-43cb-ba15-5e6e1d717c97 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:34.547475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6b883-4b43-43cb-ba15-5e6e1d717c97 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:34.547764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6b883-4b43-43cb-ba15-5e6e1d717c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:34.610787 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-e2c6b883-4b43-43cb-ba15-5e6e1d717c97 None None] MFA Rules not processed for user `eb30fc9bc5a04139b2a364ff03f4ad60`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:34.612224 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e2c6b883-4b43-43cb-ba15-5e6e1d717c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:34.654608 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:25:34.691069 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 705/1403] 10.222.0.25 () {58 vars in 1009 bytes} [Mon May 23 12:25:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:25:34.741015 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fee26-fbdb-4554-8a12-db2ae63d26ec None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:34.741571 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fee26-fbdb-4554-8a12-db2ae63d26ec None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:34.741571 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fee26-fbdb-4554-8a12-db2ae63d26ec None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:34.743077 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 699/1404] 10.222.0.25 () {54 vars in 942 bytes} [Mon May 23 12:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:25:34.750342 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471333c4-6fb2-4a19-866d-eaab6348ba2e None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:34.750943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471333c4-6fb2-4a19-866d-eaab6348ba2e None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:34.750943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471333c4-6fb2-4a19-866d-eaab6348ba2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:34.810009 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-471333c4-6fb2-4a19-866d-eaab6348ba2e None None] MFA Rules not processed for user `03ca1edc22174d258ddeda25407ee6ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:34.811267 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-471333c4-6fb2-4a19-866d-eaab6348ba2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:34.896851 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 706/1405] 10.222.0.25 () {58 vars in 1039 bytes} [Mon May 23 12:25:34 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:25:34.906202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fee26-fbdb-4554-8a12-db2ae63d26ec None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:25:34.920854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fee26-fbdb-4554-8a12-db2ae63d26ec None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:25:34.926410 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f1837-954e-4fba-828d-dfe3ac76842e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03ca1edc22174d258ddeda25407ee6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:25:34.927925 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f1837-954e-4fba-828d-dfe3ac76842e service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:34.927925 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f1837-954e-4fba-828d-dfe3ac76842e service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:34.927925 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f1837-954e-4fba-828d-dfe3ac76842e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:34.936471 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f1837-954e-4fba-828d-dfe3ac76842e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:25:34.938083 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f1837-954e-4fba-828d-dfe3ac76842e service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:25:34.947751 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 700/1406] 10.222.0.25 () {60 vars in 1384 bytes} [Mon May 23 12:25:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:25:36.704878 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91c05e-4453-46e2-a3c8-8abb6ec38d20 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:36.705455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91c05e-4453-46e2-a3c8-8abb6ec38d20 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:36.705455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91c05e-4453-46e2-a3c8-8abb6ec38d20 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:36.706902 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 707/1407] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:25:36.713938 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf102cd4-c141-4dc4-b500-1a5e3f88005f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:36.714607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf102cd4-c141-4dc4-b500-1a5e3f88005f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:36.714607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf102cd4-c141-4dc4-b500-1a5e3f88005f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:36.734936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-bf102cd4-c141-4dc4-b500-1a5e3f88005f None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:36.736177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bf102cd4-c141-4dc4-b500-1a5e3f88005f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:36.754793 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 701/1408] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:25:36.797455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91c05e-4453-46e2-a3c8-8abb6ec38d20 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:25:36.814588 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91c05e-4453-46e2-a3c8-8abb6ec38d20 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:25:36.820866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d98f4-16b7-4081-923a-ec1dade0bed0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:25:36.821581 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d98f4-16b7-4081-923a-ec1dade0bed0 service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:36.821813 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d98f4-16b7-4081-923a-ec1dade0bed0 service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:36.822098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d98f4-16b7-4081-923a-ec1dade0bed0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:36.832380 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d98f4-16b7-4081-923a-ec1dade0bed0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:25:36.834093 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d98f4-16b7-4081-923a-ec1dade0bed0 service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:25:36.845142 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 708/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:25:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:25:46.728922 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=55 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:25:46.839882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=62 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:25:58.428923 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a0177-dfa7-4d6f-92f8-83234e8454a6 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:58.429540 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a0177-dfa7-4d6f-92f8-83234e8454a6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:58.429540 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a0177-dfa7-4d6f-92f8-83234e8454a6 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:58.430836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 702/1410] 10.222.0.25 () {54 vars in 918 bytes} [Mon May 23 12:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:25:58.436226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dfddf-9366-4493-8a79-e83dc437cdc0 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:58.436778 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dfddf-9366-4493-8a79-e83dc437cdc0 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:58.436778 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dfddf-9366-4493-8a79-e83dc437cdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:58.461140 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-020dfddf-9366-4493-8a79-e83dc437cdc0 None None] MFA Rules not processed for user `a3fde90ab1e0490ebb7cb514173d984e`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:58.462941 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-020dfddf-9366-4493-8a79-e83dc437cdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:58.473108 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 709/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Mon May 23 12:25:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:25:58.488700 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d851c-a4c8-487e-9f6b-9cd02e261936 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:58.488989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d851c-a4c8-487e-9f6b-9cd02e261936 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:58.489356 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d851c-a4c8-487e-9f6b-9cd02e261936 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:58.490660 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 703/1412] 10.222.0.25 () {54 vars in 918 bytes} [Mon May 23 12:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:25:58.498131 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a972d-8ceb-4d10-9640-f746c821b1af None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:25:58.498532 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a972d-8ceb-4d10-9640-f746c821b1af None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:25:58.498833 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a972d-8ceb-4d10-9640-f746c821b1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:25:58.518556 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-a25a972d-8ceb-4d10-9640-f746c821b1af None None] MFA Rules not processed for user `d49997b9108145b78eb4db1d8823bf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:25:58.519764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-a25a972d-8ceb-4d10-9640-f746c821b1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:25:58.528818 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 710/1413] 10.222.0.25 () {58 vars in 1015 bytes} [Mon May 23 12:25:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:26:01.343415 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694efb0-f3b4-4eac-af3e-a02b705ed285 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:01.343960 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694efb0-f3b4-4eac-af3e-a02b705ed285 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:01.344299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694efb0-f3b4-4eac-af3e-a02b705ed285 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:01.345936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:26:01.352051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d2d0b-944c-4e2f-985a-6434d04d339d None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:01.352593 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d2d0b-944c-4e2f-985a-6434d04d339d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:01.352593 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d2d0b-944c-4e2f-985a-6434d04d339d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:01.372963 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-fc2d2d0b-944c-4e2f-985a-6434d04d339d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:26:01.374184 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-fc2d2d0b-944c-4e2f-985a-6434d04d339d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:26:01.384862 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:26:01.428292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694efb0-f3b4-4eac-af3e-a02b705ed285 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:26:01.443908 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694efb0-f3b4-4eac-af3e-a02b705ed285 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:26:01.449302 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a5480-6156-4097-a99c-1c3847ac6cc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:26:01.449951 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a5480-6156-4097-a99c-1c3847ac6cc6 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:01.450241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a5480-6156-4097-a99c-1c3847ac6cc6 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:01.450543 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a5480-6156-4097-a99c-1c3847ac6cc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:01.460331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a5480-6156-4097-a99c-1c3847ac6cc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:26:01.461955 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a5480-6156-4097-a99c-1c3847ac6cc6 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:26:01.472737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 705/1416] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:26:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:26:02.473757 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d7f2b-8798-4799-9733-3762350d8c80 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:02.474302 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d7f2b-8798-4799-9733-3762350d8c80 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:02.474302 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d7f2b-8798-4799-9733-3762350d8c80 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:02.475742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:26:02.480983 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbed63-3724-4fc3-b290-8b5835d64efe None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:02.481439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbed63-3724-4fc3-b290-8b5835d64efe None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:02.481621 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbed63-3724-4fc3-b290-8b5835d64efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:02.500090 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6cfbed63-3724-4fc3-b290-8b5835d64efe None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:26:02.501842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6cfbed63-3724-4fc3-b290-8b5835d64efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:26:02.509684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:26:02.677266 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d7f2b-8798-4799-9733-3762350d8c80 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:26:02.691611 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d7f2b-8798-4799-9733-3762350d8c80 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:26:02.696959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820200a-7b72-490a-b198-4bc078ed392a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:26:02.697601 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820200a-7b72-490a-b198-4bc078ed392a service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:02.697884 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820200a-7b72-490a-b198-4bc078ed392a service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:02.698159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820200a-7b72-490a-b198-4bc078ed392a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:02.707447 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820200a-7b72-490a-b198-4bc078ed392a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:26:02.709070 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820200a-7b72-490a-b198-4bc078ed392a service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:26:02.720652 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 713/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:26:03.654556 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d9487-3557-4f71-bbe9-002944c88d7a None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:03.655131 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d9487-3557-4f71-bbe9-002944c88d7a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:03.655131 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d9487-3557-4f71-bbe9-002944c88d7a None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:03.656595 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:26:03.661789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643ab9e-d07d-4f78-8728-5d37f5f7fa5c None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:03.662260 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643ab9e-d07d-4f78-8728-5d37f5f7fa5c None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:03.662355 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643ab9e-d07d-4f78-8728-5d37f5f7fa5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:03.681285 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-1643ab9e-d07d-4f78-8728-5d37f5f7fa5c None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:26:03.682489 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-1643ab9e-d07d-4f78-8728-5d37f5f7fa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:26:03.690851 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:26:03.841918 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d9487-3557-4f71-bbe9-002944c88d7a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:26:03.857012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d9487-3557-4f71-bbe9-002944c88d7a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:26:03.862983 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbab65e-99ee-47dc-8fcb-2f465ea18ab2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:26:03.863633 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbab65e-99ee-47dc-8fcb-2f465ea18ab2 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:03.864083 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbab65e-99ee-47dc-8fcb-2f465ea18ab2 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:03.864377 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbab65e-99ee-47dc-8fcb-2f465ea18ab2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:03.873119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbab65e-99ee-47dc-8fcb-2f465ea18ab2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:26:03.874768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbab65e-99ee-47dc-8fcb-2f465ea18ab2 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:26:03.887208 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 708/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:26:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:26:04.796484 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3787ffe-a3b2-411a-b7b1-87a9b31d6cdc None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:04.797067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3787ffe-a3b2-411a-b7b1-87a9b31d6cdc None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:04.797203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3787ffe-a3b2-411a-b7b1-87a9b31d6cdc None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:04.799216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:26:04.806219 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7f9b4-a90a-4dd3-9597-1101bb89b2bd None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:04.806939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7f9b4-a90a-4dd3-9597-1101bb89b2bd None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:04.807143 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7f9b4-a90a-4dd3-9597-1101bb89b2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:04.825410 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-58f7f9b4-a90a-4dd3-9597-1101bb89b2bd None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:26:04.826663 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-58f7f9b4-a90a-4dd3-9597-1101bb89b2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:26:04.837966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:26:04.987702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3787ffe-a3b2-411a-b7b1-87a9b31d6cdc None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:26:05.002567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3787ffe-a3b2-411a-b7b1-87a9b31d6cdc None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:26:05.007984 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff9d2a-4307-40ec-987b-ef15604db698 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:26:05.008657 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff9d2a-4307-40ec-987b-ef15604db698 service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:05.008944 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff9d2a-4307-40ec-987b-ef15604db698 service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:05.009220 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff9d2a-4307-40ec-987b-ef15604db698 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:05.018445 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff9d2a-4307-40ec-987b-ef15604db698 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:26:05.020091 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff9d2a-4307-40ec-987b-ef15604db698 service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:26:05.029881 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 716/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:26:05.956706 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b90105-07d6-4cf1-9409-b7eb06eecfb9 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:05.957308 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b90105-07d6-4cf1-9409-b7eb06eecfb9 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:05.957308 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b90105-07d6-4cf1-9409-b7eb06eecfb9 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:05.958657 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:26:05.963807 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48701fd6-7b65-4092-ae21-f048c82ff2d8 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:05.964265 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48701fd6-7b65-4092-ae21-f048c82ff2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:05.964357 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48701fd6-7b65-4092-ae21-f048c82ff2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:05.983420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-48701fd6-7b65-4092-ae21-f048c82ff2d8 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:26:05.984649 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-48701fd6-7b65-4092-ae21-f048c82ff2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:26:05.993254 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:26:06.143413 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b90105-07d6-4cf1-9409-b7eb06eecfb9 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:26:06.158436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b90105-07d6-4cf1-9409-b7eb06eecfb9 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:26:06.164260 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16484fe6-9e40-4e23-9195-abe7b767f00d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:26:06.164930 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16484fe6-9e40-4e23-9195-abe7b767f00d service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:06.165220 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16484fe6-9e40-4e23-9195-abe7b767f00d service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:06.165500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16484fe6-9e40-4e23-9195-abe7b767f00d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:06.174809 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16484fe6-9e40-4e23-9195-abe7b767f00d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:26:06.176479 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16484fe6-9e40-4e23-9195-abe7b767f00d service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:26:06.187003 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 711/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:26:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:26:07.043293 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaba81d-299a-4abb-9a08-ae70b58d2329 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:07.043842 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaba81d-299a-4abb-9a08-ae70b58d2329 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:07.043842 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaba81d-299a-4abb-9a08-ae70b58d2329 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:07.045221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:26:07.051058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cf88c-e309-4fbb-ace7-da7bed1613c6 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:07.051549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cf88c-e309-4fbb-ace7-da7bed1613c6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:07.051699 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cf88c-e309-4fbb-ace7-da7bed1613c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:07.070694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2b5cf88c-e309-4fbb-ace7-da7bed1613c6 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:26:07.071967 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2b5cf88c-e309-4fbb-ace7-da7bed1613c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:26:07.081377 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:26:07.231844 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaba81d-299a-4abb-9a08-ae70b58d2329 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:26:07.248546 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaba81d-299a-4abb-9a08-ae70b58d2329 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:26:07.254588 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f493c2-18d0-4dcf-9a4e-0e053c756ed5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:26:07.255250 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f493c2-18d0-4dcf-9a4e-0e053c756ed5 service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:07.255564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f493c2-18d0-4dcf-9a4e-0e053c756ed5 service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:07.255845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f493c2-18d0-4dcf-9a4e-0e053c756ed5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:07.264762 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f493c2-18d0-4dcf-9a4e-0e053c756ed5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:26:07.267304 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f493c2-18d0-4dcf-9a4e-0e053c756ed5 service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:26:07.277117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 719/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:26:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:26:08.132753 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d821c-01fa-4704-b381-e61772842850 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:08.133338 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d821c-01fa-4704-b381-e61772842850 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:08.133338 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d821c-01fa-4704-b381-e61772842850 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:08.134708 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:26:08.139743 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a481efc-d106-46e6-a975-33040d918d88 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:08.140233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a481efc-d106-46e6-a975-33040d918d88 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:08.140365 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a481efc-d106-46e6-a975-33040d918d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:08.160471 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-8a481efc-d106-46e6-a975-33040d918d88 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:26:08.161731 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-8a481efc-d106-46e6-a975-33040d918d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:26:08.169621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:26:08.320694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d821c-01fa-4704-b381-e61772842850 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:26:08.335663 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d821c-01fa-4704-b381-e61772842850 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:26:08.342215 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa8385-fd5d-451f-bbaf-e53837367fc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:26:08.342900 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa8385-fd5d-451f-bbaf-e53837367fc3 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:08.343190 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa8385-fd5d-451f-bbaf-e53837367fc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:08.343470 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa8385-fd5d-451f-bbaf-e53837367fc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:08.352542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa8385-fd5d-451f-bbaf-e53837367fc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:26:08.354180 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa8385-fd5d-451f-bbaf-e53837367fc3 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:26:08.364268 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 714/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:26:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:26:09.238872 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5b0c1-f906-4272-965a-6db2b4bc242c None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:09.239472 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5b0c1-f906-4272-965a-6db2b4bc242c None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:09.239472 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5b0c1-f906-4272-965a-6db2b4bc242c None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:09.240792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:26:09.246040 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ceb22-7a89-4911-a9cb-c15c70303724 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:09.246487 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ceb22-7a89-4911-a9cb-c15c70303724 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:09.246625 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ceb22-7a89-4911-a9cb-c15c70303724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:09.264487 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-791ceb22-7a89-4911-a9cb-c15c70303724 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:26:09.265705 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-791ceb22-7a89-4911-a9cb-c15c70303724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:26:09.273626 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:26:09.426332 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5b0c1-f906-4272-965a-6db2b4bc242c None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:26:09.443499 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5b0c1-f906-4272-965a-6db2b4bc242c None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:26:09.449171 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd302b-c0b1-4295-ae6c-16fa593974c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:26:09.449831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd302b-c0b1-4295-ae6c-16fa593974c3 service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:09.450125 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd302b-c0b1-4295-ae6c-16fa593974c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:09.450405 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd302b-c0b1-4295-ae6c-16fa593974c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:09.460294 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd302b-c0b1-4295-ae6c-16fa593974c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:26:09.461907 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd302b-c0b1-4295-ae6c-16fa593974c3 service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:26:09.472797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 722/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:26:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:26:10.333130 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81ed06-404b-4ced-aaf2-040060cc4630 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:10.333677 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81ed06-404b-4ced-aaf2-040060cc4630 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:10.333891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81ed06-404b-4ced-aaf2-040060cc4630 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:10.335398 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:26:10.340957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10c08a-6d54-42c5-9c0a-ad7d9221bfe9 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:10.341414 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10c08a-6d54-42c5-9c0a-ad7d9221bfe9 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:10.341511 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10c08a-6d54-42c5-9c0a-ad7d9221bfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:10.365717 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-9c10c08a-6d54-42c5-9c0a-ad7d9221bfe9 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:26:10.367026 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-9c10c08a-6d54-42c5-9c0a-ad7d9221bfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:26:10.374915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:26:10.527657 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81ed06-404b-4ced-aaf2-040060cc4630 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:26:10.543248 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81ed06-404b-4ced-aaf2-040060cc4630 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:26:10.549757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544dd6a9-a059-4787-9ead-b9f96b8c0c00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:26:10.550406 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dd6a9-a059-4787-9ead-b9f96b8c0c00 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:10.550793 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dd6a9-a059-4787-9ead-b9f96b8c0c00 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:10.551075 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dd6a9-a059-4787-9ead-b9f96b8c0c00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:10.560003 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544dd6a9-a059-4787-9ead-b9f96b8c0c00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:26:10.561621 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544dd6a9-a059-4787-9ead-b9f96b8c0c00 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:26:10.572195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 717/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:26:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:26:12.680199 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa549d1-1a9f-491b-8c9a-6ac165f03e67 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:12.680777 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa549d1-1a9f-491b-8c9a-6ac165f03e67 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:12.680777 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa549d1-1a9f-491b-8c9a-6ac165f03e67 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:12.682141 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:26:12.688224 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1b1f7-ec29-4592-88ce-265720335da0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:12.688727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1b1f7-ec29-4592-88ce-265720335da0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:12.688841 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1b1f7-ec29-4592-88ce-265720335da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:12.707872 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-efb1b1f7-ec29-4592-88ce-265720335da0 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:26:12.709134 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-efb1b1f7-ec29-4592-88ce-265720335da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:26:12.718728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:26:12.757479 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa549d1-1a9f-491b-8c9a-6ac165f03e67 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:26:12.768932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa549d1-1a9f-491b-8c9a-6ac165f03e67 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:26:12.772405 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdc09b-7520-4686-9eb5-9e7b0cf72b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:26:12.773046 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdc09b-7520-4686-9eb5-9e7b0cf72b1f service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:12.773333 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdc09b-7520-4686-9eb5-9e7b0cf72b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:12.773609 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdc09b-7520-4686-9eb5-9e7b0cf72b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:12.783507 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cdc09b-7520-4686-9eb5-9e7b0cf72b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:26:12.784950 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cdc09b-7520-4686-9eb5-9e7b0cf72b1f service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:26:12.794988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 725/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:26:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:26:15.211612 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd8a8d-8627-4e22-b801-d33a235bbe88 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:15.212094 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd8a8d-8627-4e22-b801-d33a235bbe88 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:15.212191 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd8a8d-8627-4e22-b801-d33a235bbe88 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:15.213628 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:26:15.219882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434625c0-9161-4b86-91b0-59281b4bebc2 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:15.220293 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434625c0-9161-4b86-91b0-59281b4bebc2 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:15.220472 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434625c0-9161-4b86-91b0-59281b4bebc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:15.237757 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-434625c0-9161-4b86-91b0-59281b4bebc2 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:26:15.238982 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-434625c0-9161-4b86-91b0-59281b4bebc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:26:15.246572 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:26:15.284624 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd8a8d-8627-4e22-b801-d33a235bbe88 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:26:15.295149 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd8a8d-8627-4e22-b801-d33a235bbe88 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:26:15.299267 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db8132-d28a-4ab9-91a7-ff3a390e7cbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:26:15.299898 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db8132-d28a-4ab9-91a7-ff3a390e7cbf service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:15.300202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db8132-d28a-4ab9-91a7-ff3a390e7cbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:15.300462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db8132-d28a-4ab9-91a7-ff3a390e7cbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:15.309232 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db8132-d28a-4ab9-91a7-ff3a390e7cbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:26:15.310714 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db8132-d28a-4ab9-91a7-ff3a390e7cbf service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:26:15.320172 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 720/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:26:17.865565 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b43b7a-c0da-4d3c-9ea5-364fe310ba68 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:17.866109 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b43b7a-c0da-4d3c-9ea5-364fe310ba68 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:17.866109 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b43b7a-c0da-4d3c-9ea5-364fe310ba68 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:17.867535 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:26:17.872779 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570a3eb-27f5-452d-a5ef-bde99ba22171 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:17.873190 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570a3eb-27f5-452d-a5ef-bde99ba22171 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:17.873337 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570a3eb-27f5-452d-a5ef-bde99ba22171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:17.892033 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2570a3eb-27f5-452d-a5ef-bde99ba22171 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:26:17.893217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2570a3eb-27f5-452d-a5ef-bde99ba22171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:26:17.900811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:26:17.939247 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b43b7a-c0da-4d3c-9ea5-364fe310ba68 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:26:17.953744 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b43b7a-c0da-4d3c-9ea5-364fe310ba68 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:26:17.957279 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe51014-3c75-40d0-9bb2-7f77f821cc98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:26:17.957916 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe51014-3c75-40d0-9bb2-7f77f821cc98 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:17.958200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe51014-3c75-40d0-9bb2-7f77f821cc98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:17.958532 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe51014-3c75-40d0-9bb2-7f77f821cc98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:17.967585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe51014-3c75-40d0-9bb2-7f77f821cc98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:26:17.969542 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe51014-3c75-40d0-9bb2-7f77f821cc98 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:26:17.978688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 728/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:26:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:26:20.303478 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070280c6-64ba-4059-8278-3c0778933b5f None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:20.304081 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070280c6-64ba-4059-8278-3c0778933b5f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:20.304081 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070280c6-64ba-4059-8278-3c0778933b5f None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:20.305402 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:26:20.310609 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb830f-ebd9-4be8-9e47-55e85e261f7d None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:20.311008 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb830f-ebd9-4be8-9e47-55e85e261f7d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:20.311181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb830f-ebd9-4be8-9e47-55e85e261f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:20.328693 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-68bb830f-ebd9-4be8-9e47-55e85e261f7d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:26:20.329900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-68bb830f-ebd9-4be8-9e47-55e85e261f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:26:20.337856 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:26:20.376783 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070280c6-64ba-4059-8278-3c0778933b5f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:26:20.387498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070280c6-64ba-4059-8278-3c0778933b5f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:26:20.391025 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60128c3-114c-461f-9a35-1eca9b511ed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:26:20.391658 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60128c3-114c-461f-9a35-1eca9b511ed6 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:20.391944 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60128c3-114c-461f-9a35-1eca9b511ed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:20.392224 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60128c3-114c-461f-9a35-1eca9b511ed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:20.401131 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60128c3-114c-461f-9a35-1eca9b511ed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:26:20.402612 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60128c3-114c-461f-9a35-1eca9b511ed6 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:26:20.412485 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 723/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:26:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:26:22.661664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f89be-8dca-4c40-800c-e75d51aa52b0 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:22.662233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f89be-8dca-4c40-800c-e75d51aa52b0 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:22.662233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f89be-8dca-4c40-800c-e75d51aa52b0 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:22.663644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:26:22.668911 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd64cf-bed3-48ca-b0ba-4919a37993c4 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:22.669362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd64cf-bed3-48ca-b0ba-4919a37993c4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:22.669483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd64cf-bed3-48ca-b0ba-4919a37993c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:22.687561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6bfd64cf-bed3-48ca-b0ba-4919a37993c4 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:26:22.688783 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6bfd64cf-bed3-48ca-b0ba-4919a37993c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:26:22.696483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:26:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:26:22.735859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f89be-8dca-4c40-800c-e75d51aa52b0 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:26:22.737555 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-507f89be-8dca-4c40-800c-e75d51aa52b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:26:22.750302 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f89be-8dca-4c40-800c-e75d51aa52b0 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:26:22.753820 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d07c9-5398-484c-9fce-4e0d33858b45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:26:22.754453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d07c9-5398-484c-9fce-4e0d33858b45 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:22.754771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d07c9-5398-484c-9fce-4e0d33858b45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:22.755125 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d07c9-5398-484c-9fce-4e0d33858b45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:22.763892 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d07c9-5398-484c-9fce-4e0d33858b45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:26:22.765381 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d07c9-5398-484c-9fce-4e0d33858b45 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:26:22.774719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 731/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:26:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:26:25.127832 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e9b89-f20c-4afe-b790-31fc110dd505 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:25.128451 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e9b89-f20c-4afe-b790-31fc110dd505 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:25.128451 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e9b89-f20c-4afe-b790-31fc110dd505 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:25.129846 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:26:25.135989 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25d646-c80e-4940-9c8d-3233c928bd0e None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:25.136540 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25d646-c80e-4940-9c8d-3233c928bd0e None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:25.136540 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25d646-c80e-4940-9c8d-3233c928bd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:25.155415 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-da25d646-c80e-4940-9c8d-3233c928bd0e None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:26:25.157200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-da25d646-c80e-4940-9c8d-3233c928bd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:26:25.165129 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:26:25.203205 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e9b89-f20c-4afe-b790-31fc110dd505 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:26:25.213742 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e9b89-f20c-4afe-b790-31fc110dd505 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:26:25.217460 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5462e2-5849-4fc2-b5ea-1d54a70c021c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:26:25.218134 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5462e2-5849-4fc2-b5ea-1d54a70c021c service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:25.218948 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5462e2-5849-4fc2-b5ea-1d54a70c021c service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:25.219234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5462e2-5849-4fc2-b5ea-1d54a70c021c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:25.228054 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5462e2-5849-4fc2-b5ea-1d54a70c021c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:26:25.229519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5462e2-5849-4fc2-b5ea-1d54a70c021c service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:26:25.239418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 726/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:26:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:26:27.488461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725df66-866f-4f69-80e1-b9d8c7065a2e None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:27.489019 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725df66-866f-4f69-80e1-b9d8c7065a2e None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:27.489019 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725df66-866f-4f69-80e1-b9d8c7065a2e None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:27.490279 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:26:27.496695 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8750a-f10f-4e82-9602-319ad3fd892b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:27.497173 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8750a-f10f-4e82-9602-319ad3fd892b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:27.497278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8750a-f10f-4e82-9602-319ad3fd892b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:27.503951 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=70 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:26:27.517084 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a1d8750a-f10f-4e82-9602-319ad3fd892b None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:26:27.518286 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a1d8750a-f10f-4e82-9602-319ad3fd892b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:26:27.526658 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:26:27.565499 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725df66-866f-4f69-80e1-b9d8c7065a2e None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:26:27.571009 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=73 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:26:27.578191 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725df66-866f-4f69-80e1-b9d8c7065a2e None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:26:27.581801 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6c04d-2785-482c-822e-a22bc3339009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:26:27.582490 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6c04d-2785-482c-822e-a22bc3339009 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:27.582810 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6c04d-2785-482c-822e-a22bc3339009 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:27.583091 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6c04d-2785-482c-822e-a22bc3339009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:27.593566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6c04d-2785-482c-822e-a22bc3339009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:26:27.596177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6c04d-2785-482c-822e-a22bc3339009 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:26:27.608054 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 734/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:26:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:26:29.993213 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f34fdb-5d3e-4c9e-a6e0-16f74737ad5e None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:29.993799 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f34fdb-5d3e-4c9e-a6e0-16f74737ad5e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:29.993799 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f34fdb-5d3e-4c9e-a6e0-16f74737ad5e None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:29.995206 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:26:30.001675 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7dce02-199b-44d9-a0a0-933f24d6a8f9 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:30.002207 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7dce02-199b-44d9-a0a0-933f24d6a8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:30.002316 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7dce02-199b-44d9-a0a0-933f24d6a8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:30.020050 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-ac7dce02-199b-44d9-a0a0-933f24d6a8f9 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:26:30.021278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ac7dce02-199b-44d9-a0a0-933f24d6a8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:26:30.029133 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:26:30.067382 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f34fdb-5d3e-4c9e-a6e0-16f74737ad5e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:26:30.081930 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f34fdb-5d3e-4c9e-a6e0-16f74737ad5e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:26:30.085553 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e078899-087e-47e3-9e16-6d07e404cead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:26:30.095573 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e078899-087e-47e3-9e16-6d07e404cead service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:30.095573 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e078899-087e-47e3-9e16-6d07e404cead service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:30.095573 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e078899-087e-47e3-9e16-6d07e404cead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:30.097043 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e078899-087e-47e3-9e16-6d07e404cead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:26:30.098520 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e078899-087e-47e3-9e16-6d07e404cead service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:26:30.108233 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 729/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:26:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:26:32.530528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed780040-1173-4ec7-8894-694763783a15 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:32.531058 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed780040-1173-4ec7-8894-694763783a15 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:32.531164 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed780040-1173-4ec7-8894-694763783a15 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:32.533002 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:26:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:26:32.540316 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681ca6c-7043-4fad-a0a3-be5c2b5b11be None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:32.540895 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681ca6c-7043-4fad-a0a3-be5c2b5b11be None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:32.541421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681ca6c-7043-4fad-a0a3-be5c2b5b11be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:32.564275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b681ca6c-7043-4fad-a0a3-be5c2b5b11be None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:26:32.565512 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b681ca6c-7043-4fad-a0a3-be5c2b5b11be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:26:32.573302 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:26:32.611147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed780040-1173-4ec7-8894-694763783a15 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:26:32.622068 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed780040-1173-4ec7-8894-694763783a15 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:26:32.625741 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf15b6-555a-432a-88f5-d7b29105c5af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:26:32.626392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf15b6-555a-432a-88f5-d7b29105c5af service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:32.626720 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf15b6-555a-432a-88f5-d7b29105c5af service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:32.627008 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf15b6-555a-432a-88f5-d7b29105c5af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:32.636717 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf15b6-555a-432a-88f5-d7b29105c5af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:26:32.638184 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf15b6-555a-432a-88f5-d7b29105c5af service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:26:32.648988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 737/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:26:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:26:34.891488 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcacaa-f8b9-4972-84ee-ae5a083da2ea None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:34.892038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcacaa-f8b9-4972-84ee-ae5a083da2ea None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:34.892038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcacaa-f8b9-4972-84ee-ae5a083da2ea None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:34.893391 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:26:34.898959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0375975-97ec-4ba3-81b6-7d184de9c706 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:34.899409 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0375975-97ec-4ba3-81b6-7d184de9c706 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:34.899518 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0375975-97ec-4ba3-81b6-7d184de9c706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:34.917861 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-c0375975-97ec-4ba3-81b6-7d184de9c706 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:26:34.919111 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-c0375975-97ec-4ba3-81b6-7d184de9c706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:26:34.927929 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:26:34.964464 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcacaa-f8b9-4972-84ee-ae5a083da2ea None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:26:34.975223 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcacaa-f8b9-4972-84ee-ae5a083da2ea None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:26:34.978737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2f08b-d41b-48d8-a6e8-4e08856c3d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:26:34.979378 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2f08b-d41b-48d8-a6e8-4e08856c3d30 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:26:34.979671 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2f08b-d41b-48d8-a6e8-4e08856c3d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:26:34.979944 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2f08b-d41b-48d8-a6e8-4e08856c3d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:26:34.989938 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2f08b-d41b-48d8-a6e8-4e08856c3d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:26:34.991421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2f08b-d41b-48d8-a6e8-4e08856c3d30 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:26:35.002438 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 732/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:26:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:26:44.912620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=17 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:26:44.996674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=17 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:27:08.247733 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c4164-f9f2-4e1a-89c0-75c21d8fbf17 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:27:08.248328 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c4164-f9f2-4e1a-89c0-75c21d8fbf17 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:27:08.248328 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c4164-f9f2-4e1a-89c0-75c21d8fbf17 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:27:08.249667 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 739/1471] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:27:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:27:08.255207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5cd3f-1697-48ec-9429-c8b0a67e2a4f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:27:08.255703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5cd3f-1697-48ec-9429-c8b0a67e2a4f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:27:08.255821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5cd3f-1697-48ec-9429-c8b0a67e2a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:27:08.274139 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-55e5cd3f-1697-48ec-9429-c8b0a67e2a4f None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:27:08.275394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-55e5cd3f-1697-48ec-9429-c8b0a67e2a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:27:08.283360 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 733/1472] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:27:08.330186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773989fd-b25d-4625-bd32-8d43e46248ca None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:27:08.330487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773989fd-b25d-4625-bd32-8d43e46248ca None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:27:08.330796 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773989fd-b25d-4625-bd32-8d43e46248ca None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:27:08.332140 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 740/1473] 10.222.0.25 () {54 vars in 962 bytes} [Mon May 23 12:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:27:08.337126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61eac0-c79a-462d-8451-71f9f2955e31 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:27:08.337422 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61eac0-c79a-462d-8451-71f9f2955e31 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:27:08.337708 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61eac0-c79a-462d-8451-71f9f2955e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:27:08.356096 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-da61eac0-c79a-462d-8451-71f9f2955e31 None None] MFA Rules not processed for user `8ed824e419544b33a2c4413da4b45aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:27:08.357314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-da61eac0-c79a-462d-8451-71f9f2955e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:27:08.363946 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 734/1474] 10.222.0.25 () {58 vars in 1059 bytes} [Mon May 23 12:27:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:27:08.371820 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773989fd-b25d-4625-bd32-8d43e46248ca None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:27:08.382225 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773989fd-b25d-4625-bd32-8d43e46248ca None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:27:08.385733 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e649d-2e3c-42d8-91b2-fe4d67e951e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ed824e419544b33a2c4413da4b45aaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:27:08.386364 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e649d-2e3c-42d8-91b2-fe4d67e951e9 service glance] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:27:08.386696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e649d-2e3c-42d8-91b2-fe4d67e951e9 service glance] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:27:08.387909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e649d-2e3c-42d8-91b2-fe4d67e951e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:27:08.398011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e649d-2e3c-42d8-91b2-fe4d67e951e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:27:08.399493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e649d-2e3c-42d8-91b2-fe4d67e951e9 service glance] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:27:08.408941 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 741/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:27:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:27:10.789879 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeaf88-f540-4ac8-81ea-7f09438802e8 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:27:10.790491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeaf88-f540-4ac8-81ea-7f09438802e8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:27:10.790491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeaf88-f540-4ac8-81ea-7f09438802e8 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:27:10.791877 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 735/1476] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:27:10.798695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124e114-53fb-45a1-88db-ac8961cabd67 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:27:10.799203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124e114-53fb-45a1-88db-ac8961cabd67 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:27:10.799350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124e114-53fb-45a1-88db-ac8961cabd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:27:10.821777 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-3124e114-53fb-45a1-88db-ac8961cabd67 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:27:10.823041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-3124e114-53fb-45a1-88db-ac8961cabd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:27:10.831399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 742/1477] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:27:10.856139 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eeaf88-f540-4ac8-81ea-7f09438802e8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:27:10.868912 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eeaf88-f540-4ac8-81ea-7f09438802e8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:27:10.873319 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe03d44-b80c-405c-88f9-f36b0543c608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:27:10.873972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe03d44-b80c-405c-88f9-f36b0543c608 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:27:10.874253 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe03d44-b80c-405c-88f9-f36b0543c608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:27:10.874618 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe03d44-b80c-405c-88f9-f36b0543c608 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:27:10.875423 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe03d44-b80c-405c-88f9-f36b0543c608 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:27:10.877235 dv-cinder-836996-27-smb devstack@keystone.service[80198]: WARNING py.warnings [None req-1fe03d44-b80c-405c-88f9-f36b0543c608 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 12:27:10.877235 dv-cinder-836996-27-smb devstack@keystone.service[80198]: warnings.warn(msg) May 23 12:27:10.877235 dv-cinder-836996-27-smb devstack@keystone.service[80198]: May 23 12:27:10.878383 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe03d44-b80c-405c-88f9-f36b0543c608 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:27:10.899208 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 736/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Mon May 23 12:27:10 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:27:13.132526 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4711417-7671-4d8f-a117-60515ba32350 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:27:13.133108 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4711417-7671-4d8f-a117-60515ba32350 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:27:13.133108 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4711417-7671-4d8f-a117-60515ba32350 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:27:13.134495 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 743/1479] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:27:13.140654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373d7e2-e584-47f9-aff2-117df7ee339c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:27:13.141141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373d7e2-e584-47f9-aff2-117df7ee339c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:27:13.141256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373d7e2-e584-47f9-aff2-117df7ee339c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:27:13.161673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9373d7e2-e584-47f9-aff2-117df7ee339c None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:27:13.162945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9373d7e2-e584-47f9-aff2-117df7ee339c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:27:13.171051 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 737/1480] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:27:13.219596 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4711417-7671-4d8f-a117-60515ba32350 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:27:13.237462 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4711417-7671-4d8f-a117-60515ba32350 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:27:13.242857 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19999b6d-6313-4061-8f9a-0869b96fa8ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:27:13.243500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19999b6d-6313-4061-8f9a-0869b96fa8ef service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:27:13.243783 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19999b6d-6313-4061-8f9a-0869b96fa8ef service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:27:13.244057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19999b6d-6313-4061-8f9a-0869b96fa8ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:27:13.252745 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19999b6d-6313-4061-8f9a-0869b96fa8ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:27:13.254357 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19999b6d-6313-4061-8f9a-0869b96fa8ef service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:27:13.264660 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 744/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:27:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:27:15.684324 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94496bb-2244-4150-a344-b57acec95457 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:27:15.684903 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94496bb-2244-4150-a344-b57acec95457 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:27:15.684903 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94496bb-2244-4150-a344-b57acec95457 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:27:15.686303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 738/1482] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:27:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:27:15.691923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3516349-6e2b-458c-bc5b-f4ebc7c22ab1 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:27:15.692671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3516349-6e2b-458c-bc5b-f4ebc7c22ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:27:15.692671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3516349-6e2b-458c-bc5b-f4ebc7c22ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:27:15.710938 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-f3516349-6e2b-458c-bc5b-f4ebc7c22ab1 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:27:15.712405 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-f3516349-6e2b-458c-bc5b-f4ebc7c22ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:27:15.720815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 745/1483] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:27:15.758584 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94496bb-2244-4150-a344-b57acec95457 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:27:15.769975 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94496bb-2244-4150-a344-b57acec95457 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:27:15.773442 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92adfe-f53a-46ca-8929-a531450be0b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:27:15.774078 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92adfe-f53a-46ca-8929-a531450be0b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:27:15.774361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92adfe-f53a-46ca-8929-a531450be0b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:27:15.774664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92adfe-f53a-46ca-8929-a531450be0b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:27:15.783898 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92adfe-f53a-46ca-8929-a531450be0b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:27:15.785357 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92adfe-f53a-46ca-8929-a531450be0b9 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:27:15.795217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 739/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:27:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:27:18.088660 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10746798-77fd-4272-8fc0-6c8990f1583c None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:27:18.089210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10746798-77fd-4272-8fc0-6c8990f1583c None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:27:18.089210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10746798-77fd-4272-8fc0-6c8990f1583c None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:27:18.091802 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 746/1485] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:27:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:27:18.096766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b01f9-5607-4350-bf3b-c3cb804f34f8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:27:18.097245 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b01f9-5607-4350-bf3b-c3cb804f34f8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:27:18.097355 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b01f9-5607-4350-bf3b-c3cb804f34f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:27:18.117711 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f39b01f9-5607-4350-bf3b-c3cb804f34f8 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:27:18.119137 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f39b01f9-5607-4350-bf3b-c3cb804f34f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:27:18.129036 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 740/1486] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:27:18.168678 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10746798-77fd-4272-8fc0-6c8990f1583c None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:27:18.180476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10746798-77fd-4272-8fc0-6c8990f1583c None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:27:18.187037 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f17e5-e151-4f94-af4c-3569c2a4e3dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:27:18.187834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f17e5-e151-4f94-af4c-3569c2a4e3dc service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:27:18.188171 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f17e5-e151-4f94-af4c-3569c2a4e3dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:27:18.189708 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f17e5-e151-4f94-af4c-3569c2a4e3dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:27:18.198738 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f17e5-e151-4f94-af4c-3569c2a4e3dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:27:18.200878 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f17e5-e151-4f94-af4c-3569c2a4e3dc service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:27:18.211223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 747/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:27:20.597609 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15e8cf-ad6c-430a-820f-3d3f54c6a70d None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:27:20.598193 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15e8cf-ad6c-430a-820f-3d3f54c6a70d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:27:20.598193 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15e8cf-ad6c-430a-820f-3d3f54c6a70d None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:27:20.599611 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 741/1488] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:27:20.605780 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11f968-1be3-40ba-bdf9-1d50ef92b792 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:27:20.606282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11f968-1be3-40ba-bdf9-1d50ef92b792 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:27:20.606392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11f968-1be3-40ba-bdf9-1d50ef92b792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:27:20.625229 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-3b11f968-1be3-40ba-bdf9-1d50ef92b792 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:27:20.626443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-3b11f968-1be3-40ba-bdf9-1d50ef92b792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:27:20.635094 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 748/1489] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:27:20.675521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15e8cf-ad6c-430a-820f-3d3f54c6a70d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:27:20.686953 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15e8cf-ad6c-430a-820f-3d3f54c6a70d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:27:20.690494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bad763-2c14-49fd-9cd2-7e0bd816dd9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:27:20.691163 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bad763-2c14-49fd-9cd2-7e0bd816dd9a service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:27:20.691450 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bad763-2c14-49fd-9cd2-7e0bd816dd9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:27:20.691727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bad763-2c14-49fd-9cd2-7e0bd816dd9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:27:20.701170 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bad763-2c14-49fd-9cd2-7e0bd816dd9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:27:20.702666 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bad763-2c14-49fd-9cd2-7e0bd816dd9a service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:27:20.712817 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 742/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:27:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:27:23.200483 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470c30e-3e93-41dc-801d-35629baa7010 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:27:23.201038 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470c30e-3e93-41dc-801d-35629baa7010 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:27:23.201391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470c30e-3e93-41dc-801d-35629baa7010 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:27:23.203353 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 749/1491] 10.222.0.25 () {54 vars in 926 bytes} [Mon May 23 12:27:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:27:23.208843 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587d5b4-9adc-4732-980c-8b92388e757b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:27:23.209343 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587d5b4-9adc-4732-980c-8b92388e757b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:27:23.209449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587d5b4-9adc-4732-980c-8b92388e757b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:27:23.229017 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a587d5b4-9adc-4732-980c-8b92388e757b None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:27:23.230389 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a587d5b4-9adc-4732-980c-8b92388e757b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:27:23.239753 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 743/1492] 10.222.0.25 () {58 vars in 1023 bytes} [Mon May 23 12:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:27:23.278889 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470c30e-3e93-41dc-801d-35629baa7010 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:27:23.289755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470c30e-3e93-41dc-801d-35629baa7010 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:27:23.294776 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262ca99-df58-4367-ad51-88dec4257a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:27:23.295432 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262ca99-df58-4367-ad51-88dec4257a50 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:27:23.295720 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262ca99-df58-4367-ad51-88dec4257a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:27:23.296001 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262ca99-df58-4367-ad51-88dec4257a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:27:23.307558 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262ca99-df58-4367-ad51-88dec4257a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:27:23.310017 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262ca99-df58-4367-ad51-88dec4257a50 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:27:23.322356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 750/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:27:33.222393 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=33 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:27:33.315331 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=33 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:29:07.817639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc198c31-fef8-428b-ac88-818e6ec8b3d8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:29:07.818267 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc198c31-fef8-428b-ac88-818e6ec8b3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:29:07.818267 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc198c31-fef8-428b-ac88-818e6ec8b3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:29:07.836984 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-fc198c31-fef8-428b-ac88-818e6ec8b3d8 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:29:07.838196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fc198c31-fef8-428b-ac88-818e6ec8b3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:29:07.846064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 744/1494] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:29:07.855793 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575fb35-5fbc-463e-b1a3-777600e52930 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:29:07.856356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575fb35-5fbc-463e-b1a3-777600e52930 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:29:07.856356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575fb35-5fbc-463e-b1a3-777600e52930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:29:07.875051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-d575fb35-5fbc-463e-b1a3-777600e52930 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:29:07.876276 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-d575fb35-5fbc-463e-b1a3-777600e52930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:29:07.886071 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 751/1495] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:29:07.890803 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc198c31-fef8-428b-ac88-818e6ec8b3d8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:29:07.900367 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc198c31-fef8-428b-ac88-818e6ec8b3d8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:29:07.904823 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece2cc3-21f1-4ab9-90c9-f6455f76521d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:29:07.905472 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece2cc3-21f1-4ab9-90c9-f6455f76521d admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:29:07.905757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece2cc3-21f1-4ab9-90c9-f6455f76521d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:29:07.906034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece2cc3-21f1-4ab9-90c9-f6455f76521d admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:29:07.906793 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece2cc3-21f1-4ab9-90c9-f6455f76521d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:29:07.907100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece2cc3-21f1-4ab9-90c9-f6455f76521d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:29:07.908121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: WARNING py.warnings [None req-1ece2cc3-21f1-4ab9-90c9-f6455f76521d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:29:07.908121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: warnings.warn(msg) May 23 12:29:07.908121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: May 23 12:29:07.909013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece2cc3-21f1-4ab9-90c9-f6455f76521d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:29:07.920495 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 745/1496] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:29:07.929225 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575fb35-5fbc-463e-b1a3-777600e52930 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:29:07.938243 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575fb35-5fbc-463e-b1a3-777600e52930 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:29:07.943426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162e534-9447-4d5e-bc00-a18ec3c8bea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:29:07.944067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162e534-9447-4d5e-bc00-a18ec3c8bea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:29:07.944350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162e534-9447-4d5e-bc00-a18ec3c8bea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:29:07.944627 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162e534-9447-4d5e-bc00-a18ec3c8bea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:29:07.945302 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162e534-9447-4d5e-bc00-a18ec3c8bea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:29:07.947096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: WARNING py.warnings [None req-c162e534-9447-4d5e-bc00-a18ec3c8bea0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 12:29:07.947096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: warnings.warn(msg) May 23 12:29:07.947096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: May 23 12:29:07.948263 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162e534-9447-4d5e-bc00-a18ec3c8bea0 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:29:07.984237 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 752/1497] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:29:07 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:29:07.988363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece2cc3-21f1-4ab9-90c9-f6455f76521d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:29:07.999194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece2cc3-21f1-4ab9-90c9-f6455f76521d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:29:08.055662 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83ef6b-779d-4fb9-8393-7c6d860960dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:29:08.056336 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83ef6b-779d-4fb9-8393-7c6d860960dc admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:29:08.056627 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83ef6b-779d-4fb9-8393-7c6d860960dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:29:08.056931 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83ef6b-779d-4fb9-8393-7c6d860960dc admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:29:08.057621 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83ef6b-779d-4fb9-8393-7c6d860960dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:29:08.058690 dv-cinder-836996-27-smb devstack@keystone.service[80198]: WARNING py.warnings [None req-0c83ef6b-779d-4fb9-8393-7c6d860960dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 12:29:08.058690 dv-cinder-836996-27-smb devstack@keystone.service[80198]: warnings.warn(msg) May 23 12:29:08.058690 dv-cinder-836996-27-smb devstack@keystone.service[80198]: May 23 12:29:08.059920 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83ef6b-779d-4fb9-8393-7c6d860960dc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:29:08.079771 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 746/1498] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:29:07 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:29:08.084553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162e534-9447-4d5e-bc00-a18ec3c8bea0 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:29:08.094631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162e534-9447-4d5e-bc00-a18ec3c8bea0 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:29:08.099896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa66131-b377-4ea6-a473-b451cf63808d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:29:08.100555 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa66131-b377-4ea6-a473-b451cf63808d admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:29:08.100845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa66131-b377-4ea6-a473-b451cf63808d admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:29:08.101126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa66131-b377-4ea6-a473-b451cf63808d admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:29:08.101853 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa66131-b377-4ea6-a473-b451cf63808d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:29:08.102923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: WARNING py.warnings [None req-5aa66131-b377-4ea6-a473-b451cf63808d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:29:08.102923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: warnings.warn(msg) May 23 12:29:08.102923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: May 23 12:29:08.103806 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa66131-b377-4ea6-a473-b451cf63808d admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:29:08.117500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 753/1499] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:29:08.120640 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83ef6b-779d-4fb9-8393-7c6d860960dc admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:29:08.130813 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83ef6b-779d-4fb9-8393-7c6d860960dc admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:29:08.135526 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd9b23-d89a-4aa6-bdcf-b7e13c781961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:29:08.136182 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd9b23-d89a-4aa6-bdcf-b7e13c781961 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:29:08.136473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd9b23-d89a-4aa6-bdcf-b7e13c781961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:29:08.136752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd9b23-d89a-4aa6-bdcf-b7e13c781961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:29:08.137483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd9b23-d89a-4aa6-bdcf-b7e13c781961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:29:08.138528 dv-cinder-836996-27-smb devstack@keystone.service[80198]: WARNING py.warnings [None req-08bd9b23-d89a-4aa6-bdcf-b7e13c781961 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:29:08.138528 dv-cinder-836996-27-smb devstack@keystone.service[80198]: warnings.warn(msg) May 23 12:29:08.138528 dv-cinder-836996-27-smb devstack@keystone.service[80198]: May 23 12:29:08.139449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd9b23-d89a-4aa6-bdcf-b7e13c781961 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:29:08.154248 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 747/1500] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:29:08.158290 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa66131-b377-4ea6-a473-b451cf63808d admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:29:08.168644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa66131-b377-4ea6-a473-b451cf63808d admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:29:08.173031 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de9ae4-133b-4c90-9e5d-cb79ef6b84c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:29:08.173895 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de9ae4-133b-4c90-9e5d-cb79ef6b84c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:29:08.174176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de9ae4-133b-4c90-9e5d-cb79ef6b84c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:29:08.174450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de9ae4-133b-4c90-9e5d-cb79ef6b84c4 admin admin] PATH_INFO: `/v3/projects/1e15c1e96dea44618968194b54a93498/users/b8263b18572047c686b994d2b1b71492/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:29:08.189621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de9ae4-133b-4c90-9e5d-cb79ef6b84c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e15c1e96dea44618968194b54a93498, user_id=b8263b18572047c686b994d2b1b71492, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:29:08.190705 dv-cinder-836996-27-smb devstack@keystone.service[80199]: WARNING py.warnings [None req-a7de9ae4-133b-4c90-9e5d-cb79ef6b84c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 12:29:08.190705 dv-cinder-836996-27-smb devstack@keystone.service[80199]: warnings.warn(msg) May 23 12:29:08.190705 dv-cinder-836996-27-smb devstack@keystone.service[80199]: May 23 12:29:08.192620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de9ae4-133b-4c90-9e5d-cb79ef6b84c4 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:29:08.205409 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 754/1501] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:29:08 2022] PUT /identity/v3/projects/1e15c1e96dea44618968194b54a93498/users/b8263b18572047c686b994d2b1b71492/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:29:08.217390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da305d0d-2810-47ae-93f4-e5707e600f60 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:29:08.217686 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da305d0d-2810-47ae-93f4-e5707e600f60 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:29:08.217969 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da305d0d-2810-47ae-93f4-e5707e600f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:29:08.246070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-da305d0d-2810-47ae-93f4-e5707e600f60 None None] MFA Rules not processed for user `b8263b18572047c686b994d2b1b71492`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:29:08.247349 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-da305d0d-2810-47ae-93f4-e5707e600f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:29:08.309879 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 748/1502] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:29:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:29:08.323504 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139af6c-4e9e-44ff-9b1f-f4af97be7068 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:29:08.323823 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139af6c-4e9e-44ff-9b1f-f4af97be7068 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:29:08.324113 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139af6c-4e9e-44ff-9b1f-f4af97be7068 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:29:08.325482 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 755/1503] 10.222.0.25 () {54 vars in 963 bytes} [Mon May 23 12:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:29:08.330528 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418f8ff-b8e6-4a86-b562-de00a434dc1d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:29:08.330781 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418f8ff-b8e6-4a86-b562-de00a434dc1d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:29:08.331315 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418f8ff-b8e6-4a86-b562-de00a434dc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:29:08.350236 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4418f8ff-b8e6-4a86-b562-de00a434dc1d None None] MFA Rules not processed for user `3a3f520fcbe544c9be7e33a64eb1dc20`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:29:08.351507 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4418f8ff-b8e6-4a86-b562-de00a434dc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:29:08.394819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:29:08.402664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 749/1504] 10.222.0.25 () {58 vars in 1060 bytes} [Mon May 23 12:29:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:29:08.410463 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139af6c-4e9e-44ff-9b1f-f4af97be7068 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:29:08.421355 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139af6c-4e9e-44ff-9b1f-f4af97be7068 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:29:08.424828 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea1c3a-f892-4297-845e-42a72806a500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:29:08.425460 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea1c3a-f892-4297-845e-42a72806a500 service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:29:08.425746 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea1c3a-f892-4297-845e-42a72806a500 service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:29:08.426571 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea1c3a-f892-4297-845e-42a72806a500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:29:08.434849 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea1c3a-f892-4297-845e-42a72806a500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:29:08.436276 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea1c3a-f892-4297-845e-42a72806a500 service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:29:08.444979 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 756/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:29:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:29:08.489195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721fc64-b076-4d97-a698-94daaac916d7 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:29:08.489499 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721fc64-b076-4d97-a698-94daaac916d7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:29:08.489782 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721fc64-b076-4d97-a698-94daaac916d7 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:29:08.491116 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 750/1506] 10.222.0.25 () {52 vars in 829 bytes} [Mon May 23 12:29:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:29:08.494658 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea1c3a-f892-4297-845e-42a72806a500 service cinder] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:29:08.576386 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea1c3a-f892-4297-845e-42a72806a500 service cinder] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:29:08.581370 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb78eb-aedb-4a9f-9e0c-4a8447a6d0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:29:08.582860 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb78eb-aedb-4a9f-9e0c-4a8447a6d0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:29:08.583148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb78eb-aedb-4a9f-9e0c-4a8447a6d0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:29:08.583429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb78eb-aedb-4a9f-9e0c-4a8447a6d0ae admin admin] PATH_INFO: `/v3/users/b8263b18572047c686b994d2b1b71492` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:29:08.584621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb78eb-aedb-4a9f-9e0c-4a8447a6d0ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8263b18572047c686b994d2b1b71492)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:29:08.585649 dv-cinder-836996-27-smb devstack@keystone.service[80199]: WARNING py.warnings [None req-96eb78eb-aedb-4a9f-9e0c-4a8447a6d0ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 12:29:08.585649 dv-cinder-836996-27-smb devstack@keystone.service[80199]: warnings.warn(msg) May 23 12:29:08.585649 dv-cinder-836996-27-smb devstack@keystone.service[80199]: May 23 12:29:08.586913 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb78eb-aedb-4a9f-9e0c-4a8447a6d0ae admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:29:08.650993 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-96eb78eb-aedb-4a9f-9e0c-4a8447a6d0ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8263b18572047c686b994d2b1b71492'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:29:08.660027 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-96eb78eb-aedb-4a9f-9e0c-4a8447a6d0ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8263b18572047c686b994d2b1b71492'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:29:08.678901 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-96eb78eb-aedb-4a9f-9e0c-4a8447a6d0ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8263b18572047c686b994d2b1b71492'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:29:08.687439 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:29:08.692783 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-96eb78eb-aedb-4a9f-9e0c-4a8447a6d0ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8263b18572047c686b994d2b1b71492'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:29:08.694114 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-96eb78eb-aedb-4a9f-9e0c-4a8447a6d0ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8263b18572047c686b994d2b1b71492'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:29:08.701179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 757/1507] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:29:08 2022] DELETE /identity/v3/users/b8263b18572047c686b994d2b1b71492 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:29:08.705577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd0d0e-6942-4f48-98d9-1f8fd7e26b4a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:29:08.706114 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd0d0e-6942-4f48-98d9-1f8fd7e26b4a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:29:08.706400 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd0d0e-6942-4f48-98d9-1f8fd7e26b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:29:08.724438 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-08fd0d0e-6942-4f48-98d9-1f8fd7e26b4a None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:29:08.725638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-08fd0d0e-6942-4f48-98d9-1f8fd7e26b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:29:08.792399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 751/1508] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:29:08.801941 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb78eb-aedb-4a9f-9e0c-4a8447a6d0ae admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:29:08.803371 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-96eb78eb-aedb-4a9f-9e0c-4a8447a6d0ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:29:08.869023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb78eb-aedb-4a9f-9e0c-4a8447a6d0ae admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:29:08.873630 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1da7b-7f7f-4c9e-b5bf-1645d17e6e01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:29:08.874283 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1da7b-7f7f-4c9e-b5bf-1645d17e6e01 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:29:08.874775 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1da7b-7f7f-4c9e-b5bf-1645d17e6e01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:29:08.875052 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1da7b-7f7f-4c9e-b5bf-1645d17e6e01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:29:08.884917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1da7b-7f7f-4c9e-b5bf-1645d17e6e01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:29:08.886359 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1da7b-7f7f-4c9e-b5bf-1645d17e6e01 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:29:08.896597 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 758/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:29:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:29:09.230722 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd0d0e-6942-4f48-98d9-1f8fd7e26b4a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:29:09.232245 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-08fd0d0e-6942-4f48-98d9-1f8fd7e26b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:29:09.244421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd0d0e-6942-4f48-98d9-1f8fd7e26b4a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:29:09.249715 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e89b9f-baee-4c5e-bcac-e503fbc053da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:29:09.250687 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e89b9f-baee-4c5e-bcac-e503fbc053da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:29:09.250855 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e89b9f-baee-4c5e-bcac-e503fbc053da admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:29:09.251211 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e89b9f-baee-4c5e-bcac-e503fbc053da admin admin] PATH_INFO: `/v3/projects/1e15c1e96dea44618968194b54a93498` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:29:09.252247 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e89b9f-baee-4c5e-bcac-e503fbc053da admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e15c1e96dea44618968194b54a93498)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:29:09.253276 dv-cinder-836996-27-smb devstack@keystone.service[80198]: WARNING py.warnings [None req-80e89b9f-baee-4c5e-bcac-e503fbc053da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 12:29:09.253276 dv-cinder-836996-27-smb devstack@keystone.service[80198]: warnings.warn(msg) May 23 12:29:09.253276 dv-cinder-836996-27-smb devstack@keystone.service[80198]: May 23 12:29:09.255018 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e89b9f-baee-4c5e-bcac-e503fbc053da admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:29:09.325999 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-80e89b9f-baee-4c5e-bcac-e503fbc053da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e15c1e96dea44618968194b54a93498', 'request_id': 'req-80e89b9f-baee-4c5e-bcac-e503fbc053da'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:29:09.339820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-80e89b9f-baee-4c5e-bcac-e503fbc053da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e15c1e96dea44618968194b54a93498', 'request_id': 'req-80e89b9f-baee-4c5e-bcac-e503fbc053da'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:29:09.345736 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-80e89b9f-baee-4c5e-bcac-e503fbc053da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e15c1e96dea44618968194b54a93498', 'request_id': 'req-80e89b9f-baee-4c5e-bcac-e503fbc053da'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:29:09.361884 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-80e89b9f-baee-4c5e-bcac-e503fbc053da admin admin] The token cache is being invalidate because project 1e15c1e96dea44618968194b54a93498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:29:09.362175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-80e89b9f-baee-4c5e-bcac-e503fbc053da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:29:09.362830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-80e89b9f-baee-4c5e-bcac-e503fbc053da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:29:09.364976 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 752/1510] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:29:09 2022] DELETE /identity/v3/projects/1e15c1e96dea44618968194b54a93498 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:29:18.891699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=29 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:29:19.358561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:31:02.396312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7f26e-2727-4714-b7c3-c1a1412ccef0 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:02.396902 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7f26e-2727-4714-b7c3-c1a1412ccef0 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:02.396902 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7f26e-2727-4714-b7c3-c1a1412ccef0 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:02.398308 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:31:02.403430 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244260d-e100-4756-911d-7844a8bf325f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:02.403882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244260d-e100-4756-911d-7844a8bf325f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:02.404185 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244260d-e100-4756-911d-7844a8bf325f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:02.405447 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673d084-392a-4e68-b24a-ab1f1498ef20 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:02.405800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673d084-392a-4e68-b24a-ab1f1498ef20 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:02.406145 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673d084-392a-4e68-b24a-ab1f1498ef20 None None] PATH_INFO: `/v3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:02.407460 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 760/1512] 10.222.0.41 () {54 vars in 925 bytes} [Mon May 23 12:31:02 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:31:02.414256 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1632e5a-05e8-41cb-89da-65e37d416069 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:02.414567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1632e5a-05e8-41cb-89da-65e37d416069 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:02.414850 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1632e5a-05e8-41cb-89da-65e37d416069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:02.423673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7244260d-e100-4756-911d-7844a8bf325f None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:31:02.425610 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7244260d-e100-4756-911d-7844a8bf325f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:31:02.432719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-e1632e5a-05e8-41cb-89da-65e37d416069 None None] MFA Rules not processed for user `a3fde90ab1e0490ebb7cb514173d984e`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:31:02.433880 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e1632e5a-05e8-41cb-89da-65e37d416069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:31:02.485743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 753/1513] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:31:02.495628 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 761/1514] 10.222.0.41 () {58 vars in 1015 bytes} [Mon May 23 12:31:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:31:02.657894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244260d-e100-4756-911d-7844a8bf325f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:31:02.659836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7244260d-e100-4756-911d-7844a8bf325f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:31:02.732631 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244260d-e100-4756-911d-7844a8bf325f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:31:02.738788 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04169261-d3f8-45e3-b471-1518aba568d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:31:02.739358 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04169261-d3f8-45e3-b471-1518aba568d0 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:02.739640 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04169261-d3f8-45e3-b471-1518aba568d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:02.739913 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04169261-d3f8-45e3-b471-1518aba568d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:02.747934 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04169261-d3f8-45e3-b471-1518aba568d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:31:02.749535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04169261-d3f8-45e3-b471-1518aba568d0 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:31:02.758715 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 754/1515] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:31:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:31:03.628501 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f10d4-310a-4edd-b62b-d4f3525ceedf None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:03.629080 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f10d4-310a-4edd-b62b-d4f3525ceedf None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:03.629080 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f10d4-310a-4edd-b62b-d4f3525ceedf None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:03.630440 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 762/1516] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:31:03.635161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3486a4f-ed4f-499e-a87b-ab886232e5eb None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:03.635600 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3486a4f-ed4f-499e-a87b-ab886232e5eb None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:03.635729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3486a4f-ed4f-499e-a87b-ab886232e5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:03.654155 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b3486a4f-ed4f-499e-a87b-ab886232e5eb None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:31:03.655410 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b3486a4f-ed4f-499e-a87b-ab886232e5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:31:03.665091 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 755/1517] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:31:03.818985 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f10d4-310a-4edd-b62b-d4f3525ceedf None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:31:03.833381 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f10d4-310a-4edd-b62b-d4f3525ceedf None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:31:03.838788 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f28804-6ab3-4270-aaa4-79cc0c1b7846 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:31:03.839422 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f28804-6ab3-4270-aaa4-79cc0c1b7846 service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:03.839708 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f28804-6ab3-4270-aaa4-79cc0c1b7846 service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:03.839984 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f28804-6ab3-4270-aaa4-79cc0c1b7846 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:03.847954 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f28804-6ab3-4270-aaa4-79cc0c1b7846 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:31:03.849555 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f28804-6ab3-4270-aaa4-79cc0c1b7846 service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:31:03.858757 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 763/1518] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:31:06.267175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28963176-e77b-43d5-bdf5-6be6d4864206 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:06.267718 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28963176-e77b-43d5-bdf5-6be6d4864206 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:06.267718 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28963176-e77b-43d5-bdf5-6be6d4864206 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:06.269621 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 756/1519] 10.222.0.25 () {54 vars in 960 bytes} [Mon May 23 12:31:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:31:06.274720 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7262c8-7ae5-4a78-98a0-6d44e2a4e5e8 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:06.275146 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7262c8-7ae5-4a78-98a0-6d44e2a4e5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:06.275435 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7262c8-7ae5-4a78-98a0-6d44e2a4e5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:06.294659 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-2b7262c8-7ae5-4a78-98a0-6d44e2a4e5e8 None None] MFA Rules not processed for user `a3fde90ab1e0490ebb7cb514173d984e`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:31:06.295895 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-2b7262c8-7ae5-4a78-98a0-6d44e2a4e5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:31:06.304554 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 764/1520] 10.222.0.25 () {58 vars in 1057 bytes} [Mon May 23 12:31:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:31:06.312741 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28963176-e77b-43d5-bdf5-6be6d4864206 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:31:06.328170 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28963176-e77b-43d5-bdf5-6be6d4864206 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:31:06.333699 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a420f5-a1af-4037-92d8-11ea78d84325 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fde90ab1e0490ebb7cb514173d984e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:31:06.334390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a420f5-a1af-4037-92d8-11ea78d84325 service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:06.334711 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a420f5-a1af-4037-92d8-11ea78d84325 service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:06.334994 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a420f5-a1af-4037-92d8-11ea78d84325 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:06.344391 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a420f5-a1af-4037-92d8-11ea78d84325 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:31:06.346020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a420f5-a1af-4037-92d8-11ea78d84325 service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:31:06.356537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 757/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:31:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:31:15.093034 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e4a9d-561d-48de-9cdf-de49ceca20ee None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:15.093606 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e4a9d-561d-48de-9cdf-de49ceca20ee None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:15.093606 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e4a9d-561d-48de-9cdf-de49ceca20ee None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:15.094989 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:31:15.100401 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb8d71-07a9-4a73-93bc-3426774ac797 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:15.100804 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb8d71-07a9-4a73-93bc-3426774ac797 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:15.100971 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb8d71-07a9-4a73-93bc-3426774ac797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:15.119006 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6ddb8d71-07a9-4a73-93bc-3426774ac797 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:31:15.120208 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6ddb8d71-07a9-4a73-93bc-3426774ac797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:31:15.127919 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:31:15.281407 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e4a9d-561d-48de-9cdf-de49ceca20ee None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:31:15.295931 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e4a9d-561d-48de-9cdf-de49ceca20ee None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:31:15.301154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d1bff-5d07-4bf4-a183-1eca107940d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:31:15.301811 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d1bff-5d07-4bf4-a183-1eca107940d8 service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:15.302102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d1bff-5d07-4bf4-a183-1eca107940d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:15.302384 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d1bff-5d07-4bf4-a183-1eca107940d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:15.310405 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d1bff-5d07-4bf4-a183-1eca107940d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:31:15.312041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d1bff-5d07-4bf4-a183-1eca107940d8 service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:31:15.321858 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 766/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:31:16.204643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947717b-e543-46d6-a923-e2b0f220569c None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:16.205075 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947717b-e543-46d6-a923-e2b0f220569c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:16.205333 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947717b-e543-46d6-a923-e2b0f220569c None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:16.206790 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 12:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:31:16.211692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85390e-ae17-4d17-94db-e3560534ead6 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:16.212148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85390e-ae17-4d17-94db-e3560534ead6 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:16.212319 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85390e-ae17-4d17-94db-e3560534ead6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:16.230726 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-0d85390e-ae17-4d17-94db-e3560534ead6 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:31:16.231908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-0d85390e-ae17-4d17-94db-e3560534ead6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:31:16.240025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 12:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:31:16.387422 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947717b-e543-46d6-a923-e2b0f220569c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:31:16.402199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947717b-e543-46d6-a923-e2b0f220569c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:31:16.407454 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08255d7-b53b-48bd-abd1-2f5556ae2b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:31:16.408093 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08255d7-b53b-48bd-abd1-2f5556ae2b2d service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:16.408378 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08255d7-b53b-48bd-abd1-2f5556ae2b2d service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:16.408655 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08255d7-b53b-48bd-abd1-2f5556ae2b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:16.417558 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08255d7-b53b-48bd-abd1-2f5556ae2b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:31:16.419185 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08255d7-b53b-48bd-abd1-2f5556ae2b2d service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:31:16.428618 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 760/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:31:20.735352 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a6f3d-ece3-41d9-8eb7-748a5cc2f578 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:20.735934 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a6f3d-ece3-41d9-8eb7-748a5cc2f578 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:20.735934 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a6f3d-ece3-41d9-8eb7-748a5cc2f578 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:20.737313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:31:20.745255 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3708c4-3f30-4ce2-9700-adc997aae434 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:20.745819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3708c4-3f30-4ce2-9700-adc997aae434 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:20.746135 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3708c4-3f30-4ce2-9700-adc997aae434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:20.765722 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9e3708c4-3f30-4ce2-9700-adc997aae434 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:31:20.766951 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9e3708c4-3f30-4ce2-9700-adc997aae434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:31:20.774803 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:31:20.811576 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a6f3d-ece3-41d9-8eb7-748a5cc2f578 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:31:20.813334 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-446a6f3d-ece3-41d9-8eb7-748a5cc2f578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:31:20.870773 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a6f3d-ece3-41d9-8eb7-748a5cc2f578 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:31:20.874213 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57229b2a-4372-4ada-9a1d-ca6d30e1c391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:31:20.874878 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57229b2a-4372-4ada-9a1d-ca6d30e1c391 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:20.875170 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57229b2a-4372-4ada-9a1d-ca6d30e1c391 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:20.875455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57229b2a-4372-4ada-9a1d-ca6d30e1c391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:20.884215 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57229b2a-4372-4ada-9a1d-ca6d30e1c391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:31:20.885653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57229b2a-4372-4ada-9a1d-ca6d30e1c391 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:31:20.895547 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 769/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:31:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:31:23.087308 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f005f2-d9b8-4dc5-9273-392c8988404f None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:23.087839 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f005f2-d9b8-4dc5-9273-392c8988404f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:23.087839 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f005f2-d9b8-4dc5-9273-392c8988404f None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:23.089196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:31:23.094394 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097abbe-52d1-45d5-81a0-ae3a4b4a0896 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:23.094848 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097abbe-52d1-45d5-81a0-ae3a4b4a0896 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:23.094988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097abbe-52d1-45d5-81a0-ae3a4b4a0896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:23.114310 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-0097abbe-52d1-45d5-81a0-ae3a4b4a0896 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:31:23.115549 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-0097abbe-52d1-45d5-81a0-ae3a4b4a0896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:31:23.123531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:31:23.158866 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f005f2-d9b8-4dc5-9273-392c8988404f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:31:23.161188 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a6f005f2-d9b8-4dc5-9273-392c8988404f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:31:23.173924 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f005f2-d9b8-4dc5-9273-392c8988404f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:31:23.177414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64136f4a-d42e-4e3a-bfbe-38ad8794f8b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:31:23.178044 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64136f4a-d42e-4e3a-bfbe-38ad8794f8b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:23.178332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64136f4a-d42e-4e3a-bfbe-38ad8794f8b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:23.178646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64136f4a-d42e-4e3a-bfbe-38ad8794f8b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:23.187815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64136f4a-d42e-4e3a-bfbe-38ad8794f8b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:31:23.189295 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64136f4a-d42e-4e3a-bfbe-38ad8794f8b2 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:31:23.198792 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 763/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:31:27.306699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9597a-1499-4611-877d-636092850e42 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:27.307292 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9597a-1499-4611-877d-636092850e42 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:27.307292 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9597a-1499-4611-877d-636092850e42 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:27.308687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:31:27.313907 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05c07c-3d1c-4c67-8677-ada2735c942a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:27.314367 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05c07c-3d1c-4c67-8677-ada2735c942a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:27.314524 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05c07c-3d1c-4c67-8677-ada2735c942a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:27.333529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ed05c07c-3d1c-4c67-8677-ada2735c942a None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:31:27.334751 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ed05c07c-3d1c-4c67-8677-ada2735c942a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:31:27.342439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:31:27.613924 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9597a-1499-4611-877d-636092850e42 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:31:27.615629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e4e9597a-1499-4611-877d-636092850e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:31:27.674134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9597a-1499-4611-877d-636092850e42 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:31:27.677728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23336df7-5e02-4a37-8ac9-1d09d03192c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:31:27.678377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23336df7-5e02-4a37-8ac9-1d09d03192c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:27.678708 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23336df7-5e02-4a37-8ac9-1d09d03192c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:27.678993 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23336df7-5e02-4a37-8ac9-1d09d03192c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:27.686028 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:31:27.688845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23336df7-5e02-4a37-8ac9-1d09d03192c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:31:27.690937 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23336df7-5e02-4a37-8ac9-1d09d03192c4 service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:31:27.700875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 772/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:31:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:31:29.918737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269f3da-c188-4f99-9c92-9f96453a5060 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:29.919306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269f3da-c188-4f99-9c92-9f96453a5060 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:29.919306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269f3da-c188-4f99-9c92-9f96453a5060 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:29.920691 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 12:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:31:29.925773 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d3b81-c5ec-4609-b745-39f069099d01 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:29.926198 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d3b81-c5ec-4609-b745-39f069099d01 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:29.926335 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d3b81-c5ec-4609-b745-39f069099d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:29.944310 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-457d3b81-c5ec-4609-b745-39f069099d01 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:31:29.945496 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-457d3b81-c5ec-4609-b745-39f069099d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:31:29.953389 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 12:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:31:30.220737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269f3da-c188-4f99-9c92-9f96453a5060 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:31:30.222438 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e269f3da-c188-4f99-9c92-9f96453a5060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:31:30.229994 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:31:30.236179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269f3da-c188-4f99-9c92-9f96453a5060 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:31:30.240275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bf0b4-c1e6-4747-a521-34186dbb56e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:31:30.240910 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bf0b4-c1e6-4747-a521-34186dbb56e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:31:30.241196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bf0b4-c1e6-4747-a521-34186dbb56e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:31:30.241476 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bf0b4-c1e6-4747-a521-34186dbb56e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:31:30.250304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bf0b4-c1e6-4747-a521-34186dbb56e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:31:30.251787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bf0b4-c1e6-4747-a521-34186dbb56e2 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:31:30.261652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 766/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:31:39.938778 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=5 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:31:40.257525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=5 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:07.252372 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dc293-e21e-452d-9334-3fc4e2e3f650 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.254738 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dc293-e21e-452d-9334-3fc4e2e3f650 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.254738 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dc293-e21e-452d-9334-3fc4e2e3f650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.277923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-c44dc293-e21e-452d-9334-3fc4e2e3f650 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:07.282920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-c44dc293-e21e-452d-9334-3fc4e2e3f650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:07.297522 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 774/1540] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:07.308097 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902e86f-50ba-4718-a75b-8d60cab7db62 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.308670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902e86f-50ba-4718-a75b-8d60cab7db62 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.308670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902e86f-50ba-4718-a75b-8d60cab7db62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.346905 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c902e86f-50ba-4718-a75b-8d60cab7db62 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:07.348450 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c902e86f-50ba-4718-a75b-8d60cab7db62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:07.361974 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 767/1541] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:07.366674 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dc293-e21e-452d-9334-3fc4e2e3f650 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:07.381243 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dc293-e21e-452d-9334-3fc4e2e3f650 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:07.387296 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68581cd6-925e-4b38-a7d2-ff4725ac79de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:07.388373 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d11ad8-0513-41cd-bbfd-db75f2f24b0d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.388741 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68581cd6-925e-4b38-a7d2-ff4725ac79de admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.389126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d11ad8-0513-41cd-bbfd-db75f2f24b0d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.389264 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68581cd6-925e-4b38-a7d2-ff4725ac79de admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.389437 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68581cd6-925e-4b38-a7d2-ff4725ac79de admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.389911 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d11ad8-0513-41cd-bbfd-db75f2f24b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.390186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68581cd6-925e-4b38-a7d2-ff4725ac79de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:07.390516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68581cd6-925e-4b38-a7d2-ff4725ac79de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:07.391558 dv-cinder-836996-27-smb devstack@keystone.service[80199]: WARNING py.warnings [None req-68581cd6-925e-4b38-a7d2-ff4725ac79de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 12:33:07.391558 dv-cinder-836996-27-smb devstack@keystone.service[80199]: warnings.warn(msg) May 23 12:33:07.391558 dv-cinder-836996-27-smb devstack@keystone.service[80199]: May 23 12:33:07.392464 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68581cd6-925e-4b38-a7d2-ff4725ac79de admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:07.418533 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 775/1542] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:07.418533 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b05c59-796d-4fdb-9716-f6376f5cb1df None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.418533 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b05c59-796d-4fdb-9716-f6376f5cb1df None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.418533 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b05c59-796d-4fdb-9716-f6376f5cb1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.423352 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-69d11ad8-0513-41cd-bbfd-db75f2f24b0d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:07.424765 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-69d11ad8-0513-41cd-bbfd-db75f2f24b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:07.444275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 768/1543] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:07.445751 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d11ad8-0513-41cd-bbfd-db75f2f24b0d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:07.456309 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-f2b05c59-796d-4fdb-9716-f6376f5cb1df None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:07.457563 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-f2b05c59-796d-4fdb-9716-f6376f5cb1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:07.468423 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d11ad8-0513-41cd-bbfd-db75f2f24b0d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:07.477137 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544ed8c-c588-4c9e-9277-c6c92689c009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:07.478301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544ed8c-c588-4c9e-9277-c6c92689c009 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.478789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544ed8c-c588-4c9e-9277-c6c92689c009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.479230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544ed8c-c588-4c9e-9277-c6c92689c009 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.480125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544ed8c-c588-4c9e-9277-c6c92689c009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:07.481551 dv-cinder-836996-27-smb devstack@keystone.service[80198]: WARNING py.warnings [None req-8544ed8c-c588-4c9e-9277-c6c92689c009 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 12:33:07.481551 dv-cinder-836996-27-smb devstack@keystone.service[80198]: warnings.warn(msg) May 23 12:33:07.481551 dv-cinder-836996-27-smb devstack@keystone.service[80198]: May 23 12:33:07.483047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 776/1544] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:07.483404 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544ed8c-c588-4c9e-9277-c6c92689c009 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:07.484472 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ea911-afb6-4e2f-a20f-2757cbed5829 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.484761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ea911-afb6-4e2f-a20f-2757cbed5829 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.485041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ea911-afb6-4e2f-a20f-2757cbed5829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.530253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-514ea911-afb6-4e2f-a20f-2757cbed5829 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:07.531511 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-514ea911-afb6-4e2f-a20f-2757cbed5829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:07.543627 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 769/1545] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:07 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:07.545453 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0418aa-ea88-41f4-a3f6-c22cfa80f54e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.545919 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0418aa-ea88-41f4-a3f6-c22cfa80f54e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.546407 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0418aa-ea88-41f4-a3f6-c22cfa80f54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.552332 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 777/1546] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:07.553423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ea911-afb6-4e2f-a20f-2757cbed5829 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:07.574668 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ea911-afb6-4e2f-a20f-2757cbed5829 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:07.577390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4f0418aa-ea88-41f4-a3f6-c22cfa80f54e None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:07.583759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4f0418aa-ea88-41f4-a3f6-c22cfa80f54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:07.671812 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 770/1547] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:07.672932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416445d-f06d-429a-865e-5283fa09fb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:07.673292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0418aa-ea88-41f4-a3f6-c22cfa80f54e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:07.673634 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416445d-f06d-429a-865e-5283fa09fb45 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.673917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416445d-f06d-429a-865e-5283fa09fb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.674203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416445d-f06d-429a-865e-5283fa09fb45 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.674918 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416445d-f06d-429a-865e-5283fa09fb45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:07.676221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: WARNING py.warnings [None req-f416445d-f06d-429a-865e-5283fa09fb45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 12:33:07.676221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: warnings.warn(msg) May 23 12:33:07.676221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: May 23 12:33:07.677474 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416445d-f06d-429a-865e-5283fa09fb45 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:07.686674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0418aa-ea88-41f4-a3f6-c22cfa80f54e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:07.692667 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900a237-6b47-401f-be97-69542dc2795a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:07.693705 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900a237-6b47-401f-be97-69542dc2795a admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.694182 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900a237-6b47-401f-be97-69542dc2795a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.694738 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900a237-6b47-401f-be97-69542dc2795a admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.695933 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900a237-6b47-401f-be97-69542dc2795a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:07.696423 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900a237-6b47-401f-be97-69542dc2795a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:07.699272 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900a237-6b47-401f-be97-69542dc2795a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:07.717082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 771/1548] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:07.719491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f8931-96b7-4d62-9886-3face3f7cc27 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.719636 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 778/1549] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:07 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:07.720066 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f8931-96b7-4d62-9886-3face3f7cc27 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.720564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f8931-96b7-4d62-9886-3face3f7cc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.723339 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416445d-f06d-429a-865e-5283fa09fb45 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:07.743013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d32f8931-96b7-4d62-9886-3face3f7cc27 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:07.744576 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d32f8931-96b7-4d62-9886-3face3f7cc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:07.747538 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416445d-f06d-429a-865e-5283fa09fb45 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:07.753135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b58a2-79b3-4201-b613-e826ffc3fd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:07.753830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b58a2-79b3-4201-b613-e826ffc3fd05 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.754115 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b58a2-79b3-4201-b613-e826ffc3fd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.754392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b58a2-79b3-4201-b613-e826ffc3fd05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.755237 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b58a2-79b3-4201-b613-e826ffc3fd05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:07.755547 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b58a2-79b3-4201-b613-e826ffc3fd05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:07.756505 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 772/1550] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:07.757448 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b58a2-79b3-4201-b613-e826ffc3fd05 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:07.758198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfe3c9-70d7-45fb-987f-2e9e29f09b48 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.758805 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfe3c9-70d7-45fb-987f-2e9e29f09b48 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.759629 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfe3c9-70d7-45fb-987f-2e9e29f09b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.772559 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 779/1551] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:07.773490 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b58a2-79b3-4201-b613-e826ffc3fd05 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:07.781086 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-55bfe3c9-70d7-45fb-987f-2e9e29f09b48 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:07.782486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-55bfe3c9-70d7-45fb-987f-2e9e29f09b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:07.789623 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b58a2-79b3-4201-b613-e826ffc3fd05 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:07.791392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 773/1552] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:07.792714 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387c67a-3c01-4501-a53c-11265efb02e6 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.793015 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387c67a-3c01-4501-a53c-11265efb02e6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.793313 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387c67a-3c01-4501-a53c-11265efb02e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.795775 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6eae8e-53b1-486b-ae85-d896d263c8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:07.796760 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6eae8e-53b1-486b-ae85-d896d263c8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.797324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6eae8e-53b1-486b-ae85-d896d263c8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.797803 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6eae8e-53b1-486b-ae85-d896d263c8f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.798833 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6eae8e-53b1-486b-ae85-d896d263c8f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:07.800841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6eae8e-53b1-486b-ae85-d896d263c8f8 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:07.812951 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 780/1553] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:07.814281 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6eae8e-53b1-486b-ae85-d896d263c8f8 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:07.814881 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0387c67a-3c01-4501-a53c-11265efb02e6 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:07.816386 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0387c67a-3c01-4501-a53c-11265efb02e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:07.825690 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 774/1554] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:07.832226 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e51c93-a403-4605-9330-c54d09f5c45f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.832226 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e51c93-a403-4605-9330-c54d09f5c45f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.832226 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e51c93-a403-4605-9330-c54d09f5c45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.832583 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6eae8e-53b1-486b-ae85-d896d263c8f8 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:07.842760 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c2f81-d237-44c5-a018-be2dbd2877e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:07.844440 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c2f81-d237-44c5-a018-be2dbd2877e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.844961 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c2f81-d237-44c5-a018-be2dbd2877e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.845516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c2f81-d237-44c5-a018-be2dbd2877e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.847058 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c2f81-d237-44c5-a018-be2dbd2877e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:07.850863 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c2f81-d237-44c5-a018-be2dbd2877e6 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:07.860069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-96e51c93-a403-4605-9330-c54d09f5c45f None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:07.863244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-96e51c93-a403-4605-9330-c54d09f5c45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:07.874259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 775/1555] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:07.877615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e51c93-a403-4605-9330-c54d09f5c45f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:07.889207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e51c93-a403-4605-9330-c54d09f5c45f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:07.889769 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 781/1556] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:07 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:07.891581 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46212f0d-f857-480d-b0e9-703847ed2659 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.891891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46212f0d-f857-480d-b0e9-703847ed2659 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.892180 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46212f0d-f857-480d-b0e9-703847ed2659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.910048 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-46212f0d-f857-480d-b0e9-703847ed2659 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:07.911293 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-46212f0d-f857-480d-b0e9-703847ed2659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:07.946220 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43453c-0044-4123-8fdd-0a2eef0493fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:07.946846 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43453c-0044-4123-8fdd-0a2eef0493fb admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.947127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43453c-0044-4123-8fdd-0a2eef0493fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.947399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43453c-0044-4123-8fdd-0a2eef0493fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.948114 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43453c-0044-4123-8fdd-0a2eef0493fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:07.950777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43453c-0044-4123-8fdd-0a2eef0493fb admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:07.972097 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 782/1557] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:07.973139 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46212f0d-f857-480d-b0e9-703847ed2659 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:07.981710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 776/1558] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:07 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:07.982418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46212f0d-f857-480d-b0e9-703847ed2659 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:07.982888 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241eec75-6317-4d78-a845-109234d502e7 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:07.983177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241eec75-6317-4d78-a845-109234d502e7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:07.983451 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241eec75-6317-4d78-a845-109234d502e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:07.990452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:08.001619 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-241eec75-6317-4d78-a845-109234d502e7 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:08.002865 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-241eec75-6317-4d78-a845-109234d502e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:08.008178 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:08.041756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dc315-bbe6-4c62-b339-f81e2e46cc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.042421 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dc315-bbe6-4c62-b339-f81e2e46cc3f admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.042739 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dc315-bbe6-4c62-b339-f81e2e46cc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.043018 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dc315-bbe6-4c62-b339-f81e2e46cc3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.043742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68dc315-bbe6-4c62-b339-f81e2e46cc3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.045891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68dc315-bbe6-4c62-b339-f81e2e46cc3f admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.055509 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 783/1559] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:08.058694 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2f234-9bd5-4453-b8a4-7ec7b554830d None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.058694 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2f234-9bd5-4453-b8a4-7ec7b554830d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.058694 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2f234-9bd5-4453-b8a4-7ec7b554830d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.062465 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 777/1560] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:08.063827 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14286944-4240-4b1f-a4c7-37d53cacdbcf None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.064130 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14286944-4240-4b1f-a4c7-37d53cacdbcf None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.064404 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14286944-4240-4b1f-a4c7-37d53cacdbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.076747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-eff2f234-9bd5-4453-b8a4-7ec7b554830d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:08.077989 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-eff2f234-9bd5-4453-b8a4-7ec7b554830d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:08.082242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-14286944-4240-4b1f-a4c7-37d53cacdbcf None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:08.083563 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-14286944-4240-4b1f-a4c7-37d53cacdbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:08.085963 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 784/1561] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:08.086870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2f234-9bd5-4453-b8a4-7ec7b554830d None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.094897 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 778/1562] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:08.094897 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14286944-4240-4b1f-a4c7-37d53cacdbcf None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.100088 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2f234-9bd5-4453-b8a4-7ec7b554830d None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.104778 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14286944-4240-4b1f-a4c7-37d53cacdbcf None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.104912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bbc34-d740-46d4-98fe-a2450da28df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.105587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bbc34-d740-46d4-98fe-a2450da28df5 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.105875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bbc34-d740-46d4-98fe-a2450da28df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.106191 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bbc34-d740-46d4-98fe-a2450da28df5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.106927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bbc34-d740-46d4-98fe-a2450da28df5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:08.107232 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bbc34-d740-46d4-98fe-a2450da28df5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.108857 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bbc34-d740-46d4-98fe-a2450da28df5 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.109380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802388d-870f-4922-9a4f-9a6140c3d9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.110036 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802388d-870f-4922-9a4f-9a6140c3d9fb admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.110324 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802388d-870f-4922-9a4f-9a6140c3d9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.110637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802388d-870f-4922-9a4f-9a6140c3d9fb admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.111330 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802388d-870f-4922-9a4f-9a6140c3d9fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.113256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802388d-870f-4922-9a4f-9a6140c3d9fb admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.120959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 785/1563] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:08.122002 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bbc34-d740-46d4-98fe-a2450da28df5 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.132738 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bbc34-d740-46d4-98fe-a2450da28df5 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.138998 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 779/1564] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:08 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:08.138998 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802388d-870f-4922-9a4f-9a6140c3d9fb admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.139234 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f7081-aeca-46cd-b684-197aaad1f89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.139234 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f7081-aeca-46cd-b684-197aaad1f89c admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.139234 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f7081-aeca-46cd-b684-197aaad1f89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.139234 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f7081-aeca-46cd-b684-197aaad1f89c admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.139963 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f7081-aeca-46cd-b684-197aaad1f89c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:08.140310 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f7081-aeca-46cd-b684-197aaad1f89c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.141952 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f7081-aeca-46cd-b684-197aaad1f89c admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.146396 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802388d-870f-4922-9a4f-9a6140c3d9fb admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.150886 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a3d3d-5043-4230-8815-c0ff7b46bbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.151523 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a3d3d-5043-4230-8815-c0ff7b46bbd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.151809 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a3d3d-5043-4230-8815-c0ff7b46bbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.152086 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a3d3d-5043-4230-8815-c0ff7b46bbd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.152752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a3d3d-5043-4230-8815-c0ff7b46bbd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.161205 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 786/1565] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:08.161353 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a3d3d-5043-4230-8815-c0ff7b46bbd6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.161468 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f7081-aeca-46cd-b684-197aaad1f89c admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.167593 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f7081-aeca-46cd-b684-197aaad1f89c admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.173116 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16222c-0bd7-4099-8e69-63b340647f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.173999 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16222c-0bd7-4099-8e69-63b340647f95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.174285 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16222c-0bd7-4099-8e69-63b340647f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.174599 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16222c-0bd7-4099-8e69-63b340647f95 admin admin] PATH_INFO: `/v3/projects/b3c2260d6d3a4d1eaf61991cf0567887/users/ce751e35d8184c809a942b4187e88cb0/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.176916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 780/1566] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:08 2022] POST /identity/v3/users => generated 290 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:08.177741 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a3d3d-5043-4230-8815-c0ff7b46bbd6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.187504 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a3d3d-5043-4230-8815-c0ff7b46bbd6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.192510 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a6692-d8d1-48fb-b289-44187ce39430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.193167 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a6692-d8d1-48fb-b289-44187ce39430 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.193457 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a6692-d8d1-48fb-b289-44187ce39430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.193781 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a6692-d8d1-48fb-b289-44187ce39430 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.194028 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16222c-0bd7-4099-8e69-63b340647f95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c2260d6d3a4d1eaf61991cf0567887, user_id=ce751e35d8184c809a942b4187e88cb0, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.194766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a6692-d8d1-48fb-b289-44187ce39430 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:08.195085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a6692-d8d1-48fb-b289-44187ce39430 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.197035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16222c-0bd7-4099-8e69-63b340647f95 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.197165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a6692-d8d1-48fb-b289-44187ce39430 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.210606 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 781/1567] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:08.212089 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6bf81-cfe9-4cca-a8fe-8ee781f72d26 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.215947 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 787/1568] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:08 2022] PUT /identity/v3/projects/b3c2260d6d3a4d1eaf61991cf0567887/users/ce751e35d8184c809a942b4187e88cb0/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:08.216101 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6bf81-cfe9-4cca-a8fe-8ee781f72d26 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.216101 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6bf81-cfe9-4cca-a8fe-8ee781f72d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.216298 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a7407-ee25-43e5-b830-e046c77020b1 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.216298 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a7407-ee25-43e5-b830-e046c77020b1 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.216298 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a7407-ee25-43e5-b830-e046c77020b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.232257 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-bf2a7407-ee25-43e5-b830-e046c77020b1 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:08.232783 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-49c6bf81-cfe9-4cca-a8fe-8ee781f72d26 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:08.233463 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-bf2a7407-ee25-43e5-b830-e046c77020b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:08.233940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-49c6bf81-cfe9-4cca-a8fe-8ee781f72d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:08.292644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 782/1569] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:08.293605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6bf81-cfe9-4cca-a8fe-8ee781f72d26 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.297477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 788/1570] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:08.297477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a7407-ee25-43e5-b830-e046c77020b1 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.303318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6bf81-cfe9-4cca-a8fe-8ee781f72d26 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.306751 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a7407-ee25-43e5-b830-e046c77020b1 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.308726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27145e9-d4e1-44c9-a25f-78680bbf6bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.310041 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27145e9-d4e1-44c9-a25f-78680bbf6bca admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.310432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27145e9-d4e1-44c9-a25f-78680bbf6bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.310877 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27145e9-d4e1-44c9-a25f-78680bbf6bca admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.311666 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27145e9-d4e1-44c9-a25f-78680bbf6bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.311775 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ea955-774c-4f01-9d3d-fade9a386b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.312387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ea955-774c-4f01-9d3d-fade9a386b40 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.312678 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ea955-774c-4f01-9d3d-fade9a386b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.312958 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ea955-774c-4f01-9d3d-fade9a386b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.313676 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ea955-774c-4f01-9d3d-fade9a386b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.313895 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27145e9-d4e1-44c9-a25f-78680bbf6bca admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.315297 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ea955-774c-4f01-9d3d-fade9a386b40 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.325612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 789/1571] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:08.326390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ea955-774c-4f01-9d3d-fade9a386b40 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.336871 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ea955-774c-4f01-9d3d-fade9a386b40 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.340253 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 783/1572] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:08 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:08.341610 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27145e9-d4e1-44c9-a25f-78680bbf6bca admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.342645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba632b-e4f1-45ae-a6bf-436d7e2f95ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.343435 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba632b-e4f1-45ae-a6bf-436d7e2f95ff admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.343968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba632b-e4f1-45ae-a6bf-436d7e2f95ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.344317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba632b-e4f1-45ae-a6bf-436d7e2f95ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.345069 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba632b-e4f1-45ae-a6bf-436d7e2f95ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.347234 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba632b-e4f1-45ae-a6bf-436d7e2f95ff admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.374436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 790/1573] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:08 2022] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:08.375831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08122a83-84f6-4388-9d9c-9ea7018d1caa None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.376114 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08122a83-84f6-4388-9d9c-9ea7018d1caa None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.376386 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08122a83-84f6-4388-9d9c-9ea7018d1caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.382522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:08.394391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-08122a83-84f6-4388-9d9c-9ea7018d1caa None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:08.395739 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-08122a83-84f6-4388-9d9c-9ea7018d1caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:08.407107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27145e9-d4e1-44c9-a25f-78680bbf6bca admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.408217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:08.457815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 791/1574] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:08.458787 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08122a83-84f6-4388-9d9c-9ea7018d1caa None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.464270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b241b-8689-46b6-b1b9-a9462441fa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.464948 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b241b-8689-46b6-b1b9-a9462441fa57 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.465238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b241b-8689-46b6-b1b9-a9462441fa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.465518 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b241b-8689-46b6-b1b9-a9462441fa57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.466791 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b241b-8689-46b6-b1b9-a9462441fa57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.468517 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08122a83-84f6-4388-9d9c-9ea7018d1caa None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.468665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b241b-8689-46b6-b1b9-a9462441fa57 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.473294 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213004b9-c308-4274-843d-2238efbf1063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.473951 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213004b9-c308-4274-843d-2238efbf1063 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.474232 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213004b9-c308-4274-843d-2238efbf1063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.474524 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213004b9-c308-4274-843d-2238efbf1063 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.475224 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213004b9-c308-4274-843d-2238efbf1063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.477129 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213004b9-c308-4274-843d-2238efbf1063 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.482585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 784/1575] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:08.482585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b241b-8689-46b6-b1b9-a9462441fa57 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.492353 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b241b-8689-46b6-b1b9-a9462441fa57 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.498402 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a16da-91eb-4e3a-a401-310a1cc903b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.499165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a16da-91eb-4e3a-a401-310a1cc903b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.499513 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a16da-91eb-4e3a-a401-310a1cc903b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.499819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a16da-91eb-4e3a-a401-310a1cc903b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.500715 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a16da-91eb-4e3a-a401-310a1cc903b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:08.501061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a16da-91eb-4e3a-a401-310a1cc903b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.502999 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a16da-91eb-4e3a-a401-310a1cc903b7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.504757 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 792/1576] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:08 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:08.505593 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213004b9-c308-4274-843d-2238efbf1063 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.519516 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 785/1577] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:08.520650 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a16da-91eb-4e3a-a401-310a1cc903b7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.535917 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a16da-91eb-4e3a-a401-310a1cc903b7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.566860 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213004b9-c308-4274-843d-2238efbf1063 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.572339 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5c862-1920-49e0-a16a-47b0b0effc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.572996 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5c862-1920-49e0-a16a-47b0b0effc67 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.573285 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5c862-1920-49e0-a16a-47b0b0effc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.573563 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5c862-1920-49e0-a16a-47b0b0effc67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.574287 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5c862-1920-49e0-a16a-47b0b0effc67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:08.574620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5c862-1920-49e0-a16a-47b0b0effc67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.576333 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5c862-1920-49e0-a16a-47b0b0effc67 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.588163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 793/1578] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:08.595376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5c862-1920-49e0-a16a-47b0b0effc67 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.598048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e2d2b-99ab-4d03-a3f1-42096e7b8af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.598746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e2d2b-99ab-4d03-a3f1-42096e7b8af0 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.599030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e2d2b-99ab-4d03-a3f1-42096e7b8af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.599311 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e2d2b-99ab-4d03-a3f1-42096e7b8af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.600050 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e2d2b-99ab-4d03-a3f1-42096e7b8af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.601653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e2d2b-99ab-4d03-a3f1-42096e7b8af0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.605653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5c862-1920-49e0-a16a-47b0b0effc67 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.610273 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76893ca6-7aa3-4db5-b10f-54d67447e6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.610966 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76893ca6-7aa3-4db5-b10f-54d67447e6a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.611259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76893ca6-7aa3-4db5-b10f-54d67447e6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.611541 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76893ca6-7aa3-4db5-b10f-54d67447e6a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.612045 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 786/1579] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:08.612250 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76893ca6-7aa3-4db5-b10f-54d67447e6a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.612837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e2d2b-99ab-4d03-a3f1-42096e7b8af0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.614274 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76893ca6-7aa3-4db5-b10f-54d67447e6a5 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.623319 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e2d2b-99ab-4d03-a3f1-42096e7b8af0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.629112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c60ea3-56ab-49cb-b859-7f81699dc209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.629933 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c60ea3-56ab-49cb-b859-7f81699dc209 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.630236 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c60ea3-56ab-49cb-b859-7f81699dc209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.630493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c60ea3-56ab-49cb-b859-7f81699dc209 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.631284 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c60ea3-56ab-49cb-b859-7f81699dc209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.633361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c60ea3-56ab-49cb-b859-7f81699dc209 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.638403 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 794/1580] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:08 2022] POST /identity/v3/users => generated 293 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:08.639089 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76893ca6-7aa3-4db5-b10f-54d67447e6a5 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.657984 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 787/1581] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:08 2022] POST /identity/v3/users => generated 278 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:08.657984 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c60ea3-56ab-49cb-b859-7f81699dc209 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.665464 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c60ea3-56ab-49cb-b859-7f81699dc209 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.671139 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1dc7a-f1a8-44ee-becd-3e488060d052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.671853 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1dc7a-f1a8-44ee-becd-3e488060d052 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.672632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1dc7a-f1a8-44ee-becd-3e488060d052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.673030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1dc7a-f1a8-44ee-becd-3e488060d052 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.673677 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1dc7a-f1a8-44ee-becd-3e488060d052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.675334 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1dc7a-f1a8-44ee-becd-3e488060d052 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.687764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 788/1582] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:08.688695 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1dc7a-f1a8-44ee-becd-3e488060d052 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.697450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76893ca6-7aa3-4db5-b10f-54d67447e6a5 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.698321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1dc7a-f1a8-44ee-becd-3e488060d052 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.701077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec342b1-8803-4824-947e-8b1cedd85d15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.701718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec342b1-8803-4824-947e-8b1cedd85d15 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.702105 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec342b1-8803-4824-947e-8b1cedd85d15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.702388 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec342b1-8803-4824-947e-8b1cedd85d15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.703338 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb1eb6-d999-4eaf-b414-4b75edcba9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.703970 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb1eb6-d999-4eaf-b414-4b75edcba9fa admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.704254 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb1eb6-d999-4eaf-b414-4b75edcba9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.704527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb1eb6-d999-4eaf-b414-4b75edcba9fa admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.705196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb1eb6-d999-4eaf-b414-4b75edcba9fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.707124 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb1eb6-d999-4eaf-b414-4b75edcba9fa admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.711546 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec342b1-8803-4824-947e-8b1cedd85d15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.712925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec342b1-8803-4824-947e-8b1cedd85d15 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.723172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 795/1583] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:08.724033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec342b1-8803-4824-947e-8b1cedd85d15 service neutron] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.729814 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 789/1584] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:08 2022] POST /identity/v3/users => generated 302 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:08.729814 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb1eb6-d999-4eaf-b414-4b75edcba9fa admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.736701 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec342b1-8803-4824-947e-8b1cedd85d15 service neutron] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.740358 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb1eb6-d999-4eaf-b414-4b75edcba9fa admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.741086 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e7a40-b670-40b5-b859-d042687a7d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.741847 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7a40-b670-40b5-b859-d042687a7d01 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.742129 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7a40-b670-40b5-b859-d042687a7d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.742407 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7a40-b670-40b5-b859-d042687a7d01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.743150 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e7a40-b670-40b5-b859-d042687a7d01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.745056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e7a40-b670-40b5-b859-d042687a7d01 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.745886 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a4a50-2186-4286-9898-ca48947ab5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.746621 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a4a50-2186-4286-9898-ca48947ab5e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.747603 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a4a50-2186-4286-9898-ca48947ab5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.747993 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a4a50-2186-4286-9898-ca48947ab5e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.748744 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a4a50-2186-4286-9898-ca48947ab5e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.750731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a4a50-2186-4286-9898-ca48947ab5e3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.760296 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:08.765222 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:08.777072 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 796/1585] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:08 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:08.779418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e7a40-b670-40b5-b859-d042687a7d01 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.782656 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 790/1586] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:08 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:08.783329 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a4a50-2186-4286-9898-ca48947ab5e3 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.853251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a4a50-2186-4286-9898-ca48947ab5e3 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.855522 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e7a40-b670-40b5-b859-d042687a7d01 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.860453 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf2d90-7646-4e2d-b384-8a04eaf29f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.861642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf2d90-7646-4e2d-b384-8a04eaf29f28 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.861929 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf2d90-7646-4e2d-b384-8a04eaf29f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.862237 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf2d90-7646-4e2d-b384-8a04eaf29f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.863035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf2d90-7646-4e2d-b384-8a04eaf29f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.864630 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf2d90-7646-4e2d-b384-8a04eaf29f28 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.864763 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfaf07-7ab3-42de-95b7-a9f33737754a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.865702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfaf07-7ab3-42de-95b7-a9f33737754a admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.866177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfaf07-7ab3-42de-95b7-a9f33737754a admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.866460 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfaf07-7ab3-42de-95b7-a9f33737754a admin admin] PATH_INFO: `/v3/projects/cc4c35e61aa244e78dbb0c254b77fda6/users/ae9ed5cec9cb45f58203e41048d8e09a/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.879434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 791/1587] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:08.880811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf2d90-7646-4e2d-b384-8a04eaf29f28 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.883014 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbfaf07-7ab3-42de-95b7-a9f33737754a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc4c35e61aa244e78dbb0c254b77fda6, user_id=ae9ed5cec9cb45f58203e41048d8e09a, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.885669 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbfaf07-7ab3-42de-95b7-a9f33737754a admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.893373 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf2d90-7646-4e2d-b384-8a04eaf29f28 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.899408 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1951a4-206f-4690-a408-76b6c5d56d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.900278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1951a4-206f-4690-a408-76b6c5d56d46 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.900396 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1951a4-206f-4690-a408-76b6c5d56d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.900656 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1951a4-206f-4690-a408-76b6c5d56d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:08.901539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 797/1588] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:08 2022] PUT /identity/v3/projects/cc4c35e61aa244e78dbb0c254b77fda6/users/ae9ed5cec9cb45f58203e41048d8e09a/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:08.901669 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1951a4-206f-4690-a408-76b6c5d56d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:08.902368 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfaf07-7ab3-42de-95b7-a9f33737754a admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.903998 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1951a4-206f-4690-a408-76b6c5d56d46 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:08.916349 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 792/1589] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:08.917153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1951a4-206f-4690-a408-76b6c5d56d46 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:08.927505 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1951a4-206f-4690-a408-76b6c5d56d46 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.976932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfaf07-7ab3-42de-95b7-a9f33737754a admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:08.982626 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac1879-2566-4dbb-ab80-9ca7a66583ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:08.983570 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac1879-2566-4dbb-ab80-9ca7a66583ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:08.983852 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac1879-2566-4dbb-ab80-9ca7a66583ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:08.984157 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac1879-2566-4dbb-ab80-9ca7a66583ce admin admin] PATH_INFO: `/v3/projects/4f55dfcc08704b20ae75695f9cd15b15/users/d662d743df1f47e88185e9ac3412ef43/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.000240 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac1879-2566-4dbb-ab80-9ca7a66583ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f55dfcc08704b20ae75695f9cd15b15, user_id=d662d743df1f47e88185e9ac3412ef43, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:09.001895 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e1260-4b8c-4b3e-b5b4-5fde1a8a81bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:09.002602 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e1260-4b8c-4b3e-b5b4-5fde1a8a81bf admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.002893 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e1260-4b8c-4b3e-b5b4-5fde1a8a81bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.003178 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e1260-4b8c-4b3e-b5b4-5fde1a8a81bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.003466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac1879-2566-4dbb-ab80-9ca7a66583ce admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:09.003921 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e1260-4b8c-4b3e-b5b4-5fde1a8a81bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:09.005633 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e1260-4b8c-4b3e-b5b4-5fde1a8a81bf admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:09.019873 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 793/1590] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:09.020097 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 798/1591] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:08 2022] PUT /identity/v3/projects/4f55dfcc08704b20ae75695f9cd15b15/users/d662d743df1f47e88185e9ac3412ef43/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:09.020097 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac1879-2566-4dbb-ab80-9ca7a66583ce admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:09.021524 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e1260-4b8c-4b3e-b5b4-5fde1a8a81bf admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:09.031823 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e1260-4b8c-4b3e-b5b4-5fde1a8a81bf admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:09.104826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac1879-2566-4dbb-ab80-9ca7a66583ce admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:09.114568 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5087d-5b02-4139-9cbb-09206a426091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:09.115293 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5087d-5b02-4139-9cbb-09206a426091 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.115699 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5087d-5b02-4139-9cbb-09206a426091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.116081 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5087d-5b02-4139-9cbb-09206a426091 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.116879 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5087d-5b02-4139-9cbb-09206a426091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:09.119058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5087d-5b02-4139-9cbb-09206a426091 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:09.119621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f8a00-c9f4-429c-b4b4-cac49ad93cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:09.120618 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f8a00-c9f4-429c-b4b4-cac49ad93cde admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.121213 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f8a00-c9f4-429c-b4b4-cac49ad93cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.121699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f8a00-c9f4-429c-b4b4-cac49ad93cde admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.123239 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f8a00-c9f4-429c-b4b4-cac49ad93cde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:09.125355 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f8a00-c9f4-429c-b4b4-cac49ad93cde admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:09.134862 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:09.148719 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 794/1592] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:09 2022] POST /identity/v3/users => generated 296 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:09.153934 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5087d-5b02-4139-9cbb-09206a426091 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:09.160510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 799/1593] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:09 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:09.162463 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:09.163567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809946ac-9814-4281-83c4-a1ba824600ff None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.164179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809946ac-9814-4281-83c4-a1ba824600ff None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.164535 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809946ac-9814-4281-83c4-a1ba824600ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.167291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5087d-5b02-4139-9cbb-09206a426091 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:09.176155 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d7a89-de3d-4df6-999b-f891d10cae34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:09.177291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d7a89-de3d-4df6-999b-f891d10cae34 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.177933 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d7a89-de3d-4df6-999b-f891d10cae34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.178626 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d7a89-de3d-4df6-999b-f891d10cae34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.179463 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d7a89-de3d-4df6-999b-f891d10cae34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:09.181231 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d7a89-de3d-4df6-999b-f891d10cae34 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:09.188179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-809946ac-9814-4281-83c4-a1ba824600ff None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:09.189606 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-809946ac-9814-4281-83c4-a1ba824600ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:09.197872 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 795/1594] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:09.198687 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d7a89-de3d-4df6-999b-f891d10cae34 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:09.204357 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 800/1595] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:09.204357 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809946ac-9814-4281-83c4-a1ba824600ff None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:09.209731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d7a89-de3d-4df6-999b-f891d10cae34 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:09.214890 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a8364-da7c-4ba1-b5ba-f4419d3fe352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:09.216078 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a8364-da7c-4ba1-b5ba-f4419d3fe352 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.216440 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a8364-da7c-4ba1-b5ba-f4419d3fe352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.216787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a8364-da7c-4ba1-b5ba-f4419d3fe352 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.217629 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a8364-da7c-4ba1-b5ba-f4419d3fe352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:09.219367 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a8364-da7c-4ba1-b5ba-f4419d3fe352 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:09.220253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809946ac-9814-4281-83c4-a1ba824600ff None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:09.225713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36294f19-075e-40ba-8530-3a6484843eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:09.226383 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36294f19-075e-40ba-8530-3a6484843eac admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.226703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36294f19-075e-40ba-8530-3a6484843eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.226980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36294f19-075e-40ba-8530-3a6484843eac admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.227701 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36294f19-075e-40ba-8530-3a6484843eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:09.229303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36294f19-075e-40ba-8530-3a6484843eac admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:09.234779 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 796/1596] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:09.234779 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedaeb5-36d2-42ea-a02f-76398f0d37a9 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.234779 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedaeb5-36d2-42ea-a02f-76398f0d37a9 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.234779 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedaeb5-36d2-42ea-a02f-76398f0d37a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.243364 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 801/1597] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:09.243364 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36294f19-075e-40ba-8530-3a6484843eac admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:09.252289 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36294f19-075e-40ba-8530-3a6484843eac admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:09.255389 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ddedaeb5-36d2-42ea-a02f-76398f0d37a9 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:09.256629 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ddedaeb5-36d2-42ea-a02f-76398f0d37a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:09.257702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef81ba-f38f-4b8f-a1b5-d6054bab2a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:09.258462 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef81ba-f38f-4b8f-a1b5-d6054bab2a3f admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.258876 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef81ba-f38f-4b8f-a1b5-d6054bab2a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.259418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef81ba-f38f-4b8f-a1b5-d6054bab2a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.260121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef81ba-f38f-4b8f-a1b5-d6054bab2a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:09.261782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef81ba-f38f-4b8f-a1b5-d6054bab2a3f admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:09.268812 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 797/1598] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:09.268812 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedaeb5-36d2-42ea-a02f-76398f0d37a9 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:09.275920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 802/1599] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:09.275920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef81ba-f38f-4b8f-a1b5-d6054bab2a3f admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:09.284423 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedaeb5-36d2-42ea-a02f-76398f0d37a9 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:09.287676 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef81ba-f38f-4b8f-a1b5-d6054bab2a3f admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:09.290068 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ac6d7-f83e-4e25-8d08-4487dd6ea143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:09.291105 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ac6d7-f83e-4e25-8d08-4487dd6ea143 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.291677 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ac6d7-f83e-4e25-8d08-4487dd6ea143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.292344 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ac6d7-f83e-4e25-8d08-4487dd6ea143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.293126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b7aea-b4e8-4100-9e7a-76b131a28de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:09.293806 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ac6d7-f83e-4e25-8d08-4487dd6ea143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:09.294120 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b7aea-b4e8-4100-9e7a-76b131a28de6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.294416 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b7aea-b4e8-4100-9e7a-76b131a28de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.294843 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b7aea-b4e8-4100-9e7a-76b131a28de6 admin admin] PATH_INFO: `/v3/projects/d726f7e8c6c74e1694cae065b0ab9b6f/users/492407d05b774097986528adef850129/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.296416 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ac6d7-f83e-4e25-8d08-4487dd6ea143 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:09.311224 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b7aea-b4e8-4100-9e7a-76b131a28de6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d726f7e8c6c74e1694cae065b0ab9b6f, user_id=492407d05b774097986528adef850129, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:09.312916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 798/1600] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:09.314440 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ac6d7-f83e-4e25-8d08-4487dd6ea143 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:09.316903 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b7aea-b4e8-4100-9e7a-76b131a28de6 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:09.332312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 803/1601] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:09 2022] PUT /identity/v3/projects/d726f7e8c6c74e1694cae065b0ab9b6f/users/492407d05b774097986528adef850129/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:09.333603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b7aea-b4e8-4100-9e7a-76b131a28de6 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:09.377896 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ac6d7-f83e-4e25-8d08-4487dd6ea143 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:09.414831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b7aea-b4e8-4100-9e7a-76b131a28de6 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:09.421271 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a12c76-1e8c-4dea-89ea-21daccb6777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:09.423155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a12c76-1e8c-4dea-89ea-21daccb6777a admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.423656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a12c76-1e8c-4dea-89ea-21daccb6777a admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.424129 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a12c76-1e8c-4dea-89ea-21daccb6777a admin admin] PATH_INFO: `/v3/projects/df75346d10fe4ec8b34fbcc0a78351ff/users/7a40e2afe28844839ba0274b7eb5a15d/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.440375 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd74b3b-4158-4ad5-bfbb-da1d30097999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:09.441067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd74b3b-4158-4ad5-bfbb-da1d30097999 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.441337 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd74b3b-4158-4ad5-bfbb-da1d30097999 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.441613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd74b3b-4158-4ad5-bfbb-da1d30097999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.441871 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a12c76-1e8c-4dea-89ea-21daccb6777a admin admin] RBAC: Authorizing `identity:create_grant(project_id=df75346d10fe4ec8b34fbcc0a78351ff, user_id=7a40e2afe28844839ba0274b7eb5a15d, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:09.444662 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a12c76-1e8c-4dea-89ea-21daccb6777a admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:09.453498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd74b3b-4158-4ad5-bfbb-da1d30097999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:09.458627 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd74b3b-4158-4ad5-bfbb-da1d30097999 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:09.460199 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 804/1602] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:09 2022] PUT /identity/v3/projects/df75346d10fe4ec8b34fbcc0a78351ff/users/7a40e2afe28844839ba0274b7eb5a15d/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:09.470152 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a12c76-1e8c-4dea-89ea-21daccb6777a admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:09.473245 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 799/1603] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:09.473968 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd74b3b-4158-4ad5-bfbb-da1d30097999 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:09.485162 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd74b3b-4158-4ad5-bfbb-da1d30097999 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:09.566020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518aaff0-f3bd-4370-b210-158e9964bc8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:09.567008 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518aaff0-f3bd-4370-b210-158e9964bc8d service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.567648 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518aaff0-f3bd-4370-b210-158e9964bc8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.568322 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518aaff0-f3bd-4370-b210-158e9964bc8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.586240 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a12c76-1e8c-4dea-89ea-21daccb6777a admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:09.590282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518aaff0-f3bd-4370-b210-158e9964bc8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:09.593024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518aaff0-f3bd-4370-b210-158e9964bc8d service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:09.599485 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdab9c-969f-4cf2-99f4-dd8b804e9187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:09.600515 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdab9c-969f-4cf2-99f4-dd8b804e9187 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.600868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdab9c-969f-4cf2-99f4-dd8b804e9187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.601205 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdab9c-969f-4cf2-99f4-dd8b804e9187 admin admin] PATH_INFO: `/v3/projects/17044a57be5648feb1b74113ef334c2c/users/0d137801c3154dd195c689d2ecf6e315/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.615173 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 800/1604] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:09.616453 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518aaff0-f3bd-4370-b210-158e9964bc8d service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:09.627871 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518aaff0-f3bd-4370-b210-158e9964bc8d service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:09.633514 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdab9c-969f-4cf2-99f4-dd8b804e9187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17044a57be5648feb1b74113ef334c2c, user_id=0d137801c3154dd195c689d2ecf6e315, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:09.633882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e38360-8dc9-4c42-8c5d-f93ccce3b5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:09.635017 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e38360-8dc9-4c42-8c5d-f93ccce3b5ad admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.636977 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e38360-8dc9-4c42-8c5d-f93ccce3b5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.636977 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e38360-8dc9-4c42-8c5d-f93ccce3b5ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.637185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdab9c-969f-4cf2-99f4-dd8b804e9187 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:09.637278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e38360-8dc9-4c42-8c5d-f93ccce3b5ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:09.640815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e38360-8dc9-4c42-8c5d-f93ccce3b5ad admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:09.659158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 801/1605] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:09.660655 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e38360-8dc9-4c42-8c5d-f93ccce3b5ad admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:09.676782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 805/1606] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:09 2022] PUT /identity/v3/projects/17044a57be5648feb1b74113ef334c2c/users/0d137801c3154dd195c689d2ecf6e315/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:09.680978 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e38360-8dc9-4c42-8c5d-f93ccce3b5ad admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:09.681555 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d122831-1d90-46fa-ab18-ceb4fe8c1f42 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.682314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d122831-1d90-46fa-ab18-ceb4fe8c1f42 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.682656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d122831-1d90-46fa-ab18-ceb4fe8c1f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.699893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:09.716713 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:09.740068 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-4d122831-1d90-46fa-ab18-ceb4fe8c1f42 None None] MFA Rules not processed for user `492407d05b774097986528adef850129`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:09.742115 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-4d122831-1d90-46fa-ab18-ceb4fe8c1f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:09.825609 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7df58-84d3-4d70-bfe1-50805724260d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:09.826294 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7df58-84d3-4d70-bfe1-50805724260d admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.826700 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7df58-84d3-4d70-bfe1-50805724260d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.826845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7df58-84d3-4d70-bfe1-50805724260d admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.827592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7df58-84d3-4d70-bfe1-50805724260d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:09.830349 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7df58-84d3-4d70-bfe1-50805724260d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:09.855711 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 802/1607] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:09.857290 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68064ec1-53fb-441a-8191-107bcab6f319 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.857544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68064ec1-53fb-441a-8191-107bcab6f319 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.857994 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68064ec1-53fb-441a-8191-107bcab6f319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.874048 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 806/1608] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:09.875862 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d122831-1d90-46fa-ab18-ceb4fe8c1f42 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:09.907236 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d122831-1d90-46fa-ab18-ceb4fe8c1f42 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:09.923232 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13c3cb-c92f-4d48-aa63-85585d4ee9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:09.924138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13c3cb-c92f-4d48-aa63-85585d4ee9d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:09.924422 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13c3cb-c92f-4d48-aa63-85585d4ee9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:09.924767 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13c3cb-c92f-4d48-aa63-85585d4ee9d1 admin admin] PATH_INFO: `/v3/projects/190b7fcba31e4f54bf934b874c90d1b1/users/261b8d67ef5847dc9117663de3f5c837/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:09.931811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-68064ec1-53fb-441a-8191-107bcab6f319 None None] MFA Rules not processed for user `7a40e2afe28844839ba0274b7eb5a15d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:09.935561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-68064ec1-53fb-441a-8191-107bcab6f319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:09.965565 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13c3cb-c92f-4d48-aa63-85585d4ee9d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=190b7fcba31e4f54bf934b874c90d1b1, user_id=261b8d67ef5847dc9117663de3f5c837, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:09.968356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13c3cb-c92f-4d48-aa63-85585d4ee9d1 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:09.997766 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 807/1609] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:09 2022] PUT /identity/v3/projects/190b7fcba31e4f54bf934b874c90d1b1/users/261b8d67ef5847dc9117663de3f5c837/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:09.999230 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cacb1e-dbef-4740-98e9-e4fd92855e02 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.000246 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cacb1e-dbef-4740-98e9-e4fd92855e02 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.000246 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cacb1e-dbef-4740-98e9-e4fd92855e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.047763 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-a0cacb1e-dbef-4740-98e9-e4fd92855e02 None None] MFA Rules not processed for user `0d137801c3154dd195c689d2ecf6e315`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:10.049160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-a0cacb1e-dbef-4740-98e9-e4fd92855e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:10.055985 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 803/1610] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:09 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:10.056234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68064ec1-53fb-441a-8191-107bcab6f319 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:10.071361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68064ec1-53fb-441a-8191-107bcab6f319 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:10.173604 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea1f24-a537-4292-959c-ae30179d724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:10.174267 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea1f24-a537-4292-959c-ae30179d724f admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.174579 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea1f24-a537-4292-959c-ae30179d724f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.174864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea1f24-a537-4292-959c-ae30179d724f admin admin] PATH_INFO: `/v3/projects/89b4af8cf0c048d49c097cadfad619cd/users/48b05708d3e344d89f964cdcdf2e5b23/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.178134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 808/1611] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:10.188317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ab996-3232-4531-96fd-cab97134048d None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.188674 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ab996-3232-4531-96fd-cab97134048d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.188884 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ab996-3232-4531-96fd-cab97134048d None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.191383 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 809/1612] 10.222.0.25 () {54 vars in 961 bytes} [Mon May 23 12:33:10 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:10.192542 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e22331-975e-4bbf-923d-c3282b879af0 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.192840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e22331-975e-4bbf-923d-c3282b879af0 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.193126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e22331-975e-4bbf-923d-c3282b879af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.212862 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea1f24-a537-4292-959c-ae30179d724f admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b4af8cf0c048d49c097cadfad619cd, user_id=48b05708d3e344d89f964cdcdf2e5b23, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:10.216374 dv-cinder-836996-27-smb devstack@keystone.service[80198]: WARNING py.warnings [None req-fdea1f24-a537-4292-959c-ae30179d724f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 12:33:10.216374 dv-cinder-836996-27-smb devstack@keystone.service[80198]: warnings.warn(msg) May 23 12:33:10.216374 dv-cinder-836996-27-smb devstack@keystone.service[80198]: May 23 12:33:10.220105 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea1f24-a537-4292-959c-ae30179d724f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:10.267424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-b7e22331-975e-4bbf-923d-c3282b879af0 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:10.277023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-b7e22331-975e-4bbf-923d-c3282b879af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:10.283501 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 804/1613] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:10 2022] PUT /identity/v3/projects/89b4af8cf0c048d49c097cadfad619cd/users/48b05708d3e344d89f964cdcdf2e5b23/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:10.284876 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea1f24-a537-4292-959c-ae30179d724f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:10.390125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:10.437908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:10.462183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 810/1614] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:10.463545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e22331-975e-4bbf-923d-c3282b879af0 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:10.468564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea1f24-a537-4292-959c-ae30179d724f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:10.481006 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5288c-cf6f-4ef6-994b-95ca8c88f7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:10.482104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5288c-cf6f-4ef6-994b-95ca8c88f7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.482417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5288c-cf6f-4ef6-994b-95ca8c88f7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.482707 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5288c-cf6f-4ef6-994b-95ca8c88f7b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.483465 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5288c-cf6f-4ef6-994b-95ca8c88f7b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:10.484025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e22331-975e-4bbf-923d-c3282b879af0 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:10.487260 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5288c-cf6f-4ef6-994b-95ca8c88f7b5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:10.499353 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd35ec-d2f0-4807-800c-1f9201246794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:10.500327 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd35ec-d2f0-4807-800c-1f9201246794 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.500767 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd35ec-d2f0-4807-800c-1f9201246794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.501251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd35ec-d2f0-4807-800c-1f9201246794 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.503242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd35ec-d2f0-4807-800c-1f9201246794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:10.505866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd35ec-d2f0-4807-800c-1f9201246794 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:10.532682 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 805/1615] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:10 2022] POST /identity/v3/projects => generated 357 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:10.536583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbac80d-8461-44c0-8997-9d4406f6ac53 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.536889 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbac80d-8461-44c0-8997-9d4406f6ac53 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.537219 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbac80d-8461-44c0-8997-9d4406f6ac53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.567389 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 811/1616] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:10 2022] POST /identity/v3/projects => generated 405 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:10.568757 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94cd0d-e19f-4277-a457-1d3e15d0e088 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.569052 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94cd0d-e19f-4277-a457-1d3e15d0e088 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.569373 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94cd0d-e19f-4277-a457-1d3e15d0e088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.591725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-fdbac80d-8461-44c0-8997-9d4406f6ac53 None None] MFA Rules not processed for user `d49997b9108145b78eb4db1d8823bf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:10.593668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fdbac80d-8461-44c0-8997-9d4406f6ac53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:10.604361 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-2b94cd0d-e19f-4277-a457-1d3e15d0e088 None None] MFA Rules not processed for user `48b05708d3e344d89f964cdcdf2e5b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:10.606166 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-2b94cd0d-e19f-4277-a457-1d3e15d0e088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:10.721238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 812/1617] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:10.726426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94cd0d-e19f-4277-a457-1d3e15d0e088 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:10.730973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 806/1618] 10.222.0.25 () {58 vars in 1058 bytes} [Mon May 23 12:33:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:10.731902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbac80d-8461-44c0-8997-9d4406f6ac53 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:10.832102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94cd0d-e19f-4277-a457-1d3e15d0e088 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:10.848418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423b4eb-2690-4d70-8760-fbdf6a3507a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:10.849256 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423b4eb-2690-4d70-8760-fbdf6a3507a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.849545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423b4eb-2690-4d70-8760-fbdf6a3507a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.849827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423b4eb-2690-4d70-8760-fbdf6a3507a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.881370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbac80d-8461-44c0-8997-9d4406f6ac53 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:10.890454 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840a35e-d7b0-4277-9df7-957f6a4ac902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:10.891600 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840a35e-d7b0-4277-9df7-957f6a4ac902 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.891745 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840a35e-d7b0-4277-9df7-957f6a4ac902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.892127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840a35e-d7b0-4277-9df7-957f6a4ac902 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.892962 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840a35e-d7b0-4277-9df7-957f6a4ac902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:10.895152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840a35e-d7b0-4277-9df7-957f6a4ac902 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:10.929147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 807/1619] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:10 2022] POST /identity/v3/users => generated 285 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:10.930873 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840a35e-d7b0-4277-9df7-957f6a4ac902 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:10.943450 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840a35e-d7b0-4277-9df7-957f6a4ac902 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:10.948875 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cfc8c-3a07-4558-9e5e-f4b8ee753edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:10.950963 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cfc8c-3a07-4558-9e5e-f4b8ee753edc admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:10.951403 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cfc8c-3a07-4558-9e5e-f4b8ee753edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:10.951829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cfc8c-3a07-4558-9e5e-f4b8ee753edc admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:10.952770 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cfc8c-3a07-4558-9e5e-f4b8ee753edc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:10.955135 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cfc8c-3a07-4558-9e5e-f4b8ee753edc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:10.976363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423b4eb-2690-4d70-8760-fbdf6a3507a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:10.978538 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423b4eb-2690-4d70-8760-fbdf6a3507a9 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:10.986642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 808/1620] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:10 2022] POST /identity/v3/users => generated 309 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:10.987664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cfc8c-3a07-4558-9e5e-f4b8ee753edc admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:10.992391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 813/1621] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:10.994046 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423b4eb-2690-4d70-8760-fbdf6a3507a9 service neutron] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:11.000075 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cfc8c-3a07-4558-9e5e-f4b8ee753edc admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:11.007881 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f3b36-e60a-4e26-9be9-5c699d8f22b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:11.009738 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423b4eb-2690-4d70-8760-fbdf6a3507a9 service neutron] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:11.011459 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f3b36-e60a-4e26-9be9-5c699d8f22b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:11.011901 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f3b36-e60a-4e26-9be9-5c699d8f22b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:11.012197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f3b36-e60a-4e26-9be9-5c699d8f22b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:11.013777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f3b36-e60a-4e26-9be9-5c699d8f22b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:11.016220 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f3b36-e60a-4e26-9be9-5c699d8f22b6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:11.020493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f20d33-94f6-4b44-80f2-21e2e3e4c0c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:11.021539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f20d33-94f6-4b44-80f2-21e2e3e4c0c4 service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:11.022044 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f20d33-94f6-4b44-80f2-21e2e3e4c0c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:11.022538 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f20d33-94f6-4b44-80f2-21e2e3e4c0c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:11.035584 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:11.084371 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 809/1622] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:10 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:11.086895 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb8976-f6cb-4c74-ade9-44d0ac4d4e0c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:11.087724 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb8976-f6cb-4c74-ade9-44d0ac4d4e0c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:11.088397 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb8976-f6cb-4c74-ade9-44d0ac4d4e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:11.091726 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:11.186840 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b4cb8976-f6cb-4c74-ade9-44d0ac4d4e0c None None] MFA Rules not processed for user `d662d743df1f47e88185e9ac3412ef43`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:11.186840 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b4cb8976-f6cb-4c74-ade9-44d0ac4d4e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:11.239170 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f20d33-94f6-4b44-80f2-21e2e3e4c0c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:11.241316 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f20d33-94f6-4b44-80f2-21e2e3e4c0c4 service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:11.267722 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 814/1623] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:11.268523 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f20d33-94f6-4b44-80f2-21e2e3e4c0c4 service nova] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:11.297932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f20d33-94f6-4b44-80f2-21e2e3e4c0c4 service nova] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:11.327811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 810/1624] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:11.330198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb8976-f6cb-4c74-ade9-44d0ac4d4e0c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:11.456362 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9c766-4e75-4662-819d-d4a84e6f84dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:11.457060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9c766-4e75-4662-819d-d4a84e6f84dd admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:11.457349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9c766-4e75-4662-819d-d4a84e6f84dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:11.457813 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9c766-4e75-4662-819d-d4a84e6f84dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:11.458592 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9c766-4e75-4662-819d-d4a84e6f84dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:11.463792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9c766-4e75-4662-819d-d4a84e6f84dd admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:11.489888 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb8976-f6cb-4c74-ade9-44d0ac4d4e0c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:11.491521 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 815/1625] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:11.492707 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9c766-4e75-4662-819d-d4a84e6f84dd admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:11.495652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305754e-d2c9-4c75-8405-16dd340c5484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:11.496624 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305754e-d2c9-4c75-8405-16dd340c5484 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:11.497772 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305754e-d2c9-4c75-8405-16dd340c5484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:11.498241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305754e-d2c9-4c75-8405-16dd340c5484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:11.499238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305754e-d2c9-4c75-8405-16dd340c5484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:11.501220 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305754e-d2c9-4c75-8405-16dd340c5484 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:11.513889 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9c766-4e75-4662-819d-d4a84e6f84dd admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:11.519072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 811/1626] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:11.521051 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26cbb1-650d-4ab2-a162-d6338eb0a781 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:11.521564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26cbb1-650d-4ab2-a162-d6338eb0a781 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:11.522048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26cbb1-650d-4ab2-a162-d6338eb0a781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:11.529081 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fcfaa-3615-46f0-89c5-c2c48bfdd988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:11.530072 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fcfaa-3615-46f0-89c5-c2c48bfdd988 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:11.530629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fcfaa-3615-46f0-89c5-c2c48bfdd988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:11.531111 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fcfaa-3615-46f0-89c5-c2c48bfdd988 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:11.531990 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fcfaa-3615-46f0-89c5-c2c48bfdd988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:11.534698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fcfaa-3615-46f0-89c5-c2c48bfdd988 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:11.573316 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-5e26cbb1-650d-4ab2-a162-d6338eb0a781 None None] MFA Rules not processed for user `d662d743df1f47e88185e9ac3412ef43`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:11.576083 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5e26cbb1-650d-4ab2-a162-d6338eb0a781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:11.588760 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 816/1627] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:11 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:11.589700 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fcfaa-3615-46f0-89c5-c2c48bfdd988 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:11.599716 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 812/1628] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:11.604392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26cbb1-650d-4ab2-a162-d6338eb0a781 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:11.616117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fcfaa-3615-46f0-89c5-c2c48bfdd988 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:11.623767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26cbb1-650d-4ab2-a162-d6338eb0a781 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:11.629139 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eb90f-31f5-4554-88af-5fb4659af9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:11.630195 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eb90f-31f5-4554-88af-5fb4659af9db admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:11.630488 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eb90f-31f5-4554-88af-5fb4659af9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:11.630880 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eb90f-31f5-4554-88af-5fb4659af9db admin admin] PATH_INFO: `/v3/projects/837eec4670924e5a813e3e637563e39a/users/eb1efb93ac0347b4bf7fdd757d75fc00/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:11.636034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c9b1b-9b2a-423c-8f45-f788d134d40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:11.638904 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c9b1b-9b2a-423c-8f45-f788d134d40c admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:11.640557 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c9b1b-9b2a-423c-8f45-f788d134d40c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:11.641215 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c9b1b-9b2a-423c-8f45-f788d134d40c admin admin] PATH_INFO: `/v3/projects/1312845278224863b673f137ae321a51/users/84cd981907cd4886827e73fe3a58cd50/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:11.673184 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837eb90f-31f5-4554-88af-5fb4659af9db admin admin] RBAC: Authorizing `identity:create_grant(project_id=837eec4670924e5a813e3e637563e39a, user_id=eb1efb93ac0347b4bf7fdd757d75fc00, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:11.678240 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837eb90f-31f5-4554-88af-5fb4659af9db admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:11.680627 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c9b1b-9b2a-423c-8f45-f788d134d40c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1312845278224863b673f137ae321a51, user_id=84cd981907cd4886827e73fe3a58cd50, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:11.687083 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c9b1b-9b2a-423c-8f45-f788d134d40c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:11.713623 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 817/1629] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:11 2022] PUT /identity/v3/projects/837eec4670924e5a813e3e637563e39a/users/eb1efb93ac0347b4bf7fdd757d75fc00/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:11.716681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eb90f-31f5-4554-88af-5fb4659af9db admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:11.720583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 813/1630] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:11 2022] PUT /identity/v3/projects/1312845278224863b673f137ae321a51/users/84cd981907cd4886827e73fe3a58cd50/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:11.724509 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edba43-847a-4533-ab60-6b3dd709e99d None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:11.724934 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edba43-847a-4533-ab60-6b3dd709e99d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:11.725915 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edba43-847a-4533-ab60-6b3dd709e99d None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:11.730415 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 814/1631] 10.222.0.25 () {54 vars in 961 bytes} [Mon May 23 12:33:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:11.733026 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edba43-847a-4533-ab60-6b3dd709e99d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:11.837231 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eb90f-31f5-4554-88af-5fb4659af9db admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:11.839258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:11.858132 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:11.904282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edba43-847a-4533-ab60-6b3dd709e99d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:11.912900 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be470e-766f-425c-9a9f-46991d1dfada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:11.913863 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be470e-766f-425c-9a9f-46991d1dfada admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:11.914377 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be470e-766f-425c-9a9f-46991d1dfada admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:11.914754 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be470e-766f-425c-9a9f-46991d1dfada admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:11.915717 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be470e-766f-425c-9a9f-46991d1dfada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:11.917484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be470e-766f-425c-9a9f-46991d1dfada admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:11.931941 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 815/1632] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:11.932976 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be470e-766f-425c-9a9f-46991d1dfada admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:11.941223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0a74f-e4bb-49e1-8523-5428969c60b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:11.942146 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0a74f-e4bb-49e1-8523-5428969c60b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:11.942408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0a74f-e4bb-49e1-8523-5428969c60b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:11.942775 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0a74f-e4bb-49e1-8523-5428969c60b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:11.943505 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0a74f-e4bb-49e1-8523-5428969c60b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:11.945263 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0a74f-e4bb-49e1-8523-5428969c60b0 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:11.947028 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be470e-766f-425c-9a9f-46991d1dfada admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:11.953814 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9924f3c-e8e3-4db9-9c37-22c410d7e3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:11.956971 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9924f3c-e8e3-4db9-9c37-22c410d7e3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:11.956971 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9924f3c-e8e3-4db9-9c37-22c410d7e3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:11.956971 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9924f3c-e8e3-4db9-9c37-22c410d7e3c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:11.956971 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9924f3c-e8e3-4db9-9c37-22c410d7e3c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:11.958420 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9924f3c-e8e3-4db9-9c37-22c410d7e3c6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:11.966945 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 818/1633] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:11.971209 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 816/1634] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:11.971603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d917146-6967-44fa-a926-40661aef4275 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:11.971909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d917146-6967-44fa-a926-40661aef4275 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:11.972199 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d917146-6967-44fa-a926-40661aef4275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:11.972954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdc05a-f0bd-4451-af18-24a2a19c9e74 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:11.973482 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdc05a-f0bd-4451-af18-24a2a19c9e74 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:11.973602 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdc05a-f0bd-4451-af18-24a2a19c9e74 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:11.975249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 817/1635] 10.222.0.25 () {54 vars in 912 bytes} [Mon May 23 12:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:11.975727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabdc05a-f0bd-4451-af18-24a2a19c9e74 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:11.993700 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabdc05a-f0bd-4451-af18-24a2a19c9e74 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:12.002725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db74fa-1569-40de-9dbb-bffdf76d7c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:12.003818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db74fa-1569-40de-9dbb-bffdf76d7c33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:12.004174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db74fa-1569-40de-9dbb-bffdf76d7c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:12.004547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db74fa-1569-40de-9dbb-bffdf76d7c33 admin admin] PATH_INFO: `/v3/projects/837eec4670924e5a813e3e637563e39a/users/eb1efb93ac0347b4bf7fdd757d75fc00/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:12.006781 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db74fa-1569-40de-9dbb-bffdf76d7c33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=837eec4670924e5a813e3e637563e39a, user_id=eb1efb93ac0347b4bf7fdd757d75fc00, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:12.010282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db74fa-1569-40de-9dbb-bffdf76d7c33 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:12.025345 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-1d917146-6967-44fa-a926-40661aef4275 None None] MFA Rules not processed for user `d49997b9108145b78eb4db1d8823bf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:12.025622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 818/1636] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:11 2022] PUT /identity/v3/projects/837eec4670924e5a813e3e637563e39a/users/eb1efb93ac0347b4bf7fdd757d75fc00/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:12.026646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db74fa-1569-40de-9dbb-bffdf76d7c33 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:12.037411 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-1d917146-6967-44fa-a926-40661aef4275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:12.167040 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db74fa-1569-40de-9dbb-bffdf76d7c33 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:12.186594 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846cf48-3719-4c41-8b10-31be2b8d2c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:12.187572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846cf48-3719-4c41-8b10-31be2b8d2c3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:12.187835 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846cf48-3719-4c41-8b10-31be2b8d2c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:12.188122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846cf48-3719-4c41-8b10-31be2b8d2c3c admin admin] PATH_INFO: `/v3/projects/7945ddbc783e4c84aac8ca8923147690/users/92bef1c245144ca29506714375419fec/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:12.243033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 819/1637] 10.222.0.25 () {58 vars in 1058 bytes} [Mon May 23 12:33:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:12.243994 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d917146-6967-44fa-a926-40661aef4275 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:12.248594 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846cf48-3719-4c41-8b10-31be2b8d2c3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7945ddbc783e4c84aac8ca8923147690, user_id=92bef1c245144ca29506714375419fec, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:12.253625 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846cf48-3719-4c41-8b10-31be2b8d2c3c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:12.267000 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d917146-6967-44fa-a926-40661aef4275 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:12.279104 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3ee23-2211-411d-a00b-d31f00fdb003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:12.280648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3ee23-2211-411d-a00b-d31f00fdb003 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:12.280931 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3ee23-2211-411d-a00b-d31f00fdb003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:12.281210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3ee23-2211-411d-a00b-d31f00fdb003 admin admin] PATH_INFO: `/v3/projects/1312845278224863b673f137ae321a51/users/84cd981907cd4886827e73fe3a58cd50/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:12.284688 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 819/1638] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:12 2022] PUT /identity/v3/projects/7945ddbc783e4c84aac8ca8923147690/users/92bef1c245144ca29506714375419fec/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:12.286242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50929a4-4803-4692-895c-86e9f2e42801 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:12.286590 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50929a4-4803-4692-895c-86e9f2e42801 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:12.286870 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50929a4-4803-4692-895c-86e9f2e42801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:12.291249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3ee23-2211-411d-a00b-d31f00fdb003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1312845278224863b673f137ae321a51, user_id=84cd981907cd4886827e73fe3a58cd50, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:12.294598 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3ee23-2211-411d-a00b-d31f00fdb003 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:12.334554 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 820/1639] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:12 2022] PUT /identity/v3/projects/1312845278224863b673f137ae321a51/users/84cd981907cd4886827e73fe3a58cd50/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:12.334802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-e50929a4-4803-4692-895c-86e9f2e42801 None None] MFA Rules not processed for user `d49997b9108145b78eb4db1d8823bf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:12.334802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e50929a4-4803-4692-895c-86e9f2e42801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:12.334976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa47eb-167e-4c0d-bb9d-b0481a56acb4 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:12.334976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa47eb-167e-4c0d-bb9d-b0481a56acb4 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:12.334976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa47eb-167e-4c0d-bb9d-b0481a56acb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:12.396688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-68fa47eb-167e-4c0d-bb9d-b0481a56acb4 None None] MFA Rules not processed for user `eb1efb93ac0347b4bf7fdd757d75fc00`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:12.398919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-68fa47eb-167e-4c0d-bb9d-b0481a56acb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:12.492088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 820/1640] 10.222.0.25 () {58 vars in 1009 bytes} [Mon May 23 12:33:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:12.493360 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50929a4-4803-4692-895c-86e9f2e42801 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:12.521515 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50929a4-4803-4692-895c-86e9f2e42801 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:12.530442 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877862ca-fe56-427a-beae-7bc33c5f12a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:12.531663 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877862ca-fe56-427a-beae-7bc33c5f12a0 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:12.532280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877862ca-fe56-427a-beae-7bc33c5f12a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:12.532767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877862ca-fe56-427a-beae-7bc33c5f12a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:12.576440 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 821/1641] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:12 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:12.577918 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa47eb-167e-4c0d-bb9d-b0481a56acb4 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:12.601236 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:12.634674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:12.671206 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877862ca-fe56-427a-beae-7bc33c5f12a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:12.673511 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877862ca-fe56-427a-beae-7bc33c5f12a0 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:12.686339 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 821/1642] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:12.688631 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b0743-7791-4ca0-b65e-ffcac7bf890c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:12.689113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b0743-7791-4ca0-b65e-ffcac7bf890c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:12.689551 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b0743-7791-4ca0-b65e-ffcac7bf890c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:12.704680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa47eb-167e-4c0d-bb9d-b0481a56acb4 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:12.712814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fae17-bb6f-4147-a94f-184c7a654848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:12.713545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fae17-bb6f-4147-a94f-184c7a654848 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:12.713835 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fae17-bb6f-4147-a94f-184c7a654848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:12.714116 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fae17-bb6f-4147-a94f-184c7a654848 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:12.714873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fae17-bb6f-4147-a94f-184c7a654848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:12.716938 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fae17-bb6f-4147-a94f-184c7a654848 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:12.730593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-097b0743-7791-4ca0-b65e-ffcac7bf890c None None] MFA Rules not processed for user `84cd981907cd4886827e73fe3a58cd50`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:12.732890 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-097b0743-7791-4ca0-b65e-ffcac7bf890c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:12.758627 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 822/1643] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:12.762347 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fae17-bb6f-4147-a94f-184c7a654848 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:12.880645 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 822/1644] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:12 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:12.882465 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b0743-7791-4ca0-b65e-ffcac7bf890c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:12.953212 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fae17-bb6f-4147-a94f-184c7a654848 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:12.969170 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016aeab-5119-479c-a250-0e4c034b9236 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:12.969873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016aeab-5119-479c-a250-0e4c034b9236 service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:12.970217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016aeab-5119-479c-a250-0e4c034b9236 service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:12.970431 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016aeab-5119-479c-a250-0e4c034b9236 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:13.004997 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016aeab-5119-479c-a250-0e4c034b9236 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:13.005250 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b0743-7791-4ca0-b65e-ffcac7bf890c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:13.007296 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016aeab-5119-479c-a250-0e4c034b9236 service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:13.009939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93860e-175b-41e1-baa0-71519fe797bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:13.010641 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93860e-175b-41e1-baa0-71519fe797bd service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:13.010929 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93860e-175b-41e1-baa0-71519fe797bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:13.011206 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93860e-175b-41e1-baa0-71519fe797bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:13.025843 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93860e-175b-41e1-baa0-71519fe797bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:13.027794 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93860e-175b-41e1-baa0-71519fe797bd service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:13.035760 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 823/1645] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:13.038766 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016aeab-5119-479c-a250-0e4c034b9236 service cinder] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:13.042053 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 823/1646] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:12 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:13.072299 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016aeab-5119-479c-a250-0e4c034b9236 service cinder] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:13.094327 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a9286-cecd-4dc2-ae8c-dc5b2f9a7a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:13.095499 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a9286-cecd-4dc2-ae8c-dc5b2f9a7a9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:13.095787 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a9286-cecd-4dc2-ae8c-dc5b2f9a7a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:13.096073 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a9286-cecd-4dc2-ae8c-dc5b2f9a7a9f admin admin] PATH_INFO: `/v3/projects/7945ddbc783e4c84aac8ca8923147690/users/92bef1c245144ca29506714375419fec/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:13.100147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a9286-cecd-4dc2-ae8c-dc5b2f9a7a9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7945ddbc783e4c84aac8ca8923147690, user_id=92bef1c245144ca29506714375419fec, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:13.109708 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a9286-cecd-4dc2-ae8c-dc5b2f9a7a9f admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:13.141876 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 824/1647] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:13 2022] PUT /identity/v3/projects/7945ddbc783e4c84aac8ca8923147690/users/92bef1c245144ca29506714375419fec/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:13.156713 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f763350-f93b-4ef3-9a46-655f4a5cd45e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:13.157360 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f763350-f93b-4ef3-9a46-655f4a5cd45e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:13.158141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f763350-f93b-4ef3-9a46-655f4a5cd45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:13.162804 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a9286-cecd-4dc2-ae8c-dc5b2f9a7a9f admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:13.270033 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6f763350-f93b-4ef3-9a46-655f4a5cd45e None None] MFA Rules not processed for user `92bef1c245144ca29506714375419fec`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:13.271775 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6f763350-f93b-4ef3-9a46-655f4a5cd45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:13.293335 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a9286-cecd-4dc2-ae8c-dc5b2f9a7a9f admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:13.306408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f142f4-1b65-4f18-9629-77afb03d201b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:13.307416 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f142f4-1b65-4f18-9629-77afb03d201b service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:13.308889 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f142f4-1b65-4f18-9629-77afb03d201b service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:13.309272 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f142f4-1b65-4f18-9629-77afb03d201b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:13.389236 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:13.424119 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:13.425936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 824/1648] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:13 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:13.428053 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2270f-979b-4070-aefb-62e9f4657aca None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:13.428731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2270f-979b-4070-aefb-62e9f4657aca None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:13.429093 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2270f-979b-4070-aefb-62e9f4657aca None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:13.431266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 825/1649] 10.222.0.25 () {54 vars in 912 bytes} [Mon May 23 12:33:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:13.442069 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f142f4-1b65-4f18-9629-77afb03d201b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:13.443563 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f142f4-1b65-4f18-9629-77afb03d201b service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:13.445578 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73819093-9838-4797-81e0-805b2a5a5ea2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:13.445909 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73819093-9838-4797-81e0-805b2a5a5ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:13.446047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73819093-9838-4797-81e0-805b2a5a5ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:13.457001 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 825/1650] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:13 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:13.500974 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-73819093-9838-4797-81e0-805b2a5a5ea2 None None] MFA Rules not processed for user `d49997b9108145b78eb4db1d8823bf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:13.502305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-73819093-9838-4797-81e0-805b2a5a5ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:13.635936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 826/1651] 10.222.0.25 () {58 vars in 1009 bytes} [Mon May 23 12:33:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:33:13.656091 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f142f4-1b65-4f18-9629-77afb03d201b service cinder] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:13.657711 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-13f142f4-1b65-4f18-9629-77afb03d201b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:13.818061 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f142f4-1b65-4f18-9629-77afb03d201b service cinder] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:13.819144 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73819093-9838-4797-81e0-805b2a5a5ea2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:13.832041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c00b31-653a-4658-bc69-09b917ab77d9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ed824e419544b33a2c4413da4b45aaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:13.834130 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c00b31-653a-4658-bc69-09b917ab77d9 service glance] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:13.835649 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c00b31-653a-4658-bc69-09b917ab77d9 service glance] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:13.836498 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c00b31-653a-4658-bc69-09b917ab77d9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:13.838372 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73819093-9838-4797-81e0-805b2a5a5ea2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:13.849017 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc53b27-7c92-46e6-a001-7f4d71cb66ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:13.850089 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc53b27-7c92-46e6-a001-7f4d71cb66ea service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:13.850636 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc53b27-7c92-46e6-a001-7f4d71cb66ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:13.851232 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc53b27-7c92-46e6-a001-7f4d71cb66ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:13.863069 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c00b31-653a-4658-bc69-09b917ab77d9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:13.870059 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c00b31-653a-4658-bc69-09b917ab77d9 service glance] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:13.881242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc53b27-7c92-46e6-a001-7f4d71cb66ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:13.883255 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc53b27-7c92-46e6-a001-7f4d71cb66ea service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:13.906048 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 826/1652] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:13.911257 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 827/1653] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:13 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:33:14.072719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c00b31-653a-4658-bc69-09b917ab77d9 service glance] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:14.122394 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c00b31-653a-4658-bc69-09b917ab77d9 service glance] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:14.133813 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab9353-baaa-42a0-83e8-ec5630a8910f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:14.134905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab9353-baaa-42a0-83e8-ec5630a8910f service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:14.135434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab9353-baaa-42a0-83e8-ec5630a8910f service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:14.135938 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab9353-baaa-42a0-83e8-ec5630a8910f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:14.281691 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab9353-baaa-42a0-83e8-ec5630a8910f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:14.299086 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab9353-baaa-42a0-83e8-ec5630a8910f service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:14.336350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 827/1654] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:14 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:14.704177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc53b27-7c92-46e6-a001-7f4d71cb66ea service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:14.746014 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc53b27-7c92-46e6-a001-7f4d71cb66ea service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:14.761554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7552925-d16f-4bd0-9501-43cd91aa9c27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:14.762779 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7552925-d16f-4bd0-9501-43cd91aa9c27 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:14.766537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7552925-d16f-4bd0-9501-43cd91aa9c27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:14.766537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7552925-d16f-4bd0-9501-43cd91aa9c27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:14.846729 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab9353-baaa-42a0-83e8-ec5630a8910f service cinder] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:14.917741 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7552925-d16f-4bd0-9501-43cd91aa9c27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:14.920078 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7552925-d16f-4bd0-9501-43cd91aa9c27 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:14.962000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 828/1655] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:15.040206 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab9353-baaa-42a0-83e8-ec5630a8910f service cinder] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:15.060479 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7d86b-3436-4fa7-b21b-2be685ebfa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:15.062453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7d86b-3436-4fa7-b21b-2be685ebfa7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:15.066570 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7d86b-3436-4fa7-b21b-2be685ebfa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:15.068058 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7d86b-3436-4fa7-b21b-2be685ebfa7d admin admin] PATH_INFO: `/v3/users/0d137801c3154dd195c689d2ecf6e315` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:15.079616 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7d86b-3436-4fa7-b21b-2be685ebfa7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d137801c3154dd195c689d2ecf6e315)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:15.087196 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7d86b-3436-4fa7-b21b-2be685ebfa7d admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:15.231007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:15.273319 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-62e7d86b-3436-4fa7-b21b-2be685ebfa7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d137801c3154dd195c689d2ecf6e315'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:15.293440 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-62e7d86b-3436-4fa7-b21b-2be685ebfa7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d137801c3154dd195c689d2ecf6e315'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:15.345054 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-62e7d86b-3436-4fa7-b21b-2be685ebfa7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d137801c3154dd195c689d2ecf6e315'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:15.380703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-62e7d86b-3436-4fa7-b21b-2be685ebfa7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d137801c3154dd195c689d2ecf6e315'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:15.384388 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-62e7d86b-3436-4fa7-b21b-2be685ebfa7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d137801c3154dd195c689d2ecf6e315'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:15.422306 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 828/1656] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:33:14 2022] DELETE /identity/v3/users/0d137801c3154dd195c689d2ecf6e315 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:15.424274 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7fb6f-a2e0-4097-a2b7-fc9ef3386271 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:15.424574 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7fb6f-a2e0-4097-a2b7-fc9ef3386271 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:15.424905 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7fb6f-a2e0-4097-a2b7-fc9ef3386271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:15.461834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-bdb7fb6f-a2e0-4097-a2b7-fc9ef3386271 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:15.463115 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bdb7fb6f-a2e0-4097-a2b7-fc9ef3386271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:15.636239 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 829/1657] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:33:15.668882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7d86b-3436-4fa7-b21b-2be685ebfa7d admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:15.670528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-62e7d86b-3436-4fa7-b21b-2be685ebfa7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:15.792549 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7d86b-3436-4fa7-b21b-2be685ebfa7d admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:15.797057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc35ab-a412-4cb7-942e-43ea9f1eea98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:15.797716 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc35ab-a412-4cb7-942e-43ea9f1eea98 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:15.798002 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc35ab-a412-4cb7-942e-43ea9f1eea98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:15.798284 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc35ab-a412-4cb7-942e-43ea9f1eea98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:15.821118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc35ab-a412-4cb7-942e-43ea9f1eea98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:15.822636 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc35ab-a412-4cb7-942e-43ea9f1eea98 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:15.846694 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 829/1658] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:15.900670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ffcf5-51cb-4a16-98ae-2fea4f1726b3 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:15.901173 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ffcf5-51cb-4a16-98ae-2fea4f1726b3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:15.901240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ffcf5-51cb-4a16-98ae-2fea4f1726b3 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:15.903431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 830/1659] 10.222.0.25 () {54 vars in 912 bytes} [Mon May 23 12:33:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:15.912743 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385df097-550c-4f0f-8710-2ac47498e5dc None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:15.913238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385df097-550c-4f0f-8710-2ac47498e5dc None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:15.913304 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385df097-550c-4f0f-8710-2ac47498e5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:15.995152 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-385df097-550c-4f0f-8710-2ac47498e5dc None None] MFA Rules not processed for user `74674b52807742abb7e144bba3bb6e56`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:15.996340 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-385df097-550c-4f0f-8710-2ac47498e5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:16.023263 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 830/1660] 10.222.0.25 () {58 vars in 1009 bytes} [Mon May 23 12:33:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:16.287869 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ffcf5-51cb-4a16-98ae-2fea4f1726b3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:16.294640 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:16.321309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ffcf5-51cb-4a16-98ae-2fea4f1726b3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:16.331133 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aeb162-e470-494d-8176-a2519c0113fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:16.331797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aeb162-e470-494d-8176-a2519c0113fd service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:16.332291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aeb162-e470-494d-8176-a2519c0113fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:16.332736 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aeb162-e470-494d-8176-a2519c0113fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:16.352923 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aeb162-e470-494d-8176-a2519c0113fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:16.354703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aeb162-e470-494d-8176-a2519c0113fd service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:16.374389 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 831/1661] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:18.291338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c29d6-94c4-448b-8538-c56da11a049e None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:18.291953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c29d6-94c4-448b-8538-c56da11a049e None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:18.291953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c29d6-94c4-448b-8538-c56da11a049e None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:18.294305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 831/1662] 10.222.0.25 () {54 vars in 960 bytes} [Mon May 23 12:33:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:18.299704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1ca7c-9852-42c9-93e1-d0461732df69 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:18.300274 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1ca7c-9852-42c9-93e1-d0461732df69 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:18.300274 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1ca7c-9852-42c9-93e1-d0461732df69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:18.333500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d1a1ca7c-9852-42c9-93e1-d0461732df69 None None] MFA Rules not processed for user `a3fde90ab1e0490ebb7cb514173d984e`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:18.337759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d1a1ca7c-9852-42c9-93e1-d0461732df69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:18.451865 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c29d6-94c4-448b-8538-c56da11a049e None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:18.457048 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-211c29d6-94c4-448b-8538-c56da11a049e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:18.464944 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 832/1663] 10.222.0.25 () {58 vars in 1057 bytes} [Mon May 23 12:33:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:18.473168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1ca7c-9852-42c9-93e1-d0461732df69 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:18.490025 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1ca7c-9852-42c9-93e1-d0461732df69 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:18.501896 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6546c80-0cf3-4509-998c-0531760d661f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fde90ab1e0490ebb7cb514173d984e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:18.502846 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6546c80-0cf3-4509-998c-0531760d661f service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:18.503152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6546c80-0cf3-4509-998c-0531760d661f service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:18.503418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6546c80-0cf3-4509-998c-0531760d661f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:18.508226 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e6546c80-0cf3-4509-998c-0531760d661f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:18.515358 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c29d6-94c4-448b-8538-c56da11a049e None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:18.520316 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea22c2-9704-48d2-a148-7be117eb497a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:18.521436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea22c2-9704-48d2-a148-7be117eb497a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:18.521882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea22c2-9704-48d2-a148-7be117eb497a admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:18.522467 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea22c2-9704-48d2-a148-7be117eb497a admin admin] PATH_INFO: `/v3/projects/17044a57be5648feb1b74113ef334c2c` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:18.525296 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea22c2-9704-48d2-a148-7be117eb497a admin admin] RBAC: Authorizing `identity:delete_project(project_id=17044a57be5648feb1b74113ef334c2c)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:18.526738 dv-cinder-836996-27-smb devstack@keystone.service[80199]: WARNING py.warnings [None req-feea22c2-9704-48d2-a148-7be117eb497a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 12:33:18.526738 dv-cinder-836996-27-smb devstack@keystone.service[80199]: warnings.warn(msg) May 23 12:33:18.526738 dv-cinder-836996-27-smb devstack@keystone.service[80199]: May 23 12:33:18.528163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea22c2-9704-48d2-a148-7be117eb497a admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:18.547681 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6546c80-0cf3-4509-998c-0531760d661f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:18.550782 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6546c80-0cf3-4509-998c-0531760d661f service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:18.567997 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 833/1664] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:33:18.644901 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-feea22c2-9704-48d2-a148-7be117eb497a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17044a57be5648feb1b74113ef334c2c', 'request_id': 'req-feea22c2-9704-48d2-a148-7be117eb497a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:18.663355 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-feea22c2-9704-48d2-a148-7be117eb497a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17044a57be5648feb1b74113ef334c2c', 'request_id': 'req-feea22c2-9704-48d2-a148-7be117eb497a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:18.684389 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-feea22c2-9704-48d2-a148-7be117eb497a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17044a57be5648feb1b74113ef334c2c', 'request_id': 'req-feea22c2-9704-48d2-a148-7be117eb497a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:18.701557 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-feea22c2-9704-48d2-a148-7be117eb497a admin admin] The token cache is being invalidate because project 17044a57be5648feb1b74113ef334c2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:33:18.701860 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-feea22c2-9704-48d2-a148-7be117eb497a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:18.702593 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-feea22c2-9704-48d2-a148-7be117eb497a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:18.704588 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 832/1665] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:33:18 2022] DELETE /identity/v3/projects/17044a57be5648feb1b74113ef334c2c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:18.709748 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6546c80-0cf3-4509-998c-0531760d661f service placement] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:18.722591 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6546c80-0cf3-4509-998c-0531760d661f service placement] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:18.863579 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccd595-adb0-41ea-9bb8-ec5a045ba772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:18.870056 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccd595-adb0-41ea-9bb8-ec5a045ba772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:18.870359 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccd595-adb0-41ea-9bb8-ec5a045ba772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:18.870679 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccd595-adb0-41ea-9bb8-ec5a045ba772 admin admin] PATH_INFO: `/v3/users/84cd981907cd4886827e73fe3a58cd50` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:18.875515 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccd595-adb0-41ea-9bb8-ec5a045ba772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84cd981907cd4886827e73fe3a58cd50)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:18.876728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: WARNING py.warnings [None req-b6ccd595-adb0-41ea-9bb8-ec5a045ba772 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 12:33:18.876728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: warnings.warn(msg) May 23 12:33:18.876728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: May 23 12:33:18.878030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccd595-adb0-41ea-9bb8-ec5a045ba772 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:19.047230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b6ccd595-adb0-41ea-9bb8-ec5a045ba772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84cd981907cd4886827e73fe3a58cd50'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:19.067318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b6ccd595-adb0-41ea-9bb8-ec5a045ba772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84cd981907cd4886827e73fe3a58cd50'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:19.068312 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b6ccd595-adb0-41ea-9bb8-ec5a045ba772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84cd981907cd4886827e73fe3a58cd50'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:19.072563 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b6ccd595-adb0-41ea-9bb8-ec5a045ba772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84cd981907cd4886827e73fe3a58cd50'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:19.140856 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b6ccd595-adb0-41ea-9bb8-ec5a045ba772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84cd981907cd4886827e73fe3a58cd50'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:19.146716 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:19.194561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 834/1666] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:33:18 2022] DELETE /identity/v3/users/84cd981907cd4886827e73fe3a58cd50 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:20.060515 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcc50f-358e-43bb-848d-34ad5783a4c0 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:20.061083 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcc50f-358e-43bb-848d-34ad5783a4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:20.061083 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcc50f-358e-43bb-848d-34ad5783a4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:20.147378 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-fbbcc50f-358e-43bb-848d-34ad5783a4c0 None None] MFA Rules not processed for user `261b8d67ef5847dc9117663de3f5c837`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:20.149343 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-fbbcc50f-358e-43bb-848d-34ad5783a4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:20.155190 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:20.251582 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 833/1667] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:20.258584 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92208ede-f7da-4c0b-83a9-8095bb69314d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:20.259076 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92208ede-f7da-4c0b-83a9-8095bb69314d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:20.259321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92208ede-f7da-4c0b-83a9-8095bb69314d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:20.298723 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-92208ede-f7da-4c0b-83a9-8095bb69314d None None] MFA Rules not processed for user `261b8d67ef5847dc9117663de3f5c837`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:20.300006 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-92208ede-f7da-4c0b-83a9-8095bb69314d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:20.313933 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 835/1668] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:20.337647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbcc50f-358e-43bb-848d-34ad5783a4c0 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:20.340604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-fbbcc50f-358e-43bb-848d-34ad5783a4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:20.488245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbcc50f-358e-43bb-848d-34ad5783a4c0 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:20.500720 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160ad37-e6ac-46d5-aa17-197fcd9e1dc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:20.502064 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160ad37-e6ac-46d5-aa17-197fcd9e1dc1 service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:20.502607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160ad37-e6ac-46d5-aa17-197fcd9e1dc1 service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:20.503145 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160ad37-e6ac-46d5-aa17-197fcd9e1dc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:20.514362 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160ad37-e6ac-46d5-aa17-197fcd9e1dc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:20.516700 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160ad37-e6ac-46d5-aa17-197fcd9e1dc1 service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:20.529805 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 834/1669] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:21.481816 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb71a79-3484-434a-af80-9c773315ca16 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:21.482313 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb71a79-3484-434a-af80-9c773315ca16 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:21.482391 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb71a79-3484-434a-af80-9c773315ca16 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:21.483770 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 836/1670] 10.222.0.25 () {54 vars in 912 bytes} [Mon May 23 12:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:21.489795 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39203a75-d6d7-45b4-b557-3224ea063921 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:21.490297 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39203a75-d6d7-45b4-b557-3224ea063921 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:21.490903 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39203a75-d6d7-45b4-b557-3224ea063921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:21.535606 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-39203a75-d6d7-45b4-b557-3224ea063921 None None] MFA Rules not processed for user `74674b52807742abb7e144bba3bb6e56`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:21.538330 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-39203a75-d6d7-45b4-b557-3224ea063921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:21.595311 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb71a79-3484-434a-af80-9c773315ca16 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:21.597235 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9fb71a79-3484-434a-af80-9c773315ca16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:21.722246 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 835/1671] 10.222.0.25 () {58 vars in 1009 bytes} [Mon May 23 12:33:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:21.742302 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39203a75-d6d7-45b4-b557-3224ea063921 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:21.744070 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-39203a75-d6d7-45b4-b557-3224ea063921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:21.849242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb71a79-3484-434a-af80-9c773315ca16 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:21.865095 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:21.865825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458f4f8-599c-4d74-8526-99a6042ec85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:21.866920 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458f4f8-599c-4d74-8526-99a6042ec85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:21.867211 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458f4f8-599c-4d74-8526-99a6042ec85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:21.868970 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458f4f8-599c-4d74-8526-99a6042ec85f admin admin] PATH_INFO: `/v3/users/492407d05b774097986528adef850129` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:21.876934 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458f4f8-599c-4d74-8526-99a6042ec85f admin admin] RBAC: Authorizing `identity:delete_user(user_id=492407d05b774097986528adef850129)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:21.894920 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458f4f8-599c-4d74-8526-99a6042ec85f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:21.949691 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39203a75-d6d7-45b4-b557-3224ea063921 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:21.961903 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d059a-2c23-4540-9122-27ae39b8b930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:21.966040 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d059a-2c23-4540-9122-27ae39b8b930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:21.966716 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d059a-2c23-4540-9122-27ae39b8b930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:21.967075 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d059a-2c23-4540-9122-27ae39b8b930 admin admin] PATH_INFO: `/v3/projects/1312845278224863b673f137ae321a51` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:21.978914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d059a-2c23-4540-9122-27ae39b8b930 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1312845278224863b673f137ae321a51)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:21.981706 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d059a-2c23-4540-9122-27ae39b8b930 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:22.214401 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-052d059a-2c23-4540-9122-27ae39b8b930 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1312845278224863b673f137ae321a51', 'request_id': 'req-052d059a-2c23-4540-9122-27ae39b8b930'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:22.239473 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-052d059a-2c23-4540-9122-27ae39b8b930 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1312845278224863b673f137ae321a51', 'request_id': 'req-052d059a-2c23-4540-9122-27ae39b8b930'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:22.272259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-052d059a-2c23-4540-9122-27ae39b8b930 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1312845278224863b673f137ae321a51', 'request_id': 'req-052d059a-2c23-4540-9122-27ae39b8b930'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:22.299750 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-052d059a-2c23-4540-9122-27ae39b8b930 admin admin] The token cache is being invalidate because project 1312845278224863b673f137ae321a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:33:22.300083 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-052d059a-2c23-4540-9122-27ae39b8b930 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:22.301929 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-052d059a-2c23-4540-9122-27ae39b8b930 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:22.305265 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 836/1672] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:33:21 2022] DELETE /identity/v3/projects/1312845278224863b673f137ae321a51 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:22.306226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d059a-2c23-4540-9122-27ae39b8b930 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:22.308759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-052d059a-2c23-4540-9122-27ae39b8b930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:22.385380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d458f4f8-599c-4d74-8526-99a6042ec85f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '492407d05b774097986528adef850129'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:22.400078 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d458f4f8-599c-4d74-8526-99a6042ec85f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '492407d05b774097986528adef850129'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:22.401171 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d458f4f8-599c-4d74-8526-99a6042ec85f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '492407d05b774097986528adef850129'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:22.402952 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d458f4f8-599c-4d74-8526-99a6042ec85f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '492407d05b774097986528adef850129'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:22.463042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d458f4f8-599c-4d74-8526-99a6042ec85f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '492407d05b774097986528adef850129'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:22.516211 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d059a-2c23-4540-9122-27ae39b8b930 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:22.522895 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 837/1673] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:33:21 2022] DELETE /identity/v3/users/492407d05b774097986528adef850129 => generated 0 bytes in 928 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:33:22.527160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146415e4-b2ab-43d4-b033-45ae162fd903 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:22.529100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146415e4-b2ab-43d4-b033-45ae162fd903 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:22.529419 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdb9c3-6bdc-4642-b193-4d2ad22d1a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:22.529919 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146415e4-b2ab-43d4-b033-45ae162fd903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:22.530099 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdb9c3-6bdc-4642-b193-4d2ad22d1a4c service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:22.530391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdb9c3-6bdc-4642-b193-4d2ad22d1a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:22.530903 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdb9c3-6bdc-4642-b193-4d2ad22d1a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:22.536115 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-33bdb9c3-6bdc-4642-b193-4d2ad22d1a4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:22.560487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bdb9c3-6bdc-4642-b193-4d2ad22d1a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:22.563392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bdb9c3-6bdc-4642-b193-4d2ad22d1a4c service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:22.578240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-146415e4-b2ab-43d4-b033-45ae162fd903 None None] MFA Rules not processed for user `eb30fc9bc5a04139b2a364ff03f4ad60`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:22.580000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-146415e4-b2ab-43d4-b033-45ae162fd903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:22.597035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 837/1674] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:22.604476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b93c8-56bf-4a79-b624-b84d54839f96 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:22.604810 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b93c8-56bf-4a79-b624-b84d54839f96 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:22.605072 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b93c8-56bf-4a79-b624-b84d54839f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:22.647657 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-9e2b93c8-56bf-4a79-b624-b84d54839f96 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:22.650914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-9e2b93c8-56bf-4a79-b624-b84d54839f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:22.721677 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 838/1675] 10.222.0.25 () {58 vars in 1009 bytes} [Mon May 23 12:33:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:22.723117 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac288f-f687-4ea0-9a8a-c13aea7e29f1 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:22.723336 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac288f-f687-4ea0-9a8a-c13aea7e29f1 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:22.723615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac288f-f687-4ea0-9a8a-c13aea7e29f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:22.801475 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-eeac288f-f687-4ea0-9a8a-c13aea7e29f1 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:22.802785 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-eeac288f-f687-4ea0-9a8a-c13aea7e29f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:22.830278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:22.858518 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 838/1676] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:22.862628 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b79e6-e483-4b78-ac1b-c71d0b654af4 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:22.862956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b79e6-e483-4b78-ac1b-c71d0b654af4 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:22.863248 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b79e6-e483-4b78-ac1b-c71d0b654af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:22.901898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-532b79e6-e483-4b78-ac1b-c71d0b654af4 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:22.903323 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-532b79e6-e483-4b78-ac1b-c71d0b654af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:22.927769 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 839/1677] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:22.932283 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b79e6-e483-4b78-ac1b-c71d0b654af4 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:22.961436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b79e6-e483-4b78-ac1b-c71d0b654af4 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:22.976145 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 839/1678] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:22.977145 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac288f-f687-4ea0-9a8a-c13aea7e29f1 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:22.979370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-eeac288f-f687-4ea0-9a8a-c13aea7e29f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:22.981034 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861eacc-7617-4f4b-8b74-31b1e11560c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:22.981786 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861eacc-7617-4f4b-8b74-31b1e11560c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:22.982074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861eacc-7617-4f4b-8b74-31b1e11560c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:22.982349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861eacc-7617-4f4b-8b74-31b1e11560c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:22.983121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861eacc-7617-4f4b-8b74-31b1e11560c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:22.983426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861eacc-7617-4f4b-8b74-31b1e11560c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:22.985085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861eacc-7617-4f4b-8b74-31b1e11560c2 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:22.988340 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:23.011509 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 840/1679] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:23.017917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861eacc-7617-4f4b-8b74-31b1e11560c2 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:23.044395 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861eacc-7617-4f4b-8b74-31b1e11560c2 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:23.056199 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139e9d1-5702-494e-a701-bd6badb1a994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:23.056816 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139e9d1-5702-494e-a701-bd6badb1a994 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:23.057373 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139e9d1-5702-494e-a701-bd6badb1a994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:23.057667 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139e9d1-5702-494e-a701-bd6badb1a994 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:23.059804 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139e9d1-5702-494e-a701-bd6badb1a994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:23.066913 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139e9d1-5702-494e-a701-bd6badb1a994 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:23.156536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 841/1680] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:23 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:33:23.162475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139e9d1-5702-494e-a701-bd6badb1a994 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:23.164547 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-9139e9d1-5702-494e-a701-bd6badb1a994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:23.173353 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac288f-f687-4ea0-9a8a-c13aea7e29f1 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:23.350376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139e9d1-5702-494e-a701-bd6badb1a994 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:23.361240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0ca6f-70ef-445b-95a2-8fb3cde6382f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03ca1edc22174d258ddeda25407ee6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:23.362664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0ca6f-70ef-445b-95a2-8fb3cde6382f service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:23.363085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0ca6f-70ef-445b-95a2-8fb3cde6382f service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:23.363476 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0ca6f-70ef-445b-95a2-8fb3cde6382f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:23.383854 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf29577-f475-4f08-b006-6bad6c7b01ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:23.384546 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf29577-f475-4f08-b006-6bad6c7b01ef service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:23.384976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf29577-f475-4f08-b006-6bad6c7b01ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:23.385265 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf29577-f475-4f08-b006-6bad6c7b01ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:23.581819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:23.590582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0ca6f-70ef-445b-95a2-8fb3cde6382f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:23.592622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0ca6f-70ef-445b-95a2-8fb3cde6382f service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:23.611334 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 840/1681] 10.222.0.25 () {60 vars in 1384 bytes} [Mon May 23 12:33:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:33:23.614461 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0ca6f-70ef-445b-95a2-8fb3cde6382f service swift] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:23.704388 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf29577-f475-4f08-b006-6bad6c7b01ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:23.715391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf29577-f475-4f08-b006-6bad6c7b01ef service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:23.751315 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 842/1682] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:23.936422 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0ca6f-70ef-445b-95a2-8fb3cde6382f service swift] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:23.951923 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47560c-1d3f-48ee-a8bf-dad8e6dbbe29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:23.953112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47560c-1d3f-48ee-a8bf-dad8e6dbbe29 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:23.953411 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47560c-1d3f-48ee-a8bf-dad8e6dbbe29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:23.953757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47560c-1d3f-48ee-a8bf-dad8e6dbbe29 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:23.957352 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47560c-1d3f-48ee-a8bf-dad8e6dbbe29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:23.963307 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47560c-1d3f-48ee-a8bf-dad8e6dbbe29 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:24.003507 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 841/1683] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:23 2022] POST /identity/v3/users => generated 287 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:24.007436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf29577-f475-4f08-b006-6bad6c7b01ef service neutron] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:24.046617 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf29577-f475-4f08-b006-6bad6c7b01ef service neutron] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:24.064471 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0dd73-e907-4da1-a3b0-7c07466f7cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:24.065184 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0dd73-e907-4da1-a3b0-7c07466f7cff admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:24.065476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0dd73-e907-4da1-a3b0-7c07466f7cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:24.065802 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0dd73-e907-4da1-a3b0-7c07466f7cff admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:24.068967 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0dd73-e907-4da1-a3b0-7c07466f7cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:24.073923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0dd73-e907-4da1-a3b0-7c07466f7cff admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:24.121939 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 843/1684] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:33:24.136965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47560c-1d3f-48ee-a8bf-dad8e6dbbe29 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:24.160164 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47560c-1d3f-48ee-a8bf-dad8e6dbbe29 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:24.178833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbefc5f-0499-44f5-bcc7-a566faaec3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:24.179583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbefc5f-0499-44f5-bcc7-a566faaec3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:24.182592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbefc5f-0499-44f5-bcc7-a566faaec3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:24.182816 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbefc5f-0499-44f5-bcc7-a566faaec3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:24.185521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbefc5f-0499-44f5-bcc7-a566faaec3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:24.193983 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbefc5f-0499-44f5-bcc7-a566faaec3d3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:24.235931 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0dd73-e907-4da1-a3b0-7c07466f7cff admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:24.245777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 842/1685] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:24.255170 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0dd73-e907-4da1-a3b0-7c07466f7cff admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:24.269558 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234b57d-c2c5-464f-adef-68c92f089469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:24.273290 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234b57d-c2c5-464f-adef-68c92f089469 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:24.276913 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234b57d-c2c5-464f-adef-68c92f089469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:24.278192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234b57d-c2c5-464f-adef-68c92f089469 admin admin] PATH_INFO: `/v3/projects/3f2a409331ca47ad9b24712245d0c89d/users/3903858b96924a43947879f153d4d1e8/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:24.362094 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234b57d-c2c5-464f-adef-68c92f089469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f2a409331ca47ad9b24712245d0c89d, user_id=3903858b96924a43947879f153d4d1e8, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:24.370690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234b57d-c2c5-464f-adef-68c92f089469 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:24.429961 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbc9f4-1b40-4311-a118-5d145d747311 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:24.430387 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbc9f4-1b40-4311-a118-5d145d747311 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:24.431267 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbc9f4-1b40-4311-a118-5d145d747311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:24.434341 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 844/1686] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:24 2022] PUT /identity/v3/projects/3f2a409331ca47ad9b24712245d0c89d/users/3903858b96924a43947879f153d4d1e8/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:24.445424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6633cd-1d9c-43d6-ba07-0d60e012db7b None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:24.446102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6633cd-1d9c-43d6-ba07-0d60e012db7b None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:24.446742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6633cd-1d9c-43d6-ba07-0d60e012db7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:24.505886 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6ecbc9f4-1b40-4311-a118-5d145d747311 None None] MFA Rules not processed for user `261b8d67ef5847dc9117663de3f5c837`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:24.509439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6ecbc9f4-1b40-4311-a118-5d145d747311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:24.575292 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-0d6633cd-1d9c-43d6-ba07-0d60e012db7b None None] MFA Rules not processed for user `3903858b96924a43947879f153d4d1e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:24.575758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-0d6633cd-1d9c-43d6-ba07-0d60e012db7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:24.773371 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:24.809881 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 843/1687] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:33:24.849550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 845/1688] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:33:24.854006 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbc9f4-1b40-4311-a118-5d145d747311 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:25.073063 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbc9f4-1b40-4311-a118-5d145d747311 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:25.079592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777086e0-0b8c-473a-b3fc-5465f1d2c1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:25.080308 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777086e0-0b8c-473a-b3fc-5465f1d2c1ce admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:25.080558 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777086e0-0b8c-473a-b3fc-5465f1d2c1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:25.080841 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777086e0-0b8c-473a-b3fc-5465f1d2c1ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:25.081756 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777086e0-0b8c-473a-b3fc-5465f1d2c1ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:25.083765 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777086e0-0b8c-473a-b3fc-5465f1d2c1ce admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:25.132740 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 844/1689] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:24 2022] POST /identity/v3/projects => generated 371 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:33:25.137508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6633cd-1d9c-43d6-ba07-0d60e012db7b None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:25.155698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6633cd-1d9c-43d6-ba07-0d60e012db7b None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:25.414743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca898866-63a6-40b3-bbf8-444c8f57a700 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:25.414940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca898866-63a6-40b3-bbf8-444c8f57a700 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:25.415178 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca898866-63a6-40b3-bbf8-444c8f57a700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:25.419273 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46d32f-ef5a-4c9b-a3b5-0285c2559e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:25.420214 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46d32f-ef5a-4c9b-a3b5-0285c2559e92 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:25.420655 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46d32f-ef5a-4c9b-a3b5-0285c2559e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:25.421004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46d32f-ef5a-4c9b-a3b5-0285c2559e92 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:25.421811 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46d32f-ef5a-4c9b-a3b5-0285c2559e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:25.425240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:25.429723 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46d32f-ef5a-4c9b-a3b5-0285c2559e92 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:25.500486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ca898866-63a6-40b3-bbf8-444c8f57a700 None None] MFA Rules not processed for user `ce751e35d8184c809a942b4187e88cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:25.512991 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ca898866-63a6-40b3-bbf8-444c8f57a700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:25.513213 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 846/1690] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:25 2022] POST /identity/v3/users => generated 292 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:25.515884 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46d32f-ef5a-4c9b-a3b5-0285c2559e92 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:25.542516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46d32f-ef5a-4c9b-a3b5-0285c2559e92 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:25.557678 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfbc47-ea68-41c2-a4e4-752cd935afb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:25.560588 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfbc47-ea68-41c2-a4e4-752cd935afb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:25.561043 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfbc47-ea68-41c2-a4e4-752cd935afb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:25.562547 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfbc47-ea68-41c2-a4e4-752cd935afb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:25.564205 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfbc47-ea68-41c2-a4e4-752cd935afb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:25.567896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfbc47-ea68-41c2-a4e4-752cd935afb4 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:25.614358 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 847/1691] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:25.614358 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfbc47-ea68-41c2-a4e4-752cd935afb4 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:25.638921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfbc47-ea68-41c2-a4e4-752cd935afb4 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:25.657444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00addf5b-e491-4034-8386-366b591ce8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:25.664298 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00addf5b-e491-4034-8386-366b591ce8dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:25.664748 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00addf5b-e491-4034-8386-366b591ce8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:25.665393 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00addf5b-e491-4034-8386-366b591ce8dd admin admin] PATH_INFO: `/v3/projects/01b4fbb94d9b4fc78f455ce80aa96f24/users/a7756adbfa9246ed80d46c95a0b10594/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:25.708617 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 845/1692] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:25.716137 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca898866-63a6-40b3-bbf8-444c8f57a700 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:25.717498 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ca898866-63a6-40b3-bbf8-444c8f57a700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:25.727339 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00addf5b-e491-4034-8386-366b591ce8dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b4fbb94d9b4fc78f455ce80aa96f24, user_id=a7756adbfa9246ed80d46c95a0b10594, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:25.741147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00addf5b-e491-4034-8386-366b591ce8dd admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:25.793520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 848/1693] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:25 2022] PUT /identity/v3/projects/01b4fbb94d9b4fc78f455ce80aa96f24/users/a7756adbfa9246ed80d46c95a0b10594/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:25.794953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00addf5b-e491-4034-8386-366b591ce8dd admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:26.026694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca898866-63a6-40b3-bbf8-444c8f57a700 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:26.122327 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00addf5b-e491-4034-8386-366b591ce8dd admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:26.149038 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a96a3c-31fc-4296-a12c-34310865247b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:26.152053 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a96a3c-31fc-4296-a12c-34310865247b admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:26.155760 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a96a3c-31fc-4296-a12c-34310865247b admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:26.159166 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a96a3c-31fc-4296-a12c-34310865247b admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:26.163169 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a96a3c-31fc-4296-a12c-34310865247b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:26.166814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a96a3c-31fc-4296-a12c-34310865247b admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:26.259355 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c432f-a62b-4f9b-9fdb-9311c083ae9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:26.262759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 849/1694] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:26.263144 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c432f-a62b-4f9b-9fdb-9311c083ae9b service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:26.263612 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c432f-a62b-4f9b-9fdb-9311c083ae9b service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:26.264657 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a96a3c-31fc-4296-a12c-34310865247b admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:26.265165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c432f-a62b-4f9b-9fdb-9311c083ae9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:26.341405 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a96a3c-31fc-4296-a12c-34310865247b admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:26.367006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36308aa9-d6f4-4420-a8c3-889402dcbbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:26.368651 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36308aa9-d6f4-4420-a8c3-889402dcbbaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:26.369162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36308aa9-d6f4-4420-a8c3-889402dcbbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:26.371871 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36308aa9-d6f4-4420-a8c3-889402dcbbaf admin admin] PATH_INFO: `/v3/projects/01b4fbb94d9b4fc78f455ce80aa96f24/users/a7756adbfa9246ed80d46c95a0b10594/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:26.382652 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36308aa9-d6f4-4420-a8c3-889402dcbbaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b4fbb94d9b4fc78f455ce80aa96f24, user_id=a7756adbfa9246ed80d46c95a0b10594, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:26.385606 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:26.390677 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36308aa9-d6f4-4420-a8c3-889402dcbbaf admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:26.443407 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 850/1695] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:26 2022] PUT /identity/v3/projects/01b4fbb94d9b4fc78f455ce80aa96f24/users/a7756adbfa9246ed80d46c95a0b10594/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:26.456030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb6ae6-c695-4306-ab14-81d82a51816e None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:26.456445 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb6ae6-c695-4306-ab14-81d82a51816e None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:26.456825 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb6ae6-c695-4306-ab14-81d82a51816e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:26.484442 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c432f-a62b-4f9b-9fdb-9311c083ae9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:26.492399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c432f-a62b-4f9b-9fdb-9311c083ae9b service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:26.537237 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 846/1696] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 822 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:26.562814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-76fb6ae6-c695-4306-ab14-81d82a51816e None None] MFA Rules not processed for user `a7756adbfa9246ed80d46c95a0b10594`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:26.564255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-76fb6ae6-c695-4306-ab14-81d82a51816e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:26.581175 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:26.683451 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c432f-a62b-4f9b-9fdb-9311c083ae9b service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:26.684927 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-412c432f-a62b-4f9b-9fdb-9311c083ae9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:26.728361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c432f-a62b-4f9b-9fdb-9311c083ae9b service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:26.760048 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 851/1697] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:26.795543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb6ae6-c695-4306-ab14-81d82a51816e None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:26.800631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-76fb6ae6-c695-4306-ab14-81d82a51816e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:27.053684 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb6ae6-c695-4306-ab14-81d82a51816e None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:27.053899 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39771f20-0cae-4046-857e-8abd9976ee30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:27.056998 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39771f20-0cae-4046-857e-8abd9976ee30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:27.057288 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39771f20-0cae-4046-857e-8abd9976ee30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:27.057612 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39771f20-0cae-4046-857e-8abd9976ee30 admin admin] PATH_INFO: `/v3/projects/d726f7e8c6c74e1694cae065b0ab9b6f` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:27.064754 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39771f20-0cae-4046-857e-8abd9976ee30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d726f7e8c6c74e1694cae065b0ab9b6f)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:27.076158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39771f20-0cae-4046-857e-8abd9976ee30 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:27.093485 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb66496-6b7a-465a-a3a7-1c39acffa4bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:27.093698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb66496-6b7a-465a-a3a7-1c39acffa4bf service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:27.094060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb66496-6b7a-465a-a3a7-1c39acffa4bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:27.094240 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb66496-6b7a-465a-a3a7-1c39acffa4bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:27.125361 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb66496-6b7a-465a-a3a7-1c39acffa4bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:27.126881 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb66496-6b7a-465a-a3a7-1c39acffa4bf service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:27.148282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 852/1698] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:26 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:27.270486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-39771f20-0cae-4046-857e-8abd9976ee30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd726f7e8c6c74e1694cae065b0ab9b6f', 'request_id': 'req-39771f20-0cae-4046-857e-8abd9976ee30'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:27.294423 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-39771f20-0cae-4046-857e-8abd9976ee30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd726f7e8c6c74e1694cae065b0ab9b6f', 'request_id': 'req-39771f20-0cae-4046-857e-8abd9976ee30'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:27.311346 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-39771f20-0cae-4046-857e-8abd9976ee30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd726f7e8c6c74e1694cae065b0ab9b6f', 'request_id': 'req-39771f20-0cae-4046-857e-8abd9976ee30'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:27.354495 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-39771f20-0cae-4046-857e-8abd9976ee30 admin admin] The token cache is being invalidate because project d726f7e8c6c74e1694cae065b0ab9b6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:33:27.356372 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-39771f20-0cae-4046-857e-8abd9976ee30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:27.357366 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-39771f20-0cae-4046-857e-8abd9976ee30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:27.360131 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 847/1699] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:33:26 2022] DELETE /identity/v3/projects/d726f7e8c6c74e1694cae065b0ab9b6f => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:33:27.365385 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefd49b-1bf2-49a0-a343-17b6005fc036 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:27.365704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefd49b-1bf2-49a0-a343-17b6005fc036 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:27.366002 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefd49b-1bf2-49a0-a343-17b6005fc036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:27.425630 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-1aefd49b-1bf2-49a0-a343-17b6005fc036 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:27.426976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-1aefd49b-1bf2-49a0-a343-17b6005fc036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:27.459023 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9279f-2718-4954-8671-a5d33543efe5 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:27.459460 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9279f-2718-4954-8671-a5d33543efe5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:27.459653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9279f-2718-4954-8671-a5d33543efe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:27.525118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-8dd9279f-2718-4954-8671-a5d33543efe5 None None] MFA Rules not processed for user `74674b52807742abb7e144bba3bb6e56`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:27.533844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8dd9279f-2718-4954-8671-a5d33543efe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:27.703455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 853/1700] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:27.706252 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5172096-26a3-4598-b87c-6cca678453d6 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:27.706252 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5172096-26a3-4598-b87c-6cca678453d6 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:27.706621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5172096-26a3-4598-b87c-6cca678453d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:27.741713 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 848/1701] 10.222.0.41 () {58 vars in 1015 bytes} [Mon May 23 12:33:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:27.761591 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9279f-2718-4954-8671-a5d33543efe5 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:27.770234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8dd9279f-2718-4954-8671-a5d33543efe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:27.794107 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-e5172096-26a3-4598-b87c-6cca678453d6 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:27.799669 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e5172096-26a3-4598-b87c-6cca678453d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:27.832346 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9279f-2718-4954-8671-a5d33543efe5 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:27.856266 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 854/1702] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:27.859808 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ca81d-716b-4b4c-bf33-214963543085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:27.859808 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ca81d-716b-4b4c-bf33-214963543085 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:27.860010 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ca81d-716b-4b4c-bf33-214963543085 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:27.860269 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ca81d-716b-4b4c-bf33-214963543085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:27.861877 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5172096-26a3-4598-b87c-6cca678453d6 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:27.891848 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:27.908026 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ca81d-716b-4b4c-bf33-214963543085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:27.909170 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5172096-26a3-4598-b87c-6cca678453d6 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:27.911075 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ca81d-716b-4b4c-bf33-214963543085 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:27.947240 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a7aba-fa64-486f-92ec-e823c6e5bcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:27.948532 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a7aba-fa64-486f-92ec-e823c6e5bcdd admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:27.950410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a7aba-fa64-486f-92ec-e823c6e5bcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:27.950958 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a7aba-fa64-486f-92ec-e823c6e5bcdd admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:27.953697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a7aba-fa64-486f-92ec-e823c6e5bcdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:27.957355 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a7aba-fa64-486f-92ec-e823c6e5bcdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:27.966982 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a7aba-fa64-486f-92ec-e823c6e5bcdd admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:27.969783 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 849/1703] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:33:28.018961 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 855/1704] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:28.026711 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ca81d-716b-4b4c-bf33-214963543085 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:28.051846 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ca81d-716b-4b4c-bf33-214963543085 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:28.090587 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa096278-95d5-4142-b0be-0223dcba93cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:28.091613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa096278-95d5-4142-b0be-0223dcba93cb admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:28.092014 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa096278-95d5-4142-b0be-0223dcba93cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:28.092314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa096278-95d5-4142-b0be-0223dcba93cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:28.093020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa096278-95d5-4142-b0be-0223dcba93cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:28.118110 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa096278-95d5-4142-b0be-0223dcba93cb admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:28.220985 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 850/1705] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:28 2022] POST /identity/v3/projects => generated 369 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:28.227521 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a7aba-fa64-486f-92ec-e823c6e5bcdd admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:28.256332 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a7aba-fa64-486f-92ec-e823c6e5bcdd admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:28.316512 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:28.419363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956bf07-9b00-41bd-8e25-dbb64dc410e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:28.423701 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956bf07-9b00-41bd-8e25-dbb64dc410e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:28.424218 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956bf07-9b00-41bd-8e25-dbb64dc410e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:28.424591 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956bf07-9b00-41bd-8e25-dbb64dc410e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:28.426354 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956bf07-9b00-41bd-8e25-dbb64dc410e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:28.443005 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956bf07-9b00-41bd-8e25-dbb64dc410e2 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:28.531370 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 856/1706] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:28 2022] POST /identity/v3/users => generated 285 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:28.534485 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa096278-95d5-4142-b0be-0223dcba93cb admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:28.549470 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa096278-95d5-4142-b0be-0223dcba93cb admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:28.584559 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4df1d-99c1-4a38-b361-53b3dc878f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:28.586230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4df1d-99c1-4a38-b361-53b3dc878f89 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:28.591130 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4df1d-99c1-4a38-b361-53b3dc878f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:28.593168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4df1d-99c1-4a38-b361-53b3dc878f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:28.602589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4df1d-99c1-4a38-b361-53b3dc878f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:28.606814 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4df1d-99c1-4a38-b361-53b3dc878f89 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:28.646847 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956bf07-9b00-41bd-8e25-dbb64dc410e2 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:28.650755 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 851/1707] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:28.678577 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956bf07-9b00-41bd-8e25-dbb64dc410e2 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:28.719442 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830fdd2-5941-4eee-85c9-422bbad027dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:28.720186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830fdd2-5941-4eee-85c9-422bbad027dc admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:28.724100 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830fdd2-5941-4eee-85c9-422bbad027dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:28.724404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830fdd2-5941-4eee-85c9-422bbad027dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:28.733450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830fdd2-5941-4eee-85c9-422bbad027dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:28.745898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830fdd2-5941-4eee-85c9-422bbad027dc admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:28.840215 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 857/1708] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:33:28.842298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4df1d-99c1-4a38-b361-53b3dc878f89 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:28.863945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4df1d-99c1-4a38-b361-53b3dc878f89 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:28.926368 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4a529-835c-440a-9ed4-46381c4ef6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:28.931699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830fdd2-5941-4eee-85c9-422bbad027dc admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:28.933856 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e830fdd2-5941-4eee-85c9-422bbad027dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:28.945297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4a529-835c-440a-9ed4-46381c4ef6f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:28.951935 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4a529-835c-440a-9ed4-46381c4ef6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:28.955422 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4a529-835c-440a-9ed4-46381c4ef6f2 admin admin] PATH_INFO: `/v3/projects/bce4eb3450e0475ab40f76d106f3c1f1/users/d733f64668d741a2ae96e4336d33971c/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:28.988396 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830fdd2-5941-4eee-85c9-422bbad027dc admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:29.009394 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae27e6-782b-4e42-8a6c-f6c0aba93c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:29.011290 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae27e6-782b-4e42-8a6c-f6c0aba93c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:29.017805 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae27e6-782b-4e42-8a6c-f6c0aba93c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:29.020839 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae27e6-782b-4e42-8a6c-f6c0aba93c7d admin admin] PATH_INFO: `/v3/users/3903858b96924a43947879f153d4d1e8` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:29.029045 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae27e6-782b-4e42-8a6c-f6c0aba93c7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3903858b96924a43947879f153d4d1e8)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:29.038293 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae27e6-782b-4e42-8a6c-f6c0aba93c7d admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:29.049122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4a529-835c-440a-9ed4-46381c4ef6f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce4eb3450e0475ab40f76d106f3c1f1, user_id=d733f64668d741a2ae96e4336d33971c, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:29.071233 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4a529-835c-440a-9ed4-46381c4ef6f2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:29.138945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 852/1709] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:28 2022] PUT /identity/v3/projects/bce4eb3450e0475ab40f76d106f3c1f1/users/d733f64668d741a2ae96e4336d33971c/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:29.142355 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff59b2-f1e4-4e2c-b029-cbe6f9812d10 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:29.142355 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff59b2-f1e4-4e2c-b029-cbe6f9812d10 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:29.143136 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff59b2-f1e4-4e2c-b029-cbe6f9812d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:29.297927 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-34ff59b2-f1e4-4e2c-b029-cbe6f9812d10 None None] MFA Rules not processed for user `d733f64668d741a2ae96e4336d33971c`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:29.309666 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-34ff59b2-f1e4-4e2c-b029-cbe6f9812d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:29.388001 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-e4ae27e6-782b-4e42-8a6c-f6c0aba93c7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3903858b96924a43947879f153d4d1e8'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:29.434876 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-e4ae27e6-782b-4e42-8a6c-f6c0aba93c7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3903858b96924a43947879f153d4d1e8'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:29.498674 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-e4ae27e6-782b-4e42-8a6c-f6c0aba93c7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3903858b96924a43947879f153d4d1e8'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:29.537708 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-e4ae27e6-782b-4e42-8a6c-f6c0aba93c7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3903858b96924a43947879f153d4d1e8'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:29.541048 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-e4ae27e6-782b-4e42-8a6c-f6c0aba93c7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3903858b96924a43947879f153d4d1e8'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:29.568296 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 858/1710] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:33:28 2022] DELETE /identity/v3/users/3903858b96924a43947879f153d4d1e8 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:29.570251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928686e-2d05-4dca-a600-703a3594ab17 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:29.575671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928686e-2d05-4dca-a600-703a3594ab17 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:29.576168 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928686e-2d05-4dca-a600-703a3594ab17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:29.631526 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-6928686e-2d05-4dca-a600-703a3594ab17 None None] MFA Rules not processed for user `ae9ed5cec9cb45f58203e41048d8e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:29.642533 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-6928686e-2d05-4dca-a600-703a3594ab17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:29.667008 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 853/1711] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 526 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:33:29.668524 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8eafdf-1666-4ce4-b7dd-acd865f78624 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:29.683216 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8eafdf-1666-4ce4-b7dd-acd865f78624 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:29.683909 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8eafdf-1666-4ce4-b7dd-acd865f78624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:29.731475 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4b8eafdf-1666-4ce4-b7dd-acd865f78624 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:29.733166 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4b8eafdf-1666-4ce4-b7dd-acd865f78624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:29.930953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 859/1712] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:29.931958 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928686e-2d05-4dca-a600-703a3594ab17 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:29.935397 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-6928686e-2d05-4dca-a600-703a3594ab17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:29.962851 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:30.033527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 854/1713] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:30.034568 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8eafdf-1666-4ce4-b7dd-acd865f78624 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:30.042547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4b8eafdf-1666-4ce4-b7dd-acd865f78624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:30.191412 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:30.223030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928686e-2d05-4dca-a600-703a3594ab17 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:30.236082 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82713f7e-b496-440a-8391-a6b30329144d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:30.237016 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82713f7e-b496-440a-8391-a6b30329144d admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:30.238437 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82713f7e-b496-440a-8391-a6b30329144d admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:30.239081 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82713f7e-b496-440a-8391-a6b30329144d admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:30.241005 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82713f7e-b496-440a-8391-a6b30329144d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:30.247565 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82713f7e-b496-440a-8391-a6b30329144d admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:30.351287 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 860/1714] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:29 2022] POST /identity/v3/projects => generated 367 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:30.352832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82713f7e-b496-440a-8391-a6b30329144d admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:30.358653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8eafdf-1666-4ce4-b7dd-acd865f78624 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:30.361070 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-82713f7e-b496-440a-8391-a6b30329144d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:30.555567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82713f7e-b496-440a-8391-a6b30329144d admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:30.571624 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737edc96-8812-4b4f-9977-af8ab0fceb7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:30.580416 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737edc96-8812-4b4f-9977-af8ab0fceb7d service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:30.580860 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737edc96-8812-4b4f-9977-af8ab0fceb7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:30.581243 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737edc96-8812-4b4f-9977-af8ab0fceb7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:30.643545 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca383baa-2bbe-4e38-9ab2-ad04a567204a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:30.647687 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca383baa-2bbe-4e38-9ab2-ad04a567204a service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:30.648940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca383baa-2bbe-4e38-9ab2-ad04a567204a service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:30.650379 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca383baa-2bbe-4e38-9ab2-ad04a567204a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:30.718006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737edc96-8812-4b4f-9977-af8ab0fceb7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:30.719757 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737edc96-8812-4b4f-9977-af8ab0fceb7d service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:30.736464 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 861/1715] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:30.739352 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737edc96-8812-4b4f-9977-af8ab0fceb7d service neutron] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:30.756214 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737edc96-8812-4b4f-9977-af8ab0fceb7d service neutron] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:30.782369 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633d3fb-e618-4b2d-9685-0c47cd619410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:30.783255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633d3fb-e618-4b2d-9685-0c47cd619410 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:30.783812 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633d3fb-e618-4b2d-9685-0c47cd619410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:30.784214 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633d3fb-e618-4b2d-9685-0c47cd619410 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:30.786719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633d3fb-e618-4b2d-9685-0c47cd619410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:30.788999 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633d3fb-e618-4b2d-9685-0c47cd619410 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:30.846031 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 862/1716] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:30 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:30.847976 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca383baa-2bbe-4e38-9ab2-ad04a567204a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:30.849783 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca383baa-2bbe-4e38-9ab2-ad04a567204a service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:30.855119 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633d3fb-e618-4b2d-9685-0c47cd619410 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:30.885465 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 855/1717] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 851 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:30.903155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633d3fb-e618-4b2d-9685-0c47cd619410 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:30.909629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3566933-f50a-428c-b1dd-a6edbf3d1ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:30.910466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3566933-f50a-428c-b1dd-a6edbf3d1ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:30.934236 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3566933-f50a-428c-b1dd-a6edbf3d1ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:30.934236 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3566933-f50a-428c-b1dd-a6edbf3d1ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:30.936229 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3566933-f50a-428c-b1dd-a6edbf3d1ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:30.938113 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3566933-f50a-428c-b1dd-a6edbf3d1ae0 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:30.978130 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 863/1718] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:30.982735 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca383baa-2bbe-4e38-9ab2-ad04a567204a service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:31.000809 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca383baa-2bbe-4e38-9ab2-ad04a567204a service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:31.010105 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab098cd-b040-4aad-bc97-38bdc92b12fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:31.012053 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab098cd-b040-4aad-bc97-38bdc92b12fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:31.012574 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab098cd-b040-4aad-bc97-38bdc92b12fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:31.013293 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab098cd-b040-4aad-bc97-38bdc92b12fc admin admin] PATH_INFO: `/v3/projects/41ca83ef85194ff8888d2e44a5f44eec/users/68c507f1c98344dea915b25225aaff9d/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:31.042874 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab098cd-b040-4aad-bc97-38bdc92b12fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ca83ef85194ff8888d2e44a5f44eec, user_id=68c507f1c98344dea915b25225aaff9d, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:31.047873 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab098cd-b040-4aad-bc97-38bdc92b12fc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:31.109189 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 856/1719] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:30 2022] PUT /identity/v3/projects/41ca83ef85194ff8888d2e44a5f44eec/users/68c507f1c98344dea915b25225aaff9d/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:31.115196 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3566933-f50a-428c-b1dd-a6edbf3d1ae0 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:31.140054 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3566933-f50a-428c-b1dd-a6edbf3d1ae0 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:31.171462 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:31.312812 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5a1ca-0748-4a03-9b8a-04840c6aa8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:31.313913 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5a1ca-0748-4a03-9b8a-04840c6aa8bc admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:31.314359 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5a1ca-0748-4a03-9b8a-04840c6aa8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:31.314828 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5a1ca-0748-4a03-9b8a-04840c6aa8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:31.316635 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5a1ca-0748-4a03-9b8a-04840c6aa8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:31.318713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5a1ca-0748-4a03-9b8a-04840c6aa8bc admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:31.387407 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab098cd-b040-4aad-bc97-38bdc92b12fc admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:31.439448 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 864/1720] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:31.487764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab098cd-b040-4aad-bc97-38bdc92b12fc admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:31.502934 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e75e18-d968-4405-856f-8782f195085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:31.508203 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e75e18-d968-4405-856f-8782f195085f admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:31.513179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e75e18-d968-4405-856f-8782f195085f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:31.513632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e75e18-d968-4405-856f-8782f195085f admin admin] PATH_INFO: `/v3/projects/41ca83ef85194ff8888d2e44a5f44eec/users/68c507f1c98344dea915b25225aaff9d/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:31.519895 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e75e18-d968-4405-856f-8782f195085f admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ca83ef85194ff8888d2e44a5f44eec, user_id=68c507f1c98344dea915b25225aaff9d, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:31.548162 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e75e18-d968-4405-856f-8782f195085f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:31.582413 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 857/1721] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:31 2022] PUT /identity/v3/projects/41ca83ef85194ff8888d2e44a5f44eec/users/68c507f1c98344dea915b25225aaff9d/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:31.594389 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3978af8-f4ce-4ed6-a953-fe7730aa6b64 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:31.595232 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3978af8-f4ce-4ed6-a953-fe7730aa6b64 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:31.595738 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3978af8-f4ce-4ed6-a953-fe7730aa6b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:31.638417 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-b3978af8-f4ce-4ed6-a953-fe7730aa6b64 None None] MFA Rules not processed for user `68c507f1c98344dea915b25225aaff9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:31.640355 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-b3978af8-f4ce-4ed6-a953-fe7730aa6b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:31.794385 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 865/1722] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:31 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:31.812655 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e75e18-d968-4405-856f-8782f195085f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:31.812655 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-79e75e18-d968-4405-856f-8782f195085f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:31.852999 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:31.925866 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e75e18-d968-4405-856f-8782f195085f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:31.941448 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7687087-e829-4bef-81eb-4fd637a6caee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:31.952178 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7687087-e829-4bef-81eb-4fd637a6caee service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:31.954703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7687087-e829-4bef-81eb-4fd637a6caee service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:31.955144 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7687087-e829-4bef-81eb-4fd637a6caee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:31.980162 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7687087-e829-4bef-81eb-4fd637a6caee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:31.981973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7687087-e829-4bef-81eb-4fd637a6caee service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:32.011560 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 858/1723] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:31 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:32.335802 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3978af8-f4ce-4ed6-a953-fe7730aa6b64 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:32.358075 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3978af8-f4ce-4ed6-a953-fe7730aa6b64 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:32.366441 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe49405-0da6-4e7b-abc2-3afbce2b514f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:32.372607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe49405-0da6-4e7b-abc2-3afbce2b514f service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:32.374463 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe49405-0da6-4e7b-abc2-3afbce2b514f service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:32.374933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe49405-0da6-4e7b-abc2-3afbce2b514f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:32.533613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe49405-0da6-4e7b-abc2-3afbce2b514f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:32.535324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe49405-0da6-4e7b-abc2-3afbce2b514f service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:32.552496 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 866/1724] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:32 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:34.410386 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87094c9-e880-4fd8-8dc3-16d0aee279a6 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:34.411702 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87094c9-e880-4fd8-8dc3-16d0aee279a6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:34.412245 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87094c9-e880-4fd8-8dc3-16d0aee279a6 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:34.414386 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 859/1725] 10.222.0.25 () {54 vars in 921 bytes} [Mon May 23 12:33:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:34.426238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f2651-3618-410b-b11a-a559bd7c87b6 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:34.426917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f2651-3618-410b-b11a-a559bd7c87b6 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:34.427321 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f2651-3618-410b-b11a-a559bd7c87b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:34.478330 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-b30f2651-3618-410b-b11a-a559bd7c87b6 None None] MFA Rules not processed for user `d49997b9108145b78eb4db1d8823bf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:34.484801 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-b30f2651-3618-410b-b11a-a559bd7c87b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:34.485661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87094c9-e880-4fd8-8dc3-16d0aee279a6 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:34.488371 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b87094c9-e880-4fd8-8dc3-16d0aee279a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:34.588480 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:34.683494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 867/1726] 10.222.0.25 () {58 vars in 1018 bytes} [Mon May 23 12:33:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:34.754265 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87094c9-e880-4fd8-8dc3-16d0aee279a6 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:34.759685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f2651-3618-410b-b11a-a559bd7c87b6 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:34.785688 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a44c79-a405-42c5-84ef-04fd04948c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:34.786614 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a44c79-a405-42c5-84ef-04fd04948c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:34.786907 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a44c79-a405-42c5-84ef-04fd04948c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:34.797446 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f2651-3618-410b-b11a-a559bd7c87b6 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:34.798627 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a44c79-a405-42c5-84ef-04fd04948c6a admin admin] PATH_INFO: `/v3/projects/3f2a409331ca47ad9b24712245d0c89d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:34.802847 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a44c79-a405-42c5-84ef-04fd04948c6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f2a409331ca47ad9b24712245d0c89d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:34.815319 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a44c79-a405-42c5-84ef-04fd04948c6a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:34.841100 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eef6bc-fdc3-4db9-8162-94617f523800 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:34.841818 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eef6bc-fdc3-4db9-8162-94617f523800 service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:34.842157 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eef6bc-fdc3-4db9-8162-94617f523800 service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:34.842446 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eef6bc-fdc3-4db9-8162-94617f523800 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:34.916689 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eef6bc-fdc3-4db9-8162-94617f523800 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:34.916689 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eef6bc-fdc3-4db9-8162-94617f523800 service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:34.991642 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 868/1727] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:33:35.053148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-17a44c79-a405-42c5-84ef-04fd04948c6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f2a409331ca47ad9b24712245d0c89d', 'request_id': 'req-17a44c79-a405-42c5-84ef-04fd04948c6a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:35.087184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-17a44c79-a405-42c5-84ef-04fd04948c6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f2a409331ca47ad9b24712245d0c89d', 'request_id': 'req-17a44c79-a405-42c5-84ef-04fd04948c6a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:35.103461 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-17a44c79-a405-42c5-84ef-04fd04948c6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f2a409331ca47ad9b24712245d0c89d', 'request_id': 'req-17a44c79-a405-42c5-84ef-04fd04948c6a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:35.129035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-17a44c79-a405-42c5-84ef-04fd04948c6a admin admin] The token cache is being invalidate because project 3f2a409331ca47ad9b24712245d0c89d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:33:35.129548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-17a44c79-a405-42c5-84ef-04fd04948c6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:35.130393 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-17a44c79-a405-42c5-84ef-04fd04948c6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:35.142307 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 860/1728] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:33:34 2022] DELETE /identity/v3/projects/3f2a409331ca47ad9b24712245d0c89d => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:35.143280 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eef6bc-fdc3-4db9-8162-94617f523800 service nova] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:35.162289 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eef6bc-fdc3-4db9-8162-94617f523800 service nova] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:35.407927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdb43c-e300-4933-b076-1bfd73d879db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:35.408824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdb43c-e300-4933-b076-1bfd73d879db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:35.409384 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdb43c-e300-4933-b076-1bfd73d879db admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:35.409893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdb43c-e300-4933-b076-1bfd73d879db admin admin] PATH_INFO: `/v3/users/a7756adbfa9246ed80d46c95a0b10594` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:35.412606 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdb43c-e300-4933-b076-1bfd73d879db admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7756adbfa9246ed80d46c95a0b10594)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:35.429955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdb43c-e300-4933-b076-1bfd73d879db admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:35.577118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-bcbdb43c-e300-4933-b076-1bfd73d879db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7756adbfa9246ed80d46c95a0b10594'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:35.619265 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-bcbdb43c-e300-4933-b076-1bfd73d879db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7756adbfa9246ed80d46c95a0b10594'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:35.666322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-bcbdb43c-e300-4933-b076-1bfd73d879db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7756adbfa9246ed80d46c95a0b10594'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:35.677267 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-bcbdb43c-e300-4933-b076-1bfd73d879db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7756adbfa9246ed80d46c95a0b10594'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:35.679012 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-bcbdb43c-e300-4933-b076-1bfd73d879db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7756adbfa9246ed80d46c95a0b10594'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:35.700394 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 869/1729] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:33:35 2022] DELETE /identity/v3/users/a7756adbfa9246ed80d46c95a0b10594 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:33:36.680002 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a44c79-a405-42c5-84ef-04fd04948c6a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:36.683160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-17a44c79-a405-42c5-84ef-04fd04948c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:36.705840 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a44c79-a405-42c5-84ef-04fd04948c6a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:36.771250 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:36.785297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b3ec9-d7d6-417b-a3d3-184f32615819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:36.786246 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b3ec9-d7d6-417b-a3d3-184f32615819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:36.786614 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b3ec9-d7d6-417b-a3d3-184f32615819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:36.786915 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b3ec9-d7d6-417b-a3d3-184f32615819 admin admin] PATH_INFO: `/v3/users/7a40e2afe28844839ba0274b7eb5a15d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:36.788327 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b3ec9-d7d6-417b-a3d3-184f32615819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a40e2afe28844839ba0274b7eb5a15d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:36.792331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b3ec9-d7d6-417b-a3d3-184f32615819 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:36.902458 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-560b3ec9-d7d6-417b-a3d3-184f32615819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a40e2afe28844839ba0274b7eb5a15d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:36.923840 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-560b3ec9-d7d6-417b-a3d3-184f32615819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a40e2afe28844839ba0274b7eb5a15d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:36.924544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-560b3ec9-d7d6-417b-a3d3-184f32615819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a40e2afe28844839ba0274b7eb5a15d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:36.925424 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-560b3ec9-d7d6-417b-a3d3-184f32615819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a40e2afe28844839ba0274b7eb5a15d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:36.961697 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-560b3ec9-d7d6-417b-a3d3-184f32615819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a40e2afe28844839ba0274b7eb5a15d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:37.045031 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 861/1730] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:33:36 2022] DELETE /identity/v3/users/7a40e2afe28844839ba0274b7eb5a15d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:37.048496 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b5fe-9d0f-4e3b-abef-a5dad5c1eb17 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:37.049073 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b5fe-9d0f-4e3b-abef-a5dad5c1eb17 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:37.049073 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b5fe-9d0f-4e3b-abef-a5dad5c1eb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:37.091006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-3813b5fe-9d0f-4e3b-abef-a5dad5c1eb17 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:37.092580 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-3813b5fe-9d0f-4e3b-abef-a5dad5c1eb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:37.226124 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:37.378241 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 870/1731] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:37.462705 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b3ec9-d7d6-417b-a3d3-184f32615819 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:37.466873 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-560b3ec9-d7d6-417b-a3d3-184f32615819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:37.646309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b3ec9-d7d6-417b-a3d3-184f32615819 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:37.661959 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e41ba-1143-4335-a83d-617ab4bef9dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:37.663184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e41ba-1143-4335-a83d-617ab4bef9dc service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:37.663677 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e41ba-1143-4335-a83d-617ab4bef9dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:37.664112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e41ba-1143-4335-a83d-617ab4bef9dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:37.699138 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e41ba-1143-4335-a83d-617ab4bef9dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:37.704265 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e41ba-1143-4335-a83d-617ab4bef9dc service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:37.728702 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 862/1732] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:38.204450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa035f7-b969-43d0-8b87-09fd09f3d012 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:38.204982 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa035f7-b969-43d0-8b87-09fd09f3d012 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:38.205072 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa035f7-b969-43d0-8b87-09fd09f3d012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:38.215919 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e41ba-1143-4335-a83d-617ab4bef9dc service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:38.218228 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-646e41ba-1143-4335-a83d-617ab4bef9dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:38.291272 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-ffa035f7-b969-43d0-8b87-09fd09f3d012 None None] MFA Rules not processed for user `ce751e35d8184c809a942b4187e88cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:38.306070 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ffa035f7-b969-43d0-8b87-09fd09f3d012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:38.319531 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e41ba-1143-4335-a83d-617ab4bef9dc service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:38.339635 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ded3f3-fa01-4b9e-b91b-88e4507afe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:38.342266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ded3f3-fa01-4b9e-b91b-88e4507afe4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:38.344919 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ded3f3-fa01-4b9e-b91b-88e4507afe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:38.345390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ded3f3-fa01-4b9e-b91b-88e4507afe4c admin admin] PATH_INFO: `/v3/projects/df75346d10fe4ec8b34fbcc0a78351ff` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:38.350754 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ded3f3-fa01-4b9e-b91b-88e4507afe4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=df75346d10fe4ec8b34fbcc0a78351ff)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:38.354234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ded3f3-fa01-4b9e-b91b-88e4507afe4c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:38.542999 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 871/1733] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:38.621149 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-82ded3f3-fa01-4b9e-b91b-88e4507afe4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df75346d10fe4ec8b34fbcc0a78351ff', 'request_id': 'req-82ded3f3-fa01-4b9e-b91b-88e4507afe4c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:38.647560 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-82ded3f3-fa01-4b9e-b91b-88e4507afe4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df75346d10fe4ec8b34fbcc0a78351ff', 'request_id': 'req-82ded3f3-fa01-4b9e-b91b-88e4507afe4c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:38.673843 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-82ded3f3-fa01-4b9e-b91b-88e4507afe4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df75346d10fe4ec8b34fbcc0a78351ff', 'request_id': 'req-82ded3f3-fa01-4b9e-b91b-88e4507afe4c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:38.713004 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-82ded3f3-fa01-4b9e-b91b-88e4507afe4c admin admin] The token cache is being invalidate because project df75346d10fe4ec8b34fbcc0a78351ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:33:38.713665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-82ded3f3-fa01-4b9e-b91b-88e4507afe4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:38.719659 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-82ded3f3-fa01-4b9e-b91b-88e4507afe4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:38.720689 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa035f7-b969-43d0-8b87-09fd09f3d012 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:38.723205 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ffa035f7-b969-43d0-8b87-09fd09f3d012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:38.725089 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 863/1734] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:33:38 2022] DELETE /identity/v3/projects/df75346d10fe4ec8b34fbcc0a78351ff => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:38.726015 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ded3f3-fa01-4b9e-b91b-88e4507afe4c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:38.730173 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-82ded3f3-fa01-4b9e-b91b-88e4507afe4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:38.744332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:38.774414 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa035f7-b969-43d0-8b87-09fd09f3d012 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:38.908554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ded3f3-fa01-4b9e-b91b-88e4507afe4c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:38.923072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d080b-b1ee-42ff-8879-9582ef0d6405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:38.929908 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d080b-b1ee-42ff-8879-9582ef0d6405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:38.930995 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d080b-b1ee-42ff-8879-9582ef0d6405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:38.933275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d080b-b1ee-42ff-8879-9582ef0d6405 admin admin] PATH_INFO: `/v3/users/eb1efb93ac0347b4bf7fdd757d75fc00` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:38.938195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d080b-b1ee-42ff-8879-9582ef0d6405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb1efb93ac0347b4bf7fdd757d75fc00)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:38.945834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d080b-b1ee-42ff-8879-9582ef0d6405 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:38.974029 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d22d3-2111-4adc-8665-d9f5c40f5de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:38.977658 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d22d3-2111-4adc-8665-d9f5c40f5de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:38.977658 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d22d3-2111-4adc-8665-d9f5c40f5de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:38.977919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d22d3-2111-4adc-8665-d9f5c40f5de6 admin admin] PATH_INFO: `/v3/users/d733f64668d741a2ae96e4336d33971c` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:38.982273 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d22d3-2111-4adc-8665-d9f5c40f5de6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d733f64668d741a2ae96e4336d33971c)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:38.984869 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d22d3-2111-4adc-8665-d9f5c40f5de6 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:39.172768 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-510d22d3-2111-4adc-8665-d9f5c40f5de6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd733f64668d741a2ae96e4336d33971c'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:39.178676 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d48d080b-b1ee-42ff-8879-9582ef0d6405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb1efb93ac0347b4bf7fdd757d75fc00'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:39.201710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d48d080b-b1ee-42ff-8879-9582ef0d6405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb1efb93ac0347b4bf7fdd757d75fc00'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:39.202420 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d48d080b-b1ee-42ff-8879-9582ef0d6405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb1efb93ac0347b4bf7fdd757d75fc00'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:39.210516 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d48d080b-b1ee-42ff-8879-9582ef0d6405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb1efb93ac0347b4bf7fdd757d75fc00'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:39.217139 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-510d22d3-2111-4adc-8665-d9f5c40f5de6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd733f64668d741a2ae96e4336d33971c'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:39.276999 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-510d22d3-2111-4adc-8665-d9f5c40f5de6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd733f64668d741a2ae96e4336d33971c'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:39.309764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d48d080b-b1ee-42ff-8879-9582ef0d6405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb1efb93ac0347b4bf7fdd757d75fc00'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:39.323958 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:39.336811 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-510d22d3-2111-4adc-8665-d9f5c40f5de6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd733f64668d741a2ae96e4336d33971c'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:39.341450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-510d22d3-2111-4adc-8665-d9f5c40f5de6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd733f64668d741a2ae96e4336d33971c'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:39.368200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 872/1735] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:33:38 2022] DELETE /identity/v3/users/d733f64668d741a2ae96e4336d33971c => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:39.373189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6f022-4162-4843-b0aa-546f4d180db7 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:39.373471 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6f022-4162-4843-b0aa-546f4d180db7 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:39.373761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6f022-4162-4843-b0aa-546f4d180db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:39.405165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 864/1736] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:33:38 2022] DELETE /identity/v3/users/eb1efb93ac0347b4bf7fdd757d75fc00 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:39.445783 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-66d6f022-4162-4843-b0aa-546f4d180db7 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:39.447004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-66d6f022-4162-4843-b0aa-546f4d180db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:39.718616 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 873/1737] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:39.818050 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d080b-b1ee-42ff-8879-9582ef0d6405 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:39.821605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d48d080b-b1ee-42ff-8879-9582ef0d6405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:40.020067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d080b-b1ee-42ff-8879-9582ef0d6405 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:40.027753 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f410d5-8352-4b2c-87e4-528b0479b736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:40.028631 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f410d5-8352-4b2c-87e4-528b0479b736 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:40.028948 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f410d5-8352-4b2c-87e4-528b0479b736 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:40.029229 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f410d5-8352-4b2c-87e4-528b0479b736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:40.080472 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f410d5-8352-4b2c-87e4-528b0479b736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:40.080583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f410d5-8352-4b2c-87e4-528b0479b736 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:40.094719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd35c2-1666-4fa1-9e66-54e4f8bd88a8 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:40.095389 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd35c2-1666-4fa1-9e66-54e4f8bd88a8 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:40.095881 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd35c2-1666-4fa1-9e66-54e4f8bd88a8 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:40.098305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 874/1738] 10.222.0.25 () {54 vars in 921 bytes} [Mon May 23 12:33:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:33:40.109081 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 865/1739] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:40.329242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d47d50-4213-48c6-afe9-657a3fcaa164 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:40.330239 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d47d50-4213-48c6-afe9-657a3fcaa164 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:40.331370 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d47d50-4213-48c6-afe9-657a3fcaa164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:40.365306 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-97d47d50-4213-48c6-afe9-657a3fcaa164 None None] MFA Rules not processed for user `d49997b9108145b78eb4db1d8823bf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:40.368493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-97d47d50-4213-48c6-afe9-657a3fcaa164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:40.549590 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 875/1740] 10.222.0.25 () {58 vars in 1018 bytes} [Mon May 23 12:33:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:40.618611 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f410d5-8352-4b2c-87e4-528b0479b736 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:40.620087 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-65f410d5-8352-4b2c-87e4-528b0479b736 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:40.641032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f410d5-8352-4b2c-87e4-528b0479b736 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:40.654026 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac9633-82b9-46d3-9c3e-2082c3e687c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:40.654793 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac9633-82b9-46d3-9c3e-2082c3e687c5 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:40.655011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac9633-82b9-46d3-9c3e-2082c3e687c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:40.655288 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac9633-82b9-46d3-9c3e-2082c3e687c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:40.701063 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac9633-82b9-46d3-9c3e-2082c3e687c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:40.704204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac9633-82b9-46d3-9c3e-2082c3e687c5 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:40.740844 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d47d50-4213-48c6-afe9-657a3fcaa164 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:40.744751 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-97d47d50-4213-48c6-afe9-657a3fcaa164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:40.749633 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 866/1741] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:40.852663 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d47d50-4213-48c6-afe9-657a3fcaa164 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:40.884391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006423f-08ac-42e0-a369-c712084dc5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:40.887573 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006423f-08ac-42e0-a369-c712084dc5b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:40.888720 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006423f-08ac-42e0-a369-c712084dc5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:40.890075 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006423f-08ac-42e0-a369-c712084dc5b7 admin admin] PATH_INFO: `/v3/projects/01b4fbb94d9b4fc78f455ce80aa96f24` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:40.892044 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006423f-08ac-42e0-a369-c712084dc5b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01b4fbb94d9b4fc78f455ce80aa96f24)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:40.895318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006423f-08ac-42e0-a369-c712084dc5b7 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:41.024050 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac9633-82b9-46d3-9c3e-2082c3e687c5 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:41.028186 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6dac9633-82b9-46d3-9c3e-2082c3e687c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:41.076199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac9633-82b9-46d3-9c3e-2082c3e687c5 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:41.095612 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cadc7-daf2-4cf1-bebe-33a73f00184c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:41.096419 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cadc7-daf2-4cf1-bebe-33a73f00184c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:41.096709 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cadc7-daf2-4cf1-bebe-33a73f00184c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:41.099381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cadc7-daf2-4cf1-bebe-33a73f00184c admin admin] PATH_INFO: `/v3/projects/837eec4670924e5a813e3e637563e39a` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:41.117782 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288cadc7-daf2-4cf1-bebe-33a73f00184c admin admin] RBAC: Authorizing `identity:delete_project(project_id=837eec4670924e5a813e3e637563e39a)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:41.119810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288cadc7-daf2-4cf1-bebe-33a73f00184c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:41.124100 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-1006423f-08ac-42e0-a369-c712084dc5b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01b4fbb94d9b4fc78f455ce80aa96f24', 'request_id': 'req-1006423f-08ac-42e0-a369-c712084dc5b7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:41.142845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:41.149754 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-1006423f-08ac-42e0-a369-c712084dc5b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01b4fbb94d9b4fc78f455ce80aa96f24', 'request_id': 'req-1006423f-08ac-42e0-a369-c712084dc5b7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:41.170317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-1006423f-08ac-42e0-a369-c712084dc5b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01b4fbb94d9b4fc78f455ce80aa96f24', 'request_id': 'req-1006423f-08ac-42e0-a369-c712084dc5b7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:41.205321 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-1006423f-08ac-42e0-a369-c712084dc5b7 admin admin] The token cache is being invalidate because project 01b4fbb94d9b4fc78f455ce80aa96f24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:33:41.205646 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-1006423f-08ac-42e0-a369-c712084dc5b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:41.207702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-1006423f-08ac-42e0-a369-c712084dc5b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:41.217867 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 876/1742] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:33:40 2022] DELETE /identity/v3/projects/01b4fbb94d9b4fc78f455ce80aa96f24 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:33:41.222724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c288dc-78c3-4378-ac1b-a85b0105f582 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:41.223031 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c288dc-78c3-4378-ac1b-a85b0105f582 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:41.223325 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c288dc-78c3-4378-ac1b-a85b0105f582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:41.278545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-31c288dc-78c3-4378-ac1b-a85b0105f582 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:41.282054 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-31c288dc-78c3-4378-ac1b-a85b0105f582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:41.300192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:41.307333 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-288cadc7-daf2-4cf1-bebe-33a73f00184c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '837eec4670924e5a813e3e637563e39a', 'request_id': 'req-288cadc7-daf2-4cf1-bebe-33a73f00184c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:41.327054 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-288cadc7-daf2-4cf1-bebe-33a73f00184c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '837eec4670924e5a813e3e637563e39a', 'request_id': 'req-288cadc7-daf2-4cf1-bebe-33a73f00184c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:41.345049 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-288cadc7-daf2-4cf1-bebe-33a73f00184c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '837eec4670924e5a813e3e637563e39a', 'request_id': 'req-288cadc7-daf2-4cf1-bebe-33a73f00184c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:41.379767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-288cadc7-daf2-4cf1-bebe-33a73f00184c admin admin] The token cache is being invalidate because project 837eec4670924e5a813e3e637563e39a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:33:41.380159 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-288cadc7-daf2-4cf1-bebe-33a73f00184c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:41.380883 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-288cadc7-daf2-4cf1-bebe-33a73f00184c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:41.388775 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 867/1743] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:33:41 2022] DELETE /identity/v3/projects/837eec4670924e5a813e3e637563e39a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:41.392559 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877eeb52-6a43-4003-8fd0-1a1cf52e17a7 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:41.393326 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877eeb52-6a43-4003-8fd0-1a1cf52e17a7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:41.393816 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877eeb52-6a43-4003-8fd0-1a1cf52e17a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:41.435840 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-877eeb52-6a43-4003-8fd0-1a1cf52e17a7 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:41.437353 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-877eeb52-6a43-4003-8fd0-1a1cf52e17a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:41.453221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 877/1744] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:41.457084 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2a4b2-2a8c-4a26-bce9-1e8917e0e0bd None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:41.457626 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2a4b2-2a8c-4a26-bce9-1e8917e0e0bd None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:41.458166 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2a4b2-2a8c-4a26-bce9-1e8917e0e0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:41.467401 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 868/1745] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:41.468926 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f93f9c-e7f2-4b94-abc8-cf1a0f558f74 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:41.472538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f93f9c-e7f2-4b94-abc8-cf1a0f558f74 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:41.472995 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f93f9c-e7f2-4b94-abc8-cf1a0f558f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:41.507328 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-49e2a4b2-2a8c-4a26-bce9-1e8917e0e0bd None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:41.511515 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-49e2a4b2-2a8c-4a26-bce9-1e8917e0e0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:41.520212 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-36f93f9c-e7f2-4b94-abc8-cf1a0f558f74 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:41.525074 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-36f93f9c-e7f2-4b94-abc8-cf1a0f558f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:41.540578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 878/1746] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:41.545771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2a4b2-2a8c-4a26-bce9-1e8917e0e0bd None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:41.555395 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 869/1747] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:41.558597 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f93f9c-e7f2-4b94-abc8-cf1a0f558f74 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:41.561267 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2a4b2-2a8c-4a26-bce9-1e8917e0e0bd None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:41.579457 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad31f2-aa79-465c-82c5-df9306dbe99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:41.580240 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad31f2-aa79-465c-82c5-df9306dbe99f admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:41.580524 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad31f2-aa79-465c-82c5-df9306dbe99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:41.580854 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad31f2-aa79-465c-82c5-df9306dbe99f admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:41.581915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad31f2-aa79-465c-82c5-df9306dbe99f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:41.582330 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad31f2-aa79-465c-82c5-df9306dbe99f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:41.585772 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f93f9c-e7f2-4b94-abc8-cf1a0f558f74 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:41.587424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad31f2-aa79-465c-82c5-df9306dbe99f admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:41.596793 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ae044-0ccb-4857-a6be-8b1521170a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:41.597806 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ae044-0ccb-4857-a6be-8b1521170a36 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:41.598248 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ae044-0ccb-4857-a6be-8b1521170a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:41.602068 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ae044-0ccb-4857-a6be-8b1521170a36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:41.603307 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ae044-0ccb-4857-a6be-8b1521170a36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:41.604003 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ae044-0ccb-4857-a6be-8b1521170a36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:41.608622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ae044-0ccb-4857-a6be-8b1521170a36 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:41.620655 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 879/1748] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:41.626051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad31f2-aa79-465c-82c5-df9306dbe99f admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:41.660314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 870/1749] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:41.661904 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ae044-0ccb-4857-a6be-8b1521170a36 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:41.667982 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad31f2-aa79-465c-82c5-df9306dbe99f admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:41.683443 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ae044-0ccb-4857-a6be-8b1521170a36 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:41.685575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041b5a7-8d50-4476-8404-7b4fd9cefcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:41.686277 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041b5a7-8d50-4476-8404-7b4fd9cefcd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:41.686596 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041b5a7-8d50-4476-8404-7b4fd9cefcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:41.686883 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041b5a7-8d50-4476-8404-7b4fd9cefcd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:41.687602 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041b5a7-8d50-4476-8404-7b4fd9cefcd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:41.690071 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041b5a7-8d50-4476-8404-7b4fd9cefcd6 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:41.700595 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47803892-921a-4b51-a3c6-9ef6dc4e3849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:41.701856 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47803892-921a-4b51-a3c6-9ef6dc4e3849 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:41.703083 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47803892-921a-4b51-a3c6-9ef6dc4e3849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:41.703483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47803892-921a-4b51-a3c6-9ef6dc4e3849 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:41.704891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47803892-921a-4b51-a3c6-9ef6dc4e3849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:41.711234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47803892-921a-4b51-a3c6-9ef6dc4e3849 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:41.764559 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 880/1750] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:41 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:41.767575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041b5a7-8d50-4476-8404-7b4fd9cefcd6 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:41.773765 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 871/1751] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:41 2022] POST /identity/v3/projects => generated 391 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:41.778222 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47803892-921a-4b51-a3c6-9ef6dc4e3849 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:41.948057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47803892-921a-4b51-a3c6-9ef6dc4e3849 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:41.970484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493be81-76f7-4b99-b401-1c81754422ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:41.971415 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493be81-76f7-4b99-b401-1c81754422ef admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:41.973154 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493be81-76f7-4b99-b401-1c81754422ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:41.973154 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493be81-76f7-4b99-b401-1c81754422ef admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:41.973332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493be81-76f7-4b99-b401-1c81754422ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:41.974213 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041b5a7-8d50-4476-8404-7b4fd9cefcd6 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:41.975744 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493be81-76f7-4b99-b401-1c81754422ef admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:41.997990 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93da7d-06bb-4358-b9b4-c43cd248c18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:42.003734 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93da7d-06bb-4358-b9b4-c43cd248c18e admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:42.004877 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93da7d-06bb-4358-b9b4-c43cd248c18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:42.009465 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93da7d-06bb-4358-b9b4-c43cd248c18e admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:42.011519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93da7d-06bb-4358-b9b4-c43cd248c18e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:42.017510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93da7d-06bb-4358-b9b4-c43cd248c18e admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:42.017939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 872/1752] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:41 2022] POST /identity/v3/users => generated 296 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:42.028958 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493be81-76f7-4b99-b401-1c81754422ef admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:42.028958 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c493be81-76f7-4b99-b401-1c81754422ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:42.062299 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 881/1753] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:41 2022] POST /identity/v3/users => generated 289 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:42.064241 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93da7d-06bb-4358-b9b4-c43cd248c18e admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:42.066318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493be81-76f7-4b99-b401-1c81754422ef admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:42.081998 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e5f2e-ad8a-48ce-b1df-59f8bbb337fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:42.083293 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e5f2e-ad8a-48ce-b1df-59f8bbb337fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:42.083821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e5f2e-ad8a-48ce-b1df-59f8bbb337fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:42.084324 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e5f2e-ad8a-48ce-b1df-59f8bbb337fe admin admin] PATH_INFO: `/v3/projects/bce4eb3450e0475ab40f76d106f3c1f1` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:42.086495 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e5f2e-ad8a-48ce-b1df-59f8bbb337fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce4eb3450e0475ab40f76d106f3c1f1)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:42.089677 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e5f2e-ad8a-48ce-b1df-59f8bbb337fe admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:42.099212 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93da7d-06bb-4358-b9b4-c43cd248c18e admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:42.120778 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3285fe6-6e95-4f73-97d0-b104e06ac378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:42.120778 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3285fe6-6e95-4f73-97d0-b104e06ac378 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:42.120778 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3285fe6-6e95-4f73-97d0-b104e06ac378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:42.120778 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3285fe6-6e95-4f73-97d0-b104e06ac378 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:42.121100 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3285fe6-6e95-4f73-97d0-b104e06ac378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:42.122991 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3285fe6-6e95-4f73-97d0-b104e06ac378 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:42.151086 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 882/1754] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:42.152764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3285fe6-6e95-4f73-97d0-b104e06ac378 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:42.175309 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3285fe6-6e95-4f73-97d0-b104e06ac378 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:42.189468 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a3560-fb5d-4323-8601-3e5c86514bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:42.189956 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:42.190150 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a3560-fb5d-4323-8601-3e5c86514bdf admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:42.190436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a3560-fb5d-4323-8601-3e5c86514bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:42.190743 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a3560-fb5d-4323-8601-3e5c86514bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:42.191734 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a3560-fb5d-4323-8601-3e5c86514bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:42.193385 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a3560-fb5d-4323-8601-3e5c86514bdf admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:42.223690 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e68e5f2e-ad8a-48ce-b1df-59f8bbb337fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce4eb3450e0475ab40f76d106f3c1f1', 'request_id': 'req-e68e5f2e-ad8a-48ce-b1df-59f8bbb337fe'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:42.229992 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 883/1755] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:42.229992 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a3560-fb5d-4323-8601-3e5c86514bdf admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:42.248913 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e68e5f2e-ad8a-48ce-b1df-59f8bbb337fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce4eb3450e0475ab40f76d106f3c1f1', 'request_id': 'req-e68e5f2e-ad8a-48ce-b1df-59f8bbb337fe'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:42.249632 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a3560-fb5d-4323-8601-3e5c86514bdf admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:42.259322 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e68e5f2e-ad8a-48ce-b1df-59f8bbb337fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce4eb3450e0475ab40f76d106f3c1f1', 'request_id': 'req-e68e5f2e-ad8a-48ce-b1df-59f8bbb337fe'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:42.286371 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e68e5f2e-ad8a-48ce-b1df-59f8bbb337fe admin admin] The token cache is being invalidate because project bce4eb3450e0475ab40f76d106f3c1f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:33:42.287763 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e68e5f2e-ad8a-48ce-b1df-59f8bbb337fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:42.290287 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e68e5f2e-ad8a-48ce-b1df-59f8bbb337fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:42.293654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 873/1756] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:33:42 2022] DELETE /identity/v3/projects/bce4eb3450e0475ab40f76d106f3c1f1 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:42.295415 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e5f2e-ad8a-48ce-b1df-59f8bbb337fe admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:42.297486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e68e5f2e-ad8a-48ce-b1df-59f8bbb337fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:42.357004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:42.424475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088ec81-853e-4871-b43e-c8dc80a5e701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:42.425172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088ec81-853e-4871-b43e-c8dc80a5e701 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:42.425458 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088ec81-853e-4871-b43e-c8dc80a5e701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:42.425736 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088ec81-853e-4871-b43e-c8dc80a5e701 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:42.426462 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088ec81-853e-4871-b43e-c8dc80a5e701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:42.426757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e5f2e-ad8a-48ce-b1df-59f8bbb337fe admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:42.428121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088ec81-853e-4871-b43e-c8dc80a5e701 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:42.433411 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3d70a-82e1-4bc2-924a-1cdea94d2f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:42.434316 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3d70a-82e1-4bc2-924a-1cdea94d2f68 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:42.434796 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3d70a-82e1-4bc2-924a-1cdea94d2f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:42.435220 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3d70a-82e1-4bc2-924a-1cdea94d2f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:42.436154 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3d70a-82e1-4bc2-924a-1cdea94d2f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:42.438191 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3d70a-82e1-4bc2-924a-1cdea94d2f68 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:42.456377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 884/1757] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:42.457082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 874/1758] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:42.457082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3d70a-82e1-4bc2-924a-1cdea94d2f68 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:42.459093 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0ed3d70a-82e1-4bc2-924a-1cdea94d2f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:42.461350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088ec81-853e-4871-b43e-c8dc80a5e701 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:42.467900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-b088ec81-853e-4871-b43e-c8dc80a5e701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:42.480832 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3d70a-82e1-4bc2-924a-1cdea94d2f68 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:42.486247 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c2f4d-a200-4ad3-adc4-4726acc5bd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:42.487566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c2f4d-a200-4ad3-adc4-4726acc5bd67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:42.488491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c2f4d-a200-4ad3-adc4-4726acc5bd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:42.489010 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c2f4d-a200-4ad3-adc4-4726acc5bd67 admin admin] PATH_INFO: `/v3/users/68c507f1c98344dea915b25225aaff9d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:42.492090 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c2f4d-a200-4ad3-adc4-4726acc5bd67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68c507f1c98344dea915b25225aaff9d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:42.493517 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088ec81-853e-4871-b43e-c8dc80a5e701 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:42.495574 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c2f4d-a200-4ad3-adc4-4726acc5bd67 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:42.508997 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf597c-b92f-4ad6-b1a6-a89aaac6611a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:42.510350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf597c-b92f-4ad6-b1a6-a89aaac6611a admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:42.510974 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf597c-b92f-4ad6-b1a6-a89aaac6611a admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:42.511404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf597c-b92f-4ad6-b1a6-a89aaac6611a admin admin] PATH_INFO: `/v3/projects/f3bc231714e8470fbfad9a58e2de9e8a/users/7c0ae2727d104d99b7a6a6ca5409a2f8/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:42.540611 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf597c-b92f-4ad6-b1a6-a89aaac6611a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3bc231714e8470fbfad9a58e2de9e8a, user_id=7c0ae2727d104d99b7a6a6ca5409a2f8, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:42.547765 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf597c-b92f-4ad6-b1a6-a89aaac6611a admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:42.592260 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 885/1759] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:42 2022] PUT /identity/v3/projects/f3bc231714e8470fbfad9a58e2de9e8a/users/7c0ae2727d104d99b7a6a6ca5409a2f8/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:42.595266 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf597c-b92f-4ad6-b1a6-a89aaac6611a admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:42.662910 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c47c2f4d-a200-4ad3-adc4-4726acc5bd67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68c507f1c98344dea915b25225aaff9d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:42.699137 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c47c2f4d-a200-4ad3-adc4-4726acc5bd67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68c507f1c98344dea915b25225aaff9d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:42.700019 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c47c2f4d-a200-4ad3-adc4-4726acc5bd67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68c507f1c98344dea915b25225aaff9d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:42.702588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c47c2f4d-a200-4ad3-adc4-4726acc5bd67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68c507f1c98344dea915b25225aaff9d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:42.743893 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c47c2f4d-a200-4ad3-adc4-4726acc5bd67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68c507f1c98344dea915b25225aaff9d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:42.796103 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf597c-b92f-4ad6-b1a6-a89aaac6611a admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:42.798282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 875/1760] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:33:42 2022] DELETE /identity/v3/users/68c507f1c98344dea915b25225aaff9d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:42.800199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e814fd0-49b6-4b45-9b4a-a2d394cb6396 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:42.800495 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e814fd0-49b6-4b45-9b4a-a2d394cb6396 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:42.802569 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e814fd0-49b6-4b45-9b4a-a2d394cb6396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:42.876265 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4e814fd0-49b6-4b45-9b4a-a2d394cb6396 None None] MFA Rules not processed for user `7c0ae2727d104d99b7a6a6ca5409a2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:42.879453 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4e814fd0-49b6-4b45-9b4a-a2d394cb6396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:42.928290 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:43.002981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df77eba-0ca4-41e5-aee8-244dfb8f2ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:43.009560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df77eba-0ca4-41e5-aee8-244dfb8f2ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:43.010004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df77eba-0ca4-41e5-aee8-244dfb8f2ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:43.011398 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df77eba-0ca4-41e5-aee8-244dfb8f2ad1 admin admin] PATH_INFO: `/v3/projects/7d8e707bda43465f803c3f85fe3b7409/users/9a03ce3999704599a00596336d2097eb/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:43.054930 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df77eba-0ca4-41e5-aee8-244dfb8f2ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d8e707bda43465f803c3f85fe3b7409, user_id=9a03ce3999704599a00596336d2097eb, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:43.060195 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df77eba-0ca4-41e5-aee8-244dfb8f2ad1 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:43.071006 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 876/1761] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:43.077077 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e814fd0-49b6-4b45-9b4a-a2d394cb6396 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:43.084019 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4e814fd0-49b6-4b45-9b4a-a2d394cb6396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:43.093606 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 886/1762] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:42 2022] PUT /identity/v3/projects/7d8e707bda43465f803c3f85fe3b7409/users/9a03ce3999704599a00596336d2097eb/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:43.104100 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158d54f-6dc6-44ed-9e92-49de941edb18 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:43.104980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158d54f-6dc6-44ed-9e92-49de941edb18 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:43.105338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158d54f-6dc6-44ed-9e92-49de941edb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:43.110362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e814fd0-49b6-4b45-9b4a-a2d394cb6396 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:43.158021 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-e158d54f-6dc6-44ed-9e92-49de941edb18 None None] MFA Rules not processed for user `ae9ed5cec9cb45f58203e41048d8e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:43.160908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e158d54f-6dc6-44ed-9e92-49de941edb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:43.233847 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:43.236178 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653f049-81f4-47ad-a7ee-1475c3b2ccd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:43.236844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653f049-81f4-47ad-a7ee-1475c3b2ccd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:43.237153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653f049-81f4-47ad-a7ee-1475c3b2ccd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:43.237482 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653f049-81f4-47ad-a7ee-1475c3b2ccd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:43.238240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653f049-81f4-47ad-a7ee-1475c3b2ccd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:43.240641 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653f049-81f4-47ad-a7ee-1475c3b2ccd9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:43.288256 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 887/1763] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:43.289986 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17840ec2-3777-4313-b47f-c2a51a54931e None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:43.290232 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 877/1764] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:43 2022] POST /identity/v3/projects => generated 393 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:33:43.290818 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17840ec2-3777-4313-b47f-c2a51a54931e None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:43.291168 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17840ec2-3777-4313-b47f-c2a51a54931e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:43.294880 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653f049-81f4-47ad-a7ee-1475c3b2ccd9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:43.423072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653f049-81f4-47ad-a7ee-1475c3b2ccd9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:43.441332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680ae46-6763-4e85-a268-42c7486631f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:43.442051 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680ae46-6763-4e85-a268-42c7486631f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:43.442381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680ae46-6763-4e85-a268-42c7486631f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:43.442847 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680ae46-6763-4e85-a268-42c7486631f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:43.444800 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680ae46-6763-4e85-a268-42c7486631f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:43.446882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680ae46-6763-4e85-a268-42c7486631f0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:43.491997 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 878/1765] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:43 2022] POST /identity/v3/users => generated 303 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:33:43.492973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680ae46-6763-4e85-a268-42c7486631f0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:43.494917 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7680ae46-6763-4e85-a268-42c7486631f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:43.510277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680ae46-6763-4e85-a268-42c7486631f0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:43.517222 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5db270-1e6b-4563-80c7-5d2f8bac2fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:43.521701 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5db270-1e6b-4563-80c7-5d2f8bac2fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:43.522129 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5db270-1e6b-4563-80c7-5d2f8bac2fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:43.522417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5db270-1e6b-4563-80c7-5d2f8bac2fa8 admin admin] PATH_INFO: `/v3/projects/41ca83ef85194ff8888d2e44a5f44eec` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:43.523955 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5db270-1e6b-4563-80c7-5d2f8bac2fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41ca83ef85194ff8888d2e44a5f44eec)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:43.526220 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5db270-1e6b-4563-80c7-5d2f8bac2fa8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:43.588194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:43.616636 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9c5db270-1e6b-4563-80c7-5d2f8bac2fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41ca83ef85194ff8888d2e44a5f44eec', 'request_id': 'req-9c5db270-1e6b-4563-80c7-5d2f8bac2fa8'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:43.626061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9c5db270-1e6b-4563-80c7-5d2f8bac2fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41ca83ef85194ff8888d2e44a5f44eec', 'request_id': 'req-9c5db270-1e6b-4563-80c7-5d2f8bac2fa8'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:43.634330 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9c5db270-1e6b-4563-80c7-5d2f8bac2fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41ca83ef85194ff8888d2e44a5f44eec', 'request_id': 'req-9c5db270-1e6b-4563-80c7-5d2f8bac2fa8'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:43.665145 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9c5db270-1e6b-4563-80c7-5d2f8bac2fa8 admin admin] The token cache is being invalidate because project 41ca83ef85194ff8888d2e44a5f44eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:33:43.667833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9c5db270-1e6b-4563-80c7-5d2f8bac2fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:43.671137 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9c5db270-1e6b-4563-80c7-5d2f8bac2fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:43.673850 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-17840ec2-3777-4313-b47f-c2a51a54931e None None] MFA Rules not processed for user `9a03ce3999704599a00596336d2097eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:43.676099 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 879/1766] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:33:43 2022] DELETE /identity/v3/projects/41ca83ef85194ff8888d2e44a5f44eec => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:43.679518 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5db270-1e6b-4563-80c7-5d2f8bac2fa8 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:43.679636 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9c5db270-1e6b-4563-80c7-5d2f8bac2fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:43.682137 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-17840ec2-3777-4313-b47f-c2a51a54931e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:43.852828 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5db270-1e6b-4563-80c7-5d2f8bac2fa8 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:43.865811 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 888/1767] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 575 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:43.870094 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0b95b-1146-4d4b-9162-778d354be66d None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:43.870362 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0b95b-1146-4d4b-9162-778d354be66d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:43.870939 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0b95b-1146-4d4b-9162-778d354be66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:43.878741 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecca72-450b-416c-9c98-c437defee54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:43.881977 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecca72-450b-416c-9c98-c437defee54b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:43.882282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecca72-450b-416c-9c98-c437defee54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:43.885111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecca72-450b-416c-9c98-c437defee54b admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:43.887524 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ecca72-450b-416c-9c98-c437defee54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:43.890330 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ecca72-450b-416c-9c98-c437defee54b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:43.914790 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 880/1768] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:43.916151 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecca72-450b-416c-9c98-c437defee54b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:43.919841 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-04ecca72-450b-416c-9c98-c437defee54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:43.940741 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-70b0b95b-1146-4d4b-9162-778d354be66d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:43.942113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecca72-450b-416c-9c98-c437defee54b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:43.943275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-70b0b95b-1146-4d4b-9162-778d354be66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:43.949441 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89945748-0cab-46b5-b11d-b689b210c70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:43.951659 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89945748-0cab-46b5-b11d-b689b210c70a admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:43.952165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89945748-0cab-46b5-b11d-b689b210c70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:43.952801 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89945748-0cab-46b5-b11d-b689b210c70a admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:43.953712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89945748-0cab-46b5-b11d-b689b210c70a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:43.956099 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89945748-0cab-46b5-b11d-b689b210c70a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:43.978945 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 889/1769] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:43.994003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0b95b-1146-4d4b-9162-778d354be66d None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:44.002886 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 881/1770] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:43 2022] POST /identity/v3/projects => generated 377 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:44.004496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1cb0d-3893-4288-a5b1-c3d0c72b848f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.004791 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1cb0d-3893-4288-a5b1-c3d0c72b848f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.005064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1cb0d-3893-4288-a5b1-c3d0c72b848f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.031187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0b95b-1146-4d4b-9162-778d354be66d None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:44.039671 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-76d1cb0d-3893-4288-a5b1-c3d0c72b848f None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:44.043715 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-76d1cb0d-3893-4288-a5b1-c3d0c72b848f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:44.158828 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58411b61-819a-43ca-aee8-b7dfa59c5634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:44.159862 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58411b61-819a-43ca-aee8-b7dfa59c5634 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.160197 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58411b61-819a-43ca-aee8-b7dfa59c5634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.160480 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58411b61-819a-43ca-aee8-b7dfa59c5634 admin admin] PATH_INFO: `/v3/projects/e03def84ef264e42b304b091c895d9f3/users/70bb67c8bafc44c4a5d624b14a5fe5b9/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.197310 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58411b61-819a-43ca-aee8-b7dfa59c5634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e03def84ef264e42b304b091c895d9f3, user_id=70bb67c8bafc44c4a5d624b14a5fe5b9, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:44.204841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58411b61-819a-43ca-aee8-b7dfa59c5634 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:44.212303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 882/1771] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:44.214999 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1cb0d-3893-4288-a5b1-c3d0c72b848f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:44.240147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1cb0d-3893-4288-a5b1-c3d0c72b848f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:44.250487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 890/1772] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:43 2022] PUT /identity/v3/projects/e03def84ef264e42b304b091c895d9f3/users/70bb67c8bafc44c4a5d624b14a5fe5b9/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:44.251618 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58411b61-819a-43ca-aee8-b7dfa59c5634 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:44.330665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:44.392926 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3337c-6432-4135-8434-b8162798a502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:44.394669 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3337c-6432-4135-8434-b8162798a502 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.395711 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3337c-6432-4135-8434-b8162798a502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.396138 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3337c-6432-4135-8434-b8162798a502 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.396675 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:44.397167 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3337c-6432-4135-8434-b8162798a502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:44.400189 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3337c-6432-4135-8434-b8162798a502 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:44.430147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58411b61-819a-43ca-aee8-b7dfa59c5634 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:44.437675 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc45ee7-7a07-4950-ba45-eefd199cb498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:44.438469 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc45ee7-7a07-4950-ba45-eefd199cb498 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.438861 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc45ee7-7a07-4950-ba45-eefd199cb498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.439610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc45ee7-7a07-4950-ba45-eefd199cb498 admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.440362 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc45ee7-7a07-4950-ba45-eefd199cb498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:44.441251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc45ee7-7a07-4950-ba45-eefd199cb498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:44.443730 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc45ee7-7a07-4950-ba45-eefd199cb498 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:44.457908 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 883/1773] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:44 2022] POST /identity/v3/users => generated 295 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:44.458881 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3337c-6432-4135-8434-b8162798a502 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:44.459386 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 891/1774] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:44.462536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc45ee7-7a07-4950-ba45-eefd199cb498 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:44.476510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc45ee7-7a07-4950-ba45-eefd199cb498 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:44.482740 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c25265-d8db-4b1f-9a5b-800e71e19779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:44.483710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c25265-d8db-4b1f-9a5b-800e71e19779 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.484535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3337c-6432-4135-8434-b8162798a502 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:44.484656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c25265-d8db-4b1f-9a5b-800e71e19779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.485139 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c25265-d8db-4b1f-9a5b-800e71e19779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.486087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c25265-d8db-4b1f-9a5b-800e71e19779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:44.488363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c25265-d8db-4b1f-9a5b-800e71e19779 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:44.500026 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb833879-598f-4788-a863-6363e6adf1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:44.500026 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb833879-598f-4788-a863-6363e6adf1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.500026 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb833879-598f-4788-a863-6363e6adf1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.500026 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb833879-598f-4788-a863-6363e6adf1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.500475 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb833879-598f-4788-a863-6363e6adf1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:44.503402 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb833879-598f-4788-a863-6363e6adf1f4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:44.507627 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 892/1775] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:44.507627 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c25265-d8db-4b1f-9a5b-800e71e19779 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:44.516001 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 884/1776] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:44.516997 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb833879-598f-4788-a863-6363e6adf1f4 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:44.524593 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c25265-d8db-4b1f-9a5b-800e71e19779 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:44.528068 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb833879-598f-4788-a863-6363e6adf1f4 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:44.529540 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458547a-0ea4-47af-90c2-65591cb2e0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:44.530633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458547a-0ea4-47af-90c2-65591cb2e0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.531176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458547a-0ea4-47af-90c2-65591cb2e0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.531587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458547a-0ea4-47af-90c2-65591cb2e0e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.532487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458547a-0ea4-47af-90c2-65591cb2e0e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:44.533200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ba0cc-f1f7-487f-852d-9e9cf6749a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:44.533828 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ba0cc-f1f7-487f-852d-9e9cf6749a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.534119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ba0cc-f1f7-487f-852d-9e9cf6749a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.534617 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ba0cc-f1f7-487f-852d-9e9cf6749a2d admin admin] PATH_INFO: `/v3/projects/06441101a0b24f1cbe0e6adb2970640e/users/093efa98e5334b46bb1a58b3b44ec999/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.535214 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458547a-0ea4-47af-90c2-65591cb2e0e4 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:44.553836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ba0cc-f1f7-487f-852d-9e9cf6749a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=06441101a0b24f1cbe0e6adb2970640e, user_id=093efa98e5334b46bb1a58b3b44ec999, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:44.557072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ba0cc-f1f7-487f-852d-9e9cf6749a2d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:44.571899 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 885/1777] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:44 2022] PUT /identity/v3/projects/06441101a0b24f1cbe0e6adb2970640e/users/093efa98e5334b46bb1a58b3b44ec999/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:44.574881 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ba0cc-f1f7-487f-852d-9e9cf6749a2d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:44.576555 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 893/1778] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:44 2022] POST /identity/v3/projects => generated 409 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:44.577334 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458547a-0ea4-47af-90c2-65591cb2e0e4 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:44.649665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ba0cc-f1f7-487f-852d-9e9cf6749a2d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:44.655394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ad38b-9eca-4c40-89ca-356463f3d92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:44.656496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ad38b-9eca-4c40-89ca-356463f3d92a admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.656814 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ad38b-9eca-4c40-89ca-356463f3d92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.657071 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ad38b-9eca-4c40-89ca-356463f3d92a admin admin] PATH_INFO: `/v3/projects/e03def84ef264e42b304b091c895d9f3/users/70bb67c8bafc44c4a5d624b14a5fe5b9/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.659623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ad38b-9eca-4c40-89ca-356463f3d92a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e03def84ef264e42b304b091c895d9f3, user_id=70bb67c8bafc44c4a5d624b14a5fe5b9, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:44.662904 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ad38b-9eca-4c40-89ca-356463f3d92a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:44.663271 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458547a-0ea4-47af-90c2-65591cb2e0e4 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:44.668475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0734fb-79f7-401d-902f-1dfb856cd8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:44.669376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0734fb-79f7-401d-902f-1dfb856cd8ea admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.669726 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0734fb-79f7-401d-902f-1dfb856cd8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.670075 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0734fb-79f7-401d-902f-1dfb856cd8ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.671227 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0734fb-79f7-401d-902f-1dfb856cd8ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:44.673070 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0734fb-79f7-401d-902f-1dfb856cd8ea admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:44.675529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 886/1779] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:44 2022] PUT /identity/v3/projects/e03def84ef264e42b304b091c895d9f3/users/70bb67c8bafc44c4a5d624b14a5fe5b9/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:44.676250 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ad38b-9eca-4c40-89ca-356463f3d92a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:44.695932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 894/1780] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:44.697221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edcb69-9f1e-456e-a8f2-7204ab67abb6 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.697513 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edcb69-9f1e-456e-a8f2-7204ab67abb6 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.697790 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edcb69-9f1e-456e-a8f2-7204ab67abb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.742897 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-f8edcb69-9f1e-456e-a8f2-7204ab67abb6 None None] MFA Rules not processed for user `70bb67c8bafc44c4a5d624b14a5fe5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:44.745011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-f8edcb69-9f1e-456e-a8f2-7204ab67abb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:44.762603 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ad38b-9eca-4c40-89ca-356463f3d92a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:44.769366 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa02833-b22a-4777-adb8-b8aabec8fa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:44.770063 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa02833-b22a-4777-adb8-b8aabec8fa85 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.771331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa02833-b22a-4777-adb8-b8aabec8fa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.771640 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa02833-b22a-4777-adb8-b8aabec8fa85 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.772501 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa02833-b22a-4777-adb8-b8aabec8fa85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:44.774994 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa02833-b22a-4777-adb8-b8aabec8fa85 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:44.801614 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 887/1781] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:44 2022] POST /identity/v3/users => generated 305 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:44.802990 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa02833-b22a-4777-adb8-b8aabec8fa85 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:44.814380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa02833-b22a-4777-adb8-b8aabec8fa85 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:44.820044 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac983a2-fcff-43ef-a2f9-125b034e5ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:44.821182 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac983a2-fcff-43ef-a2f9-125b034e5ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.821534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac983a2-fcff-43ef-a2f9-125b034e5ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.821883 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac983a2-fcff-43ef-a2f9-125b034e5ec8 admin admin] PATH_INFO: `/v3/projects/06441101a0b24f1cbe0e6adb2970640e/users/093efa98e5334b46bb1a58b3b44ec999/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.824081 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac983a2-fcff-43ef-a2f9-125b034e5ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06441101a0b24f1cbe0e6adb2970640e, user_id=093efa98e5334b46bb1a58b3b44ec999, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:44.826942 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac983a2-fcff-43ef-a2f9-125b034e5ec8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:44.829407 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:44.832670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 895/1782] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:44.837199 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edcb69-9f1e-456e-a8f2-7204ab67abb6 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:44.848275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edcb69-9f1e-456e-a8f2-7204ab67abb6 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:44.853622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 888/1783] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:44 2022] PUT /identity/v3/projects/06441101a0b24f1cbe0e6adb2970640e/users/093efa98e5334b46bb1a58b3b44ec999/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:44.855129 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac983a2-fcff-43ef-a2f9-125b034e5ec8 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:44.868350 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4ac983a2-fcff-43ef-a2f9-125b034e5ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:44.879849 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:44.913123 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d3d0a-74b6-427c-9261-3f3b7bed59dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:44.913809 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d3d0a-74b6-427c-9261-3f3b7bed59dd admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.914158 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d3d0a-74b6-427c-9261-3f3b7bed59dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.914527 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d3d0a-74b6-427c-9261-3f3b7bed59dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.915476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d3d0a-74b6-427c-9261-3f3b7bed59dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:44.918081 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d3d0a-74b6-427c-9261-3f3b7bed59dd admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:44.930190 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 896/1784] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:44.931712 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654e5da-1780-48b8-a236-7f8744fa18eb None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.932014 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654e5da-1780-48b8-a236-7f8744fa18eb None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.932720 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654e5da-1780-48b8-a236-7f8744fa18eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.941219 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac983a2-fcff-43ef-a2f9-125b034e5ec8 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:44.945323 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3686d88-d913-4c4b-8d91-1648ad375374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:44.946021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3686d88-d913-4c4b-8d91-1648ad375374 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:44.946309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3686d88-d913-4c4b-8d91-1648ad375374 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:44.946613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3686d88-d913-4c4b-8d91-1648ad375374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:44.964598 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-2654e5da-1780-48b8-a236-7f8744fa18eb None None] MFA Rules not processed for user `093efa98e5334b46bb1a58b3b44ec999`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:44.965896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-2654e5da-1780-48b8-a236-7f8744fa18eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:45.031531 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3686d88-d913-4c4b-8d91-1648ad375374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:45.036515 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3686d88-d913-4c4b-8d91-1648ad375374 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:45.067427 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 889/1785] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:45.075475 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3686d88-d913-4c4b-8d91-1648ad375374 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:45.100655 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 897/1786] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:45.102669 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3686d88-d913-4c4b-8d91-1648ad375374 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:45.110031 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05999a4-8487-4504-9310-035c9e029314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:45.110961 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05999a4-8487-4504-9310-035c9e029314 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:45.111350 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05999a4-8487-4504-9310-035c9e029314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:45.111776 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654e5da-1780-48b8-a236-7f8744fa18eb None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:45.118326 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-2654e5da-1780-48b8-a236-7f8744fa18eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:45.123221 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05999a4-8487-4504-9310-035c9e029314 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:45.125722 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05999a4-8487-4504-9310-035c9e029314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:45.130419 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05999a4-8487-4504-9310-035c9e029314 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:45.140055 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654e5da-1780-48b8-a236-7f8744fa18eb None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:45.151873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18314e0-d728-4296-a4ec-a4e9f26e981a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:45.152559 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18314e0-d728-4296-a4ec-a4e9f26e981a service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:45.152851 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18314e0-d728-4296-a4ec-a4e9f26e981a service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:45.153140 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18314e0-d728-4296-a4ec-a4e9f26e981a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:45.201825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 890/1787] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:45.204941 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05999a4-8487-4504-9310-035c9e029314 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:45.231019 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05999a4-8487-4504-9310-035c9e029314 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:45.250405 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b586046-ee2e-4c2c-b403-e010555d63f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:45.252181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b586046-ee2e-4c2c-b403-e010555d63f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:45.252620 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b586046-ee2e-4c2c-b403-e010555d63f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:45.253213 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b586046-ee2e-4c2c-b403-e010555d63f4 admin admin] PATH_INFO: `/v3/projects/153bedffeef8478398c052c599837ea5/users/c36e6f00321c4da8b4c70f381ac0f31d/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:45.280141 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18314e0-d728-4296-a4ec-a4e9f26e981a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:45.281622 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18314e0-d728-4296-a4ec-a4e9f26e981a service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:45.312242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b586046-ee2e-4c2c-b403-e010555d63f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=153bedffeef8478398c052c599837ea5, user_id=c36e6f00321c4da8b4c70f381ac0f31d, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:45.314993 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 898/1788] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:33:45.317682 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18314e0-d728-4296-a4ec-a4e9f26e981a service cinder] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:45.324838 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b586046-ee2e-4c2c-b403-e010555d63f4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:45.352434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18314e0-d728-4296-a4ec-a4e9f26e981a service cinder] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:45.368795 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 891/1789] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:45 2022] PUT /identity/v3/projects/153bedffeef8478398c052c599837ea5/users/c36e6f00321c4da8b4c70f381ac0f31d/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:45.380871 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc8960-0215-4a84-a4d0-9b5643a7746d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:45.381168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc8960-0215-4a84-a4d0-9b5643a7746d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:45.381450 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc8960-0215-4a84-a4d0-9b5643a7746d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:45.428813 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4ecc8960-0215-4a84-a4d0-9b5643a7746d None None] MFA Rules not processed for user `c36e6f00321c4da8b4c70f381ac0f31d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:45.431152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4ecc8960-0215-4a84-a4d0-9b5643a7746d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:45.533394 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6963cc8-389e-4503-88b0-9a8193ec83fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:45.534068 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6963cc8-389e-4503-88b0-9a8193ec83fa service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:45.534917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6963cc8-389e-4503-88b0-9a8193ec83fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:45.535151 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6963cc8-389e-4503-88b0-9a8193ec83fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:45.538302 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-d6963cc8-389e-4503-88b0-9a8193ec83fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:45.548447 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:45.550724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:45.568636 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 892/1790] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:45 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:33:45.574119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc8960-0215-4a84-a4d0-9b5643a7746d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:45.642810 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6963cc8-389e-4503-88b0-9a8193ec83fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:45.646271 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6963cc8-389e-4503-88b0-9a8193ec83fa service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:45.671224 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 899/1791] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:45.692067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc8960-0215-4a84-a4d0-9b5643a7746d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:45.706691 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032bc4c-6287-47e5-b148-ba0ae0e6e373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:45.707547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032bc4c-6287-47e5-b148-ba0ae0e6e373 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:45.708798 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032bc4c-6287-47e5-b148-ba0ae0e6e373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:45.710841 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032bc4c-6287-47e5-b148-ba0ae0e6e373 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:45.711844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032bc4c-6287-47e5-b148-ba0ae0e6e373 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:45.718051 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032bc4c-6287-47e5-b148-ba0ae0e6e373 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:45.782078 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 893/1792] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:45 2022] POST /identity/v3/projects => generated 409 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:45.785801 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6963cc8-389e-4503-88b0-9a8193ec83fa service cinder] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:45.820774 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6963cc8-389e-4503-88b0-9a8193ec83fa service cinder] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:46.002544 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446ab40-a4ce-447c-a203-a7ebcc3a1ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:46.004757 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446ab40-a4ce-447c-a203-a7ebcc3a1ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:46.005055 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446ab40-a4ce-447c-a203-a7ebcc3a1ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:46.005479 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446ab40-a4ce-447c-a203-a7ebcc3a1ae5 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:46.006279 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446ab40-a4ce-447c-a203-a7ebcc3a1ae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:46.008686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446ab40-a4ce-447c-a203-a7ebcc3a1ae5 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:46.045645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 900/1793] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:45 2022] POST /identity/v3/users => generated 311 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:46.049585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032bc4c-6287-47e5-b148-ba0ae0e6e373 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:46.061596 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032bc4c-6287-47e5-b148-ba0ae0e6e373 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:46.067748 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497afe9a-1b76-4713-867f-c9bd7df97be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:46.070005 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497afe9a-1b76-4713-867f-c9bd7df97be7 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:46.071643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497afe9a-1b76-4713-867f-c9bd7df97be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:46.074458 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497afe9a-1b76-4713-867f-c9bd7df97be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:46.075528 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497afe9a-1b76-4713-867f-c9bd7df97be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:46.079646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497afe9a-1b76-4713-867f-c9bd7df97be7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:46.100164 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69299c6b-52dc-408e-8f89-4bd315ae4019 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:46.100642 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69299c6b-52dc-408e-8f89-4bd315ae4019 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:46.101030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69299c6b-52dc-408e-8f89-4bd315ae4019 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:46.102857 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 901/1794] 10.222.0.25 () {54 vars in 921 bytes} [Mon May 23 12:33:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 12:33:46.140054 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 894/1795] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:46.144411 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69299c6b-52dc-408e-8f89-4bd315ae4019 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:46.157052 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66124c-6caf-4e7b-99ca-2011d5eee358 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:46.159538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66124c-6caf-4e7b-99ca-2011d5eee358 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:46.160343 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66124c-6caf-4e7b-99ca-2011d5eee358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:46.173085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69299c6b-52dc-408e-8f89-4bd315ae4019 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:46.195472 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586cedf-9ba3-4ad7-a665-798a7943201a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:46.198650 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586cedf-9ba3-4ad7-a665-798a7943201a admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:46.198945 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586cedf-9ba3-4ad7-a665-798a7943201a admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:46.199231 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586cedf-9ba3-4ad7-a665-798a7943201a admin admin] PATH_INFO: `/v3/projects/0c9bcc0098be48adabf1d919ce9ed2e5/users/33c1640ad5024a57a71b55819f72b18d/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:46.212744 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0e66124c-6caf-4e7b-99ca-2011d5eee358 None None] MFA Rules not processed for user `d49997b9108145b78eb4db1d8823bf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:46.218916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0e66124c-6caf-4e7b-99ca-2011d5eee358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:46.271457 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586cedf-9ba3-4ad7-a665-798a7943201a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c9bcc0098be48adabf1d919ce9ed2e5, user_id=33c1640ad5024a57a71b55819f72b18d, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:46.286022 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586cedf-9ba3-4ad7-a665-798a7943201a admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:46.342906 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 902/1796] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:46 2022] PUT /identity/v3/projects/0c9bcc0098be48adabf1d919ce9ed2e5/users/33c1640ad5024a57a71b55819f72b18d/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:46.344562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586cedf-9ba3-4ad7-a665-798a7943201a admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:46.374749 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 895/1797] 10.222.0.25 () {58 vars in 1018 bytes} [Mon May 23 12:33:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:46.405514 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66124c-6caf-4e7b-99ca-2011d5eee358 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:46.408506 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0e66124c-6caf-4e7b-99ca-2011d5eee358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:46.444348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66124c-6caf-4e7b-99ca-2011d5eee358 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:46.548560 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:46.579868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894c6ee-9f50-4e63-abe0-eb840ffa1f3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:46.584700 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894c6ee-9f50-4e63-abe0-eb840ffa1f3c service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:46.585776 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894c6ee-9f50-4e63-abe0-eb840ffa1f3c service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:46.589464 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894c6ee-9f50-4e63-abe0-eb840ffa1f3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:46.596197 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586cedf-9ba3-4ad7-a665-798a7943201a admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:46.617857 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97135f4-557d-43ee-8a90-48b751c52d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:46.621155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97135f4-557d-43ee-8a90-48b751c52d80 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:46.622350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97135f4-557d-43ee-8a90-48b751c52d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:46.625833 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97135f4-557d-43ee-8a90-48b751c52d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:46.629100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894c6ee-9f50-4e63-abe0-eb840ffa1f3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:46.630316 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97135f4-557d-43ee-8a90-48b751c52d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:46.634897 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894c6ee-9f50-4e63-abe0-eb840ffa1f3c service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:46.635264 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97135f4-557d-43ee-8a90-48b751c52d80 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:46.668575 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 896/1798] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:46.669890 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 903/1799] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:46.670007 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894c6ee-9f50-4e63-abe0-eb840ffa1f3c service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:46.704927 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894c6ee-9f50-4e63-abe0-eb840ffa1f3c service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:46.733676 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e8793-1212-4382-b58d-075e9e675f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:46.735935 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e8793-1212-4382-b58d-075e9e675f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:46.738369 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e8793-1212-4382-b58d-075e9e675f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:46.739442 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e8793-1212-4382-b58d-075e9e675f80 admin admin] PATH_INFO: `/v3/projects/0c9bcc0098be48adabf1d919ce9ed2e5/users/33c1640ad5024a57a71b55819f72b18d/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:46.750930 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e8793-1212-4382-b58d-075e9e675f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c9bcc0098be48adabf1d919ce9ed2e5, user_id=33c1640ad5024a57a71b55819f72b18d, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:46.767756 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e8793-1212-4382-b58d-075e9e675f80 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:46.791573 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 897/1800] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:46 2022] PUT /identity/v3/projects/0c9bcc0098be48adabf1d919ce9ed2e5/users/33c1640ad5024a57a71b55819f72b18d/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:46.804020 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45a063-c1f3-4cf7-ae37-36be2c1b2765 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:46.804020 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45a063-c1f3-4cf7-ae37-36be2c1b2765 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:46.804020 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45a063-c1f3-4cf7-ae37-36be2c1b2765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:46.831536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:46.865495 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-7b45a063-c1f3-4cf7-ae37-36be2c1b2765 None None] MFA Rules not processed for user `33c1640ad5024a57a71b55819f72b18d`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:46.867021 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-7b45a063-c1f3-4cf7-ae37-36be2c1b2765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:47.001294 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 904/1801] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:46 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:47.014652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e8793-1212-4382-b58d-075e9e675f80 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:47.087330 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e8793-1212-4382-b58d-075e9e675f80 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:47.094647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b58eb-cd4e-4fac-8057-4f35dfe3b059 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:47.095481 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b58eb-cd4e-4fac-8057-4f35dfe3b059 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:47.095774 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b58eb-cd4e-4fac-8057-4f35dfe3b059 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:47.096081 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b58eb-cd4e-4fac-8057-4f35dfe3b059 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:47.113374 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b58eb-cd4e-4fac-8057-4f35dfe3b059 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:47.115240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b58eb-cd4e-4fac-8057-4f35dfe3b059 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:47.131531 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 898/1802] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:47 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:47.594220 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b45a063-c1f3-4cf7-ae37-36be2c1b2765 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:47.608391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b45a063-c1f3-4cf7-ae37-36be2c1b2765 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:47.613711 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fffbc2-3030-4244-a8c0-baec301d625c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:47.615728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fffbc2-3030-4244-a8c0-baec301d625c service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:47.616691 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fffbc2-3030-4244-a8c0-baec301d625c service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:47.617140 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fffbc2-3030-4244-a8c0-baec301d625c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:47.748945 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fffbc2-3030-4244-a8c0-baec301d625c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:47.749227 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fffbc2-3030-4244-a8c0-baec301d625c service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:47.778371 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 905/1803] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:47 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:48.228326 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b58eb-cd4e-4fac-8057-4f35dfe3b059 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:48.251523 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b58eb-cd4e-4fac-8057-4f35dfe3b059 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:48.280708 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10de612-ceab-4e74-bd0d-48dc16db0b29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:48.281386 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10de612-ceab-4e74-bd0d-48dc16db0b29 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:48.281677 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10de612-ceab-4e74-bd0d-48dc16db0b29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:48.281957 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10de612-ceab-4e74-bd0d-48dc16db0b29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:48.415995 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10de612-ceab-4e74-bd0d-48dc16db0b29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:48.419488 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10de612-ceab-4e74-bd0d-48dc16db0b29 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:48.437926 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 899/1804] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:50.714958 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fffbc2-3030-4244-a8c0-baec301d625c service cinder] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:50.841601 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fffbc2-3030-4244-a8c0-baec301d625c service cinder] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:50.848576 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ef527-af0b-4106-afa8-92c94631ac4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:50.849615 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ef527-af0b-4106-afa8-92c94631ac4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:50.849926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ef527-af0b-4106-afa8-92c94631ac4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:50.850760 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ef527-af0b-4106-afa8-92c94631ac4b admin admin] PATH_INFO: `/v3/users/7c0ae2727d104d99b7a6a6ca5409a2f8` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:50.851885 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ef527-af0b-4106-afa8-92c94631ac4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c0ae2727d104d99b7a6a6ca5409a2f8)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:50.854767 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ef527-af0b-4106-afa8-92c94631ac4b admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:50.933299 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:50.979311 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-856ef527-af0b-4106-afa8-92c94631ac4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c0ae2727d104d99b7a6a6ca5409a2f8'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:50.996996 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-856ef527-af0b-4106-afa8-92c94631ac4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c0ae2727d104d99b7a6a6ca5409a2f8'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:51.026149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-856ef527-af0b-4106-afa8-92c94631ac4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c0ae2727d104d99b7a6a6ca5409a2f8'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:51.044555 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-856ef527-af0b-4106-afa8-92c94631ac4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c0ae2727d104d99b7a6a6ca5409a2f8'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:51.046363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-856ef527-af0b-4106-afa8-92c94631ac4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c0ae2727d104d99b7a6a6ca5409a2f8'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:51.063408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 906/1805] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:33:50 2022] DELETE /identity/v3/users/7c0ae2727d104d99b7a6a6ca5409a2f8 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:51.068217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fc137-daf5-427f-a938-1daa47a573a0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:51.069004 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fc137-daf5-427f-a938-1daa47a573a0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:51.069370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fc137-daf5-427f-a938-1daa47a573a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:51.108350 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-600fc137-daf5-427f-a938-1daa47a573a0 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:51.109575 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-600fc137-daf5-427f-a938-1daa47a573a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:51.213445 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 900/1806] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:51.224258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ef527-af0b-4106-afa8-92c94631ac4b admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:51.226050 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-856ef527-af0b-4106-afa8-92c94631ac4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:51.305820 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ef527-af0b-4106-afa8-92c94631ac4b admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:51.314998 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67883109-93bc-4200-bf46-3b3749b42fe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:51.316487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67883109-93bc-4200-bf46-3b3749b42fe3 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:51.316782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67883109-93bc-4200-bf46-3b3749b42fe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:51.317080 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67883109-93bc-4200-bf46-3b3749b42fe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:51.328347 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67883109-93bc-4200-bf46-3b3749b42fe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:51.330309 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67883109-93bc-4200-bf46-3b3749b42fe3 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:51.341260 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 907/1807] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:52.080918 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fc137-daf5-427f-a938-1daa47a573a0 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:52.083047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-600fc137-daf5-427f-a938-1daa47a573a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:52.098334 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fc137-daf5-427f-a938-1daa47a573a0 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:52.106151 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcec76e-5159-46f3-9422-b76f85d442d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:52.107547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcec76e-5159-46f3-9422-b76f85d442d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:52.108286 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcec76e-5159-46f3-9422-b76f85d442d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:52.108743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcec76e-5159-46f3-9422-b76f85d442d5 admin admin] PATH_INFO: `/v3/projects/f3bc231714e8470fbfad9a58e2de9e8a` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:52.110734 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcec76e-5159-46f3-9422-b76f85d442d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3bc231714e8470fbfad9a58e2de9e8a)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:52.113837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcec76e-5159-46f3-9422-b76f85d442d5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:52.125319 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:52.199473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0dcec76e-5159-46f3-9422-b76f85d442d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3bc231714e8470fbfad9a58e2de9e8a', 'request_id': 'req-0dcec76e-5159-46f3-9422-b76f85d442d5'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:52.215600 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0dcec76e-5159-46f3-9422-b76f85d442d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3bc231714e8470fbfad9a58e2de9e8a', 'request_id': 'req-0dcec76e-5159-46f3-9422-b76f85d442d5'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:52.224857 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0dcec76e-5159-46f3-9422-b76f85d442d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3bc231714e8470fbfad9a58e2de9e8a', 'request_id': 'req-0dcec76e-5159-46f3-9422-b76f85d442d5'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:52.241322 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0dcec76e-5159-46f3-9422-b76f85d442d5 admin admin] The token cache is being invalidate because project f3bc231714e8470fbfad9a58e2de9e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:33:52.241786 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0dcec76e-5159-46f3-9422-b76f85d442d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:52.242344 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0dcec76e-5159-46f3-9422-b76f85d442d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:52.243966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 901/1808] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:33:52 2022] DELETE /identity/v3/projects/f3bc231714e8470fbfad9a58e2de9e8a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:52.248577 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67883109-93bc-4200-bf46-3b3749b42fe3 service neutron] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:52.259382 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67883109-93bc-4200-bf46-3b3749b42fe3 service neutron] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:52.324526 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b3af9-5024-4e5e-9c8b-6d6460fb4948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:52.325396 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b3af9-5024-4e5e-9c8b-6d6460fb4948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:52.325677 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b3af9-5024-4e5e-9c8b-6d6460fb4948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:52.325967 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b3af9-5024-4e5e-9c8b-6d6460fb4948 admin admin] PATH_INFO: `/v3/users/70bb67c8bafc44c4a5d624b14a5fe5b9` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:52.327316 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b3af9-5024-4e5e-9c8b-6d6460fb4948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70bb67c8bafc44c4a5d624b14a5fe5b9)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:52.329867 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b3af9-5024-4e5e-9c8b-6d6460fb4948 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:52.379320 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-eb2b3af9-5024-4e5e-9c8b-6d6460fb4948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70bb67c8bafc44c4a5d624b14a5fe5b9'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:52.387492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-eb2b3af9-5024-4e5e-9c8b-6d6460fb4948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70bb67c8bafc44c4a5d624b14a5fe5b9'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:52.388878 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:52.414298 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-eb2b3af9-5024-4e5e-9c8b-6d6460fb4948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70bb67c8bafc44c4a5d624b14a5fe5b9'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:52.422566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-eb2b3af9-5024-4e5e-9c8b-6d6460fb4948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70bb67c8bafc44c4a5d624b14a5fe5b9'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:52.423282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-eb2b3af9-5024-4e5e-9c8b-6d6460fb4948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70bb67c8bafc44c4a5d624b14a5fe5b9'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:52.429419 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 908/1809] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:33:52 2022] DELETE /identity/v3/users/70bb67c8bafc44c4a5d624b14a5fe5b9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:52.977998 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcec76e-5159-46f3-9422-b76f85d442d5 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:52.980277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0dcec76e-5159-46f3-9422-b76f85d442d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:53.032599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcec76e-5159-46f3-9422-b76f85d442d5 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:53.133195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2eb30c-9cba-48c8-8819-c04781b5cae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:53.135199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eb30c-9cba-48c8-8819-c04781b5cae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:53.136302 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eb30c-9cba-48c8-8819-c04781b5cae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:53.137341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eb30c-9cba-48c8-8819-c04781b5cae9 admin admin] PATH_INFO: `/v3/projects/e03def84ef264e42b304b091c895d9f3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:53.138960 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2eb30c-9cba-48c8-8819-c04781b5cae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e03def84ef264e42b304b091c895d9f3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:53.141533 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2eb30c-9cba-48c8-8819-c04781b5cae9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:53.251355 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4c2eb30c-9cba-48c8-8819-c04781b5cae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e03def84ef264e42b304b091c895d9f3', 'request_id': 'req-4c2eb30c-9cba-48c8-8819-c04781b5cae9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:53.267422 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4c2eb30c-9cba-48c8-8819-c04781b5cae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e03def84ef264e42b304b091c895d9f3', 'request_id': 'req-4c2eb30c-9cba-48c8-8819-c04781b5cae9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:53.286357 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4c2eb30c-9cba-48c8-8819-c04781b5cae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e03def84ef264e42b304b091c895d9f3', 'request_id': 'req-4c2eb30c-9cba-48c8-8819-c04781b5cae9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:53.316382 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4c2eb30c-9cba-48c8-8819-c04781b5cae9 admin admin] The token cache is being invalidate because project e03def84ef264e42b304b091c895d9f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:33:53.316684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4c2eb30c-9cba-48c8-8819-c04781b5cae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:53.317444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4c2eb30c-9cba-48c8-8819-c04781b5cae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:53.320113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 902/1810] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:33:52 2022] DELETE /identity/v3/projects/e03def84ef264e42b304b091c895d9f3 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:53.328744 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc708e62-c138-44a2-bf2f-3dc4914121b7 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:53.329322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc708e62-c138-44a2-bf2f-3dc4914121b7 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:53.329816 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc708e62-c138-44a2-bf2f-3dc4914121b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:53.368486 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-bc708e62-c138-44a2-bf2f-3dc4914121b7 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:53.370042 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-bc708e62-c138-44a2-bf2f-3dc4914121b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:53.487248 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 909/1811] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:53.495297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d22a6-b756-495c-9452-a192ece975de None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:53.495720 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d22a6-b756-495c-9452-a192ece975de None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:53.496262 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d22a6-b756-495c-9452-a192ece975de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:53.517633 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-5c0d22a6-b756-495c-9452-a192ece975de None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:53.519548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5c0d22a6-b756-495c-9452-a192ece975de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:53.535602 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 903/1812] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:53.535760 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc708e62-c138-44a2-bf2f-3dc4914121b7 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:53.535760 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-bc708e62-c138-44a2-bf2f-3dc4914121b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:53.536830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d22a6-b756-495c-9452-a192ece975de None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:53.548053 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d22a6-b756-495c-9452-a192ece975de None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:53.550682 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc708e62-c138-44a2-bf2f-3dc4914121b7 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:53.553018 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7932e-ce86-4c6b-9205-86fccdd75a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:53.553751 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7932e-ce86-4c6b-9205-86fccdd75a6b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:53.554135 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7932e-ce86-4c6b-9205-86fccdd75a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:53.554479 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7932e-ce86-4c6b-9205-86fccdd75a6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:53.555764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea434cc9-d37c-448e-824a-6708ceb549a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:53.556752 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea434cc9-d37c-448e-824a-6708ceb549a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:53.557174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea434cc9-d37c-448e-824a-6708ceb549a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:53.557533 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea434cc9-d37c-448e-824a-6708ceb549a0 admin admin] PATH_INFO: `/v3/users/48b05708d3e344d89f964cdcdf2e5b23` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:53.558888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea434cc9-d37c-448e-824a-6708ceb549a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48b05708d3e344d89f964cdcdf2e5b23)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:53.561292 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea434cc9-d37c-448e-824a-6708ceb549a0 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:53.561690 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7932e-ce86-4c6b-9205-86fccdd75a6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:53.562313 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7932e-ce86-4c6b-9205-86fccdd75a6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:53.567137 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7932e-ce86-4c6b-9205-86fccdd75a6b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:53.581056 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 904/1813] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:53.585128 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7932e-ce86-4c6b-9205-86fccdd75a6b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:53.596065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7932e-ce86-4c6b-9205-86fccdd75a6b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:53.601054 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7014d8-dd31-4025-ad0f-ce99021bbc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:53.601787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7014d8-dd31-4025-ad0f-ce99021bbc51 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:53.602117 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7014d8-dd31-4025-ad0f-ce99021bbc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:53.602417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7014d8-dd31-4025-ad0f-ce99021bbc51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:53.603244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7014d8-dd31-4025-ad0f-ce99021bbc51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:53.605361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7014d8-dd31-4025-ad0f-ce99021bbc51 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:53.608631 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:53.616818 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ea434cc9-d37c-448e-824a-6708ceb549a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48b05708d3e344d89f964cdcdf2e5b23'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:53.627117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ea434cc9-d37c-448e-824a-6708ceb549a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48b05708d3e344d89f964cdcdf2e5b23'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:53.641924 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ea434cc9-d37c-448e-824a-6708ceb549a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48b05708d3e344d89f964cdcdf2e5b23'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:53.642241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 905/1814] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:53 2022] POST /identity/v3/projects => generated 401 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:33:53.643152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7014d8-dd31-4025-ad0f-ce99021bbc51 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:53.652103 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ea434cc9-d37c-448e-824a-6708ceb549a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48b05708d3e344d89f964cdcdf2e5b23'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:53.652832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ea434cc9-d37c-448e-824a-6708ceb549a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48b05708d3e344d89f964cdcdf2e5b23'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:53.659412 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 910/1815] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:33:53 2022] DELETE /identity/v3/users/48b05708d3e344d89f964cdcdf2e5b23 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:33:53.664115 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cc47a-4a1d-4b24-b621-7d680d7c6b3c None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:53.664576 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cc47a-4a1d-4b24-b621-7d680d7c6b3c None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:53.665038 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cc47a-4a1d-4b24-b621-7d680d7c6b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:53.686681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-864cc47a-4a1d-4b24-b621-7d680d7c6b3c None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:53.687986 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-864cc47a-4a1d-4b24-b621-7d680d7c6b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:53.722817 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7014d8-dd31-4025-ad0f-ce99021bbc51 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:53.738435 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:53.770650 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 911/1816] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:33:53.780974 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864cc47a-4a1d-4b24-b621-7d680d7c6b3c None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:53.784097 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-864cc47a-4a1d-4b24-b621-7d680d7c6b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:53.798546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037de2a-85ac-45da-b0fb-1acd5731e4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:53.798848 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037de2a-85ac-45da-b0fb-1acd5731e4ad admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:53.799208 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037de2a-85ac-45da-b0fb-1acd5731e4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:53.799559 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037de2a-85ac-45da-b0fb-1acd5731e4ad admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:53.800516 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037de2a-85ac-45da-b0fb-1acd5731e4ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:53.803186 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037de2a-85ac-45da-b0fb-1acd5731e4ad admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:53.828324 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 906/1817] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:53 2022] POST /identity/v3/users => generated 301 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:53.843327 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037de2a-85ac-45da-b0fb-1acd5731e4ad admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:53.848980 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a037de2a-85ac-45da-b0fb-1acd5731e4ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:53.881046 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037de2a-85ac-45da-b0fb-1acd5731e4ad admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:53.895523 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5aaca-0e1a-453e-a834-c6ab80d7a75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:53.896221 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5aaca-0e1a-453e-a834-c6ab80d7a75a admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:53.896507 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5aaca-0e1a-453e-a834-c6ab80d7a75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:53.896786 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5aaca-0e1a-453e-a834-c6ab80d7a75a admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:53.899023 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5aaca-0e1a-453e-a834-c6ab80d7a75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:53.905743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5aaca-0e1a-453e-a834-c6ab80d7a75a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:53.921760 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864cc47a-4a1d-4b24-b621-7d680d7c6b3c None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:53.925589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 907/1818] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:53.928991 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5aaca-0e1a-453e-a834-c6ab80d7a75a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:53.931269 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbd7e4-de90-495b-a647-2c9fa350859c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:53.932679 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbd7e4-de90-495b-a647-2c9fa350859c service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:53.933040 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbd7e4-de90-495b-a647-2c9fa350859c service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:53.933395 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbd7e4-de90-495b-a647-2c9fa350859c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:53.942614 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5aaca-0e1a-453e-a834-c6ab80d7a75a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:53.948746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03cf1b-aeba-48c5-8f32-0c7acf69ac3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:53.949615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03cf1b-aeba-48c5-8f32-0c7acf69ac3f admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:53.950145 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03cf1b-aeba-48c5-8f32-0c7acf69ac3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:53.950770 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03cf1b-aeba-48c5-8f32-0c7acf69ac3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:53.951669 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03cf1b-aeba-48c5-8f32-0c7acf69ac3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:53.952995 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbd7e4-de90-495b-a647-2c9fa350859c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:53.954042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03cf1b-aeba-48c5-8f32-0c7acf69ac3f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:53.954820 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbd7e4-de90-495b-a647-2c9fa350859c service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:53.967920 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 908/1819] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:53.968667 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 912/1820] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:33:53.973500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03cf1b-aeba-48c5-8f32-0c7acf69ac3f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:53.995561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03cf1b-aeba-48c5-8f32-0c7acf69ac3f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:54.003761 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50eb6e1-d7f8-493f-97bc-fd6d84eb1b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:54.005122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50eb6e1-d7f8-493f-97bc-fd6d84eb1b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.005344 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50eb6e1-d7f8-493f-97bc-fd6d84eb1b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.005666 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50eb6e1-d7f8-493f-97bc-fd6d84eb1b86 admin admin] PATH_INFO: `/v3/projects/ccbc9e819d044f598810c140cf648ded/users/e67b1124e5024b19889e7275536c7694/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.020678 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbd7e4-de90-495b-a647-2c9fa350859c service neutron] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:54.022842 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-aefbd7e4-de90-495b-a647-2c9fa350859c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:54.028178 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50eb6e1-d7f8-493f-97bc-fd6d84eb1b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccbc9e819d044f598810c140cf648ded, user_id=e67b1124e5024b19889e7275536c7694, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:54.031134 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50eb6e1-d7f8-493f-97bc-fd6d84eb1b86 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:54.041385 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbd7e4-de90-495b-a647-2c9fa350859c service neutron] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:54.058591 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 909/1821] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:53 2022] PUT /identity/v3/projects/ccbc9e819d044f598810c140cf648ded/users/e67b1124e5024b19889e7275536c7694/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:54.064764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f3164-1c03-464c-b9f3-f1d766e1c948 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.065661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f3164-1c03-464c-b9f3-f1d766e1c948 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.065661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f3164-1c03-464c-b9f3-f1d766e1c948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.120847 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-8f0f3164-1c03-464c-b9f3-f1d766e1c948 None None] MFA Rules not processed for user `e67b1124e5024b19889e7275536c7694`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:54.122334 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8f0f3164-1c03-464c-b9f3-f1d766e1c948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:54.147810 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afa7cf-71c1-4361-9c8d-3c06229f1d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:54.150232 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afa7cf-71c1-4361-9c8d-3c06229f1d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.150232 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afa7cf-71c1-4361-9c8d-3c06229f1d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.150232 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afa7cf-71c1-4361-9c8d-3c06229f1d64 admin admin] PATH_INFO: `/v3/users/c36e6f00321c4da8b4c70f381ac0f31d` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.155203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afa7cf-71c1-4361-9c8d-3c06229f1d64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c36e6f00321c4da8b4c70f381ac0f31d)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:54.158320 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afa7cf-71c1-4361-9c8d-3c06229f1d64 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:54.167975 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:54.230908 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 910/1822] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:54.234689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f3164-1c03-464c-b9f3-f1d766e1c948 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:54.240349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-25afa7cf-71c1-4361-9c8d-3c06229f1d64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c36e6f00321c4da8b4c70f381ac0f31d'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:54.255197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f3164-1c03-464c-b9f3-f1d766e1c948 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:54.256875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-25afa7cf-71c1-4361-9c8d-3c06229f1d64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c36e6f00321c4da8b4c70f381ac0f31d'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:54.264189 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c64d0-4991-4c9b-b42f-2abc1d2ce2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:54.264936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c64d0-4991-4c9b-b42f-2abc1d2ce2fb admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.265230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c64d0-4991-4c9b-b42f-2abc1d2ce2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.265669 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c64d0-4991-4c9b-b42f-2abc1d2ce2fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.266387 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c64d0-4991-4c9b-b42f-2abc1d2ce2fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:54.268579 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c64d0-4991-4c9b-b42f-2abc1d2ce2fb admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:54.275146 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-25afa7cf-71c1-4361-9c8d-3c06229f1d64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c36e6f00321c4da8b4c70f381ac0f31d'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:54.300466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-25afa7cf-71c1-4361-9c8d-3c06229f1d64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c36e6f00321c4da8b4c70f381ac0f31d'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:54.301565 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-25afa7cf-71c1-4361-9c8d-3c06229f1d64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c36e6f00321c4da8b4c70f381ac0f31d'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:54.318186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 913/1823] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:33:54 2022] DELETE /identity/v3/users/c36e6f00321c4da8b4c70f381ac0f31d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:33:54.324854 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db37d7d-5035-47a2-9548-f8f19baff2d0 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.325167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db37d7d-5035-47a2-9548-f8f19baff2d0 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.325460 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db37d7d-5035-47a2-9548-f8f19baff2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.332009 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 911/1824] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:54 2022] POST /identity/v3/projects => generated 401 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:33:54.339358 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c64d0-4991-4c9b-b42f-2abc1d2ce2fb admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:54.345088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7a2c64d0-4991-4c9b-b42f-2abc1d2ce2fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:54.357260 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:54.367541 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-2db37d7d-5035-47a2-9548-f8f19baff2d0 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:54.369161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-2db37d7d-5035-47a2-9548-f8f19baff2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:54.430662 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c64d0-4991-4c9b-b42f-2abc1d2ce2fb admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:54.436036 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ee6ea-d12d-464b-9eaa-aaeca5c3fed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:54.436813 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ee6ea-d12d-464b-9eaa-aaeca5c3fed4 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.437162 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ee6ea-d12d-464b-9eaa-aaeca5c3fed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.437504 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ee6ea-d12d-464b-9eaa-aaeca5c3fed4 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.438302 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ee6ea-d12d-464b-9eaa-aaeca5c3fed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:54.439596 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 914/1825] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:54.440516 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ee6ea-d12d-464b-9eaa-aaeca5c3fed4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:54.444529 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db37d7d-5035-47a2-9548-f8f19baff2d0 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:54.446348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-2db37d7d-5035-47a2-9548-f8f19baff2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:54.460497 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db37d7d-5035-47a2-9548-f8f19baff2d0 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:54.467427 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af1656-405d-40ea-b09a-2554dd84783e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:54.468305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af1656-405d-40ea-b09a-2554dd84783e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.468591 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af1656-405d-40ea-b09a-2554dd84783e admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.468868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af1656-405d-40ea-b09a-2554dd84783e admin admin] PATH_INFO: `/v3/projects/89b4af8cf0c048d49c097cadfad619cd` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.470283 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af1656-405d-40ea-b09a-2554dd84783e admin admin] RBAC: Authorizing `identity:delete_project(project_id=89b4af8cf0c048d49c097cadfad619cd)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:54.472351 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af1656-405d-40ea-b09a-2554dd84783e admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:54.473479 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 912/1826] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:54 2022] POST /identity/v3/users => generated 307 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:33:54.474839 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ee6ea-d12d-464b-9eaa-aaeca5c3fed4 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:54.476702 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d43ee6ea-d12d-464b-9eaa-aaeca5c3fed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:54.540693 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d8af1656-405d-40ea-b09a-2554dd84783e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89b4af8cf0c048d49c097cadfad619cd', 'request_id': 'req-d8af1656-405d-40ea-b09a-2554dd84783e'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:54.549474 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d8af1656-405d-40ea-b09a-2554dd84783e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89b4af8cf0c048d49c097cadfad619cd', 'request_id': 'req-d8af1656-405d-40ea-b09a-2554dd84783e'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:54.558861 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d8af1656-405d-40ea-b09a-2554dd84783e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89b4af8cf0c048d49c097cadfad619cd', 'request_id': 'req-d8af1656-405d-40ea-b09a-2554dd84783e'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:54.560678 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ee6ea-d12d-464b-9eaa-aaeca5c3fed4 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:54.574972 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d8af1656-405d-40ea-b09a-2554dd84783e admin admin] The token cache is being invalidate because project 89b4af8cf0c048d49c097cadfad619cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:33:54.574972 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d8af1656-405d-40ea-b09a-2554dd84783e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:54.575389 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d8af1656-405d-40ea-b09a-2554dd84783e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:54.580372 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 915/1827] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:33:54 2022] DELETE /identity/v3/projects/89b4af8cf0c048d49c097cadfad619cd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:54.581669 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af1656-405d-40ea-b09a-2554dd84783e admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:54.583132 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-d8af1656-405d-40ea-b09a-2554dd84783e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:54.645827 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:54.656639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c6d4c-41b9-4322-8317-af487249f1c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:54.657584 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c6d4c-41b9-4322-8317-af487249f1c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.658122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c6d4c-41b9-4322-8317-af487249f1c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.658529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c6d4c-41b9-4322-8317-af487249f1c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.660836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-395c6d4c-41b9-4322-8317-af487249f1c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:54.675804 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af1656-405d-40ea-b09a-2554dd84783e admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:54.682387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e557c-f027-4c91-a97b-dc9e990e0756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:54.683125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c6d4c-41b9-4322-8317-af487249f1c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:54.683484 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e557c-f027-4c91-a97b-dc9e990e0756 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.683924 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e557c-f027-4c91-a97b-dc9e990e0756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.684423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e557c-f027-4c91-a97b-dc9e990e0756 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.684601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c6d4c-41b9-4322-8317-af487249f1c9 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:54.685466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e557c-f027-4c91-a97b-dc9e990e0756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:54.687256 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e557c-f027-4c91-a97b-dc9e990e0756 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:54.696573 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 913/1828] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:54.697988 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c6d4c-41b9-4322-8317-af487249f1c9 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:54.699458 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-395c6d4c-41b9-4322-8317-af487249f1c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:54.700242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 916/1829] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:54.704092 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e557c-f027-4c91-a97b-dc9e990e0756 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:54.711700 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c6d4c-41b9-4322-8317-af487249f1c9 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:54.716414 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e557c-f027-4c91-a97b-dc9e990e0756 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:54.718029 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ed556-62d1-41f0-acc6-3fc2d7bf5583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:54.719168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ed556-62d1-41f0-acc6-3fc2d7bf5583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.719548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ed556-62d1-41f0-acc6-3fc2d7bf5583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.719975 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ed556-62d1-41f0-acc6-3fc2d7bf5583 admin admin] PATH_INFO: `/v3/users/92bef1c245144ca29506714375419fec` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.722134 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ed556-62d1-41f0-acc6-3fc2d7bf5583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92bef1c245144ca29506714375419fec)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:54.723765 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b24cef-cff2-4ad4-9d87-eb81b02dbc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:54.724625 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ed556-62d1-41f0-acc6-3fc2d7bf5583 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:54.725211 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b24cef-cff2-4ad4-9d87-eb81b02dbc2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:54.725639 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b24cef-cff2-4ad4-9d87-eb81b02dbc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:54.726819 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b24cef-cff2-4ad4-9d87-eb81b02dbc2c admin admin] PATH_INFO: `/v3/projects/0d140d1b765c425cb11640093d98fb55/users/70aac314b01b45c198b61daeab9e5d9d/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:54.750417 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b24cef-cff2-4ad4-9d87-eb81b02dbc2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d140d1b765c425cb11640093d98fb55, user_id=70aac314b01b45c198b61daeab9e5d9d, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:54.753949 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b24cef-cff2-4ad4-9d87-eb81b02dbc2c admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:54.780030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 917/1830] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:54 2022] PUT /identity/v3/projects/0d140d1b765c425cb11640093d98fb55/users/70aac314b01b45c198b61daeab9e5d9d/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:54.781799 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b24cef-cff2-4ad4-9d87-eb81b02dbc2c admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:54.794488 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:54.801646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-456ed556-62d1-41f0-acc6-3fc2d7bf5583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92bef1c245144ca29506714375419fec'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:54.817811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-456ed556-62d1-41f0-acc6-3fc2d7bf5583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92bef1c245144ca29506714375419fec'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:54.818955 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-456ed556-62d1-41f0-acc6-3fc2d7bf5583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92bef1c245144ca29506714375419fec'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:54.819825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-456ed556-62d1-41f0-acc6-3fc2d7bf5583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92bef1c245144ca29506714375419fec'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:54.857393 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-456ed556-62d1-41f0-acc6-3fc2d7bf5583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92bef1c245144ca29506714375419fec'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:54.890601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 914/1831] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:33:54 2022] DELETE /identity/v3/users/92bef1c245144ca29506714375419fec => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:54.905423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b24cef-cff2-4ad4-9d87-eb81b02dbc2c admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:55.037733 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d14f2-d06b-4881-a4bf-f248c9bce303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:55.038672 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d14f2-d06b-4881-a4bf-f248c9bce303 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:55.039098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d14f2-d06b-4881-a4bf-f248c9bce303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:55.039475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d14f2-d06b-4881-a4bf-f248c9bce303 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:55.043425 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d14f2-d06b-4881-a4bf-f248c9bce303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:55.045423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d14f2-d06b-4881-a4bf-f248c9bce303 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:55.072161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 918/1832] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:55.076317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ed556-62d1-41f0-acc6-3fc2d7bf5583 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:55.077879 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-456ed556-62d1-41f0-acc6-3fc2d7bf5583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:55.093354 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ed556-62d1-41f0-acc6-3fc2d7bf5583 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:55.117077 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3d63d-d34c-46a5-bc9a-c8f0832ae1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:55.118006 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3d63d-d34c-46a5-bc9a-c8f0832ae1f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:55.118294 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3d63d-d34c-46a5-bc9a-c8f0832ae1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:55.118599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3d63d-d34c-46a5-bc9a-c8f0832ae1f6 admin admin] PATH_INFO: `/v3/projects/0d140d1b765c425cb11640093d98fb55/users/70aac314b01b45c198b61daeab9e5d9d/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:55.125467 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3d63d-d34c-46a5-bc9a-c8f0832ae1f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d140d1b765c425cb11640093d98fb55, user_id=70aac314b01b45c198b61daeab9e5d9d, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:55.129416 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3d63d-d34c-46a5-bc9a-c8f0832ae1f6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:55.148944 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 915/1833] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:55 2022] PUT /identity/v3/projects/0d140d1b765c425cb11640093d98fb55/users/70aac314b01b45c198b61daeab9e5d9d/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:55.160708 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b75ff-d9ba-4254-80e5-39e14eeff77d None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:55.161027 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b75ff-d9ba-4254-80e5-39e14eeff77d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:55.161362 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b75ff-d9ba-4254-80e5-39e14eeff77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:55.195537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3d63d-d34c-46a5-bc9a-c8f0832ae1f6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:55.197877 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c4d3d63d-d34c-46a5-bc9a-c8f0832ae1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:55.213509 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-611b75ff-d9ba-4254-80e5-39e14eeff77d None None] MFA Rules not processed for user `70aac314b01b45c198b61daeab9e5d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:55.215547 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-611b75ff-d9ba-4254-80e5-39e14eeff77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:55.293578 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3d63d-d34c-46a5-bc9a-c8f0832ae1f6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:55.300823 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b537414-1bdd-4041-aa65-50e066f00b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:55.302192 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b537414-1bdd-4041-aa65-50e066f00b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:55.302585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b537414-1bdd-4041-aa65-50e066f00b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:55.302958 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b537414-1bdd-4041-aa65-50e066f00b92 admin admin] PATH_INFO: `/v3/projects/153bedffeef8478398c052c599837ea5` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:55.305012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b537414-1bdd-4041-aa65-50e066f00b92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=153bedffeef8478398c052c599837ea5)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:55.310029 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b537414-1bdd-4041-aa65-50e066f00b92 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:55.337875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 919/1834] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:55 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:55.347321 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b75ff-d9ba-4254-80e5-39e14eeff77d None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:55.349256 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-611b75ff-d9ba-4254-80e5-39e14eeff77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:55.383269 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5b537414-1bdd-4041-aa65-50e066f00b92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '153bedffeef8478398c052c599837ea5', 'request_id': 'req-5b537414-1bdd-4041-aa65-50e066f00b92'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:55.386382 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:55.394365 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5b537414-1bdd-4041-aa65-50e066f00b92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '153bedffeef8478398c052c599837ea5', 'request_id': 'req-5b537414-1bdd-4041-aa65-50e066f00b92'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:55.402868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:55.427638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5b537414-1bdd-4041-aa65-50e066f00b92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '153bedffeef8478398c052c599837ea5', 'request_id': 'req-5b537414-1bdd-4041-aa65-50e066f00b92'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:55.457045 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5b537414-1bdd-4041-aa65-50e066f00b92 admin admin] The token cache is being invalidate because project 153bedffeef8478398c052c599837ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:33:55.457624 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5b537414-1bdd-4041-aa65-50e066f00b92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:55.459226 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5b537414-1bdd-4041-aa65-50e066f00b92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:55.460528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b75ff-d9ba-4254-80e5-39e14eeff77d None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:55.461739 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 916/1835] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:33:55 2022] DELETE /identity/v3/projects/153bedffeef8478398c052c599837ea5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:55.463210 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b537414-1bdd-4041-aa65-50e066f00b92 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:55.465592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5b537414-1bdd-4041-aa65-50e066f00b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:55.532460 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531ef69-2e07-4fc1-983f-fb1e5a29f2ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:55.533368 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531ef69-2e07-4fc1-983f-fb1e5a29f2ab service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:55.533749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531ef69-2e07-4fc1-983f-fb1e5a29f2ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:55.534397 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531ef69-2e07-4fc1-983f-fb1e5a29f2ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:55.536013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-9531ef69-2e07-4fc1-983f-fb1e5a29f2ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:55.556362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b537414-1bdd-4041-aa65-50e066f00b92 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:55.561969 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e9a4f-d03a-4dc9-a914-639a5eebbe03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:55.563041 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e9a4f-d03a-4dc9-a914-639a5eebbe03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:55.563328 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e9a4f-d03a-4dc9-a914-639a5eebbe03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:55.563606 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e9a4f-d03a-4dc9-a914-639a5eebbe03 admin admin] PATH_INFO: `/v3/projects/7945ddbc783e4c84aac8ca8923147690` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:55.565852 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e9a4f-d03a-4dc9-a914-639a5eebbe03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7945ddbc783e4c84aac8ca8923147690)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:55.568458 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e9a4f-d03a-4dc9-a914-639a5eebbe03 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:55.624638 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531ef69-2e07-4fc1-983f-fb1e5a29f2ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:55.630929 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531ef69-2e07-4fc1-983f-fb1e5a29f2ab service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:55.638119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0f4e9a4f-d03a-4dc9-a914-639a5eebbe03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7945ddbc783e4c84aac8ca8923147690', 'request_id': 'req-0f4e9a4f-d03a-4dc9-a914-639a5eebbe03'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:55.644473 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 920/1836] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:55 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:55.645264 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531ef69-2e07-4fc1-983f-fb1e5a29f2ab service cinder] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:55.645543 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0f4e9a4f-d03a-4dc9-a914-639a5eebbe03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7945ddbc783e4c84aac8ca8923147690', 'request_id': 'req-0f4e9a4f-d03a-4dc9-a914-639a5eebbe03'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:55.646840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-9531ef69-2e07-4fc1-983f-fb1e5a29f2ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:55.652166 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0f4e9a4f-d03a-4dc9-a914-639a5eebbe03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7945ddbc783e4c84aac8ca8923147690', 'request_id': 'req-0f4e9a4f-d03a-4dc9-a914-639a5eebbe03'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:55.662106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531ef69-2e07-4fc1-983f-fb1e5a29f2ab service cinder] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:55.668178 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0f4e9a4f-d03a-4dc9-a914-639a5eebbe03 admin admin] The token cache is being invalidate because project 7945ddbc783e4c84aac8ca8923147690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:33:55.668605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0f4e9a4f-d03a-4dc9-a914-639a5eebbe03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:55.669823 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0f4e9a4f-d03a-4dc9-a914-639a5eebbe03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:55.671994 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 917/1837] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:33:55 2022] DELETE /identity/v3/projects/7945ddbc783e4c84aac8ca8923147690 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:55.677877 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dd704-ed01-414a-8487-00f19bbaed9d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:55.678173 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dd704-ed01-414a-8487-00f19bbaed9d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:55.678664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dd704-ed01-414a-8487-00f19bbaed9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:55.704746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-774dd704-ed01-414a-8487-00f19bbaed9d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:55.706668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-774dd704-ed01-414a-8487-00f19bbaed9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:55.738347 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0639966-aaa8-4148-8c37-cbfa4961d161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:55.739397 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0639966-aaa8-4148-8c37-cbfa4961d161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:55.739837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0639966-aaa8-4148-8c37-cbfa4961d161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:55.740128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0639966-aaa8-4148-8c37-cbfa4961d161 admin admin] PATH_INFO: `/v3/users/33c1640ad5024a57a71b55819f72b18d` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:55.741334 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0639966-aaa8-4148-8c37-cbfa4961d161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33c1640ad5024a57a71b55819f72b18d)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:55.743292 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0639966-aaa8-4148-8c37-cbfa4961d161 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:55.772983 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 918/1838] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:55.773825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774dd704-ed01-414a-8487-00f19bbaed9d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:55.775218 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-774dd704-ed01-414a-8487-00f19bbaed9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:55.789419 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:55.799152 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:55.807616 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d0639966-aaa8-4148-8c37-cbfa4961d161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33c1640ad5024a57a71b55819f72b18d'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:55.814783 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d0639966-aaa8-4148-8c37-cbfa4961d161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33c1640ad5024a57a71b55819f72b18d'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:55.827885 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d0639966-aaa8-4148-8c37-cbfa4961d161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33c1640ad5024a57a71b55819f72b18d'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:55.835002 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d0639966-aaa8-4148-8c37-cbfa4961d161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33c1640ad5024a57a71b55819f72b18d'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:55.835777 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d0639966-aaa8-4148-8c37-cbfa4961d161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33c1640ad5024a57a71b55819f72b18d'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:55.839173 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774dd704-ed01-414a-8487-00f19bbaed9d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:55.842583 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 921/1839] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:33:55 2022] DELETE /identity/v3/users/33c1640ad5024a57a71b55819f72b18d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:55.842974 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110810f-0f51-4bfb-b9c9-3d575d22c3b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:55.843703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110810f-0f51-4bfb-b9c9-3d575d22c3b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:55.843865 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1b02e-aced-4f60-9eca-100a38051cd2 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:55.844015 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110810f-0f51-4bfb-b9c9-3d575d22c3b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:55.844158 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1b02e-aced-4f60-9eca-100a38051cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:55.844301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110810f-0f51-4bfb-b9c9-3d575d22c3b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:55.844398 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1b02e-aced-4f60-9eca-100a38051cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:55.846200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2110810f-0f51-4bfb-b9c9-3d575d22c3b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:55.864264 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-d6d1b02e-aced-4f60-9eca-100a38051cd2 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:55.865503 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-d6d1b02e-aced-4f60-9eca-100a38051cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:55.914121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110810f-0f51-4bfb-b9c9-3d575d22c3b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:55.916275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110810f-0f51-4bfb-b9c9-3d575d22c3b9 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:55.931216 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 919/1840] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:55.957909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 922/1841] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:55.962343 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110810f-0f51-4bfb-b9c9-3d575d22c3b9 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:55.985765 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110810f-0f51-4bfb-b9c9-3d575d22c3b9 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:56.000809 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5cb8e-1556-4abf-bb7d-95619fea3f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:56.001790 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5cb8e-1556-4abf-bb7d-95619fea3f7b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:56.002978 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5cb8e-1556-4abf-bb7d-95619fea3f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:56.003590 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5cb8e-1556-4abf-bb7d-95619fea3f7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:56.007075 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e5cb8e-1556-4abf-bb7d-95619fea3f7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:56.008389 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e5cb8e-1556-4abf-bb7d-95619fea3f7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:56.015286 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e5cb8e-1556-4abf-bb7d-95619fea3f7b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:56.042523 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1b02e-aced-4f60-9eca-100a38051cd2 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:56.048589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 920/1842] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:33:56.054026 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1b02e-aced-4f60-9eca-100a38051cd2 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:56.061302 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721612c0-336b-44dc-a0ac-11873ed465a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:56.062468 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721612c0-336b-44dc-a0ac-11873ed465a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:56.063310 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721612c0-336b-44dc-a0ac-11873ed465a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:56.064501 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721612c0-336b-44dc-a0ac-11873ed465a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:56.065465 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721612c0-336b-44dc-a0ac-11873ed465a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:56.067703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721612c0-336b-44dc-a0ac-11873ed465a1 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:56.119874 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5cb8e-1556-4abf-bb7d-95619fea3f7b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:56.126767 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 923/1843] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:56 2022] POST /identity/v3/projects => generated 363 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:56.133521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5cb8e-1556-4abf-bb7d-95619fea3f7b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:56.270263 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3762b01-b9d3-4c8a-bb8e-364c44bc4903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:56.270974 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3762b01-b9d3-4c8a-bb8e-364c44bc4903 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:56.271263 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3762b01-b9d3-4c8a-bb8e-364c44bc4903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:56.271536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3762b01-b9d3-4c8a-bb8e-364c44bc4903 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:56.272513 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3762b01-b9d3-4c8a-bb8e-364c44bc4903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:56.274167 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3762b01-b9d3-4c8a-bb8e-364c44bc4903 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:56.301158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 921/1844] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:56 2022] POST /identity/v3/users => generated 282 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:56.305068 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721612c0-336b-44dc-a0ac-11873ed465a1 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:56.318116 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721612c0-336b-44dc-a0ac-11873ed465a1 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:56.324301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374da8b-7269-4578-8130-84f022a8a77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:56.325006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374da8b-7269-4578-8130-84f022a8a77f admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:56.325302 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374da8b-7269-4578-8130-84f022a8a77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:56.325585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374da8b-7269-4578-8130-84f022a8a77f admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:56.326391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374da8b-7269-4578-8130-84f022a8a77f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:56.328219 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374da8b-7269-4578-8130-84f022a8a77f admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:56.345696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 924/1845] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:56.347282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3762b01-b9d3-4c8a-bb8e-364c44bc4903 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:56.362757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3762b01-b9d3-4c8a-bb8e-364c44bc4903 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:56.370856 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba4d24-2ccc-4a05-b603-5244acba46b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:56.371833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba4d24-2ccc-4a05-b603-5244acba46b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:56.372262 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba4d24-2ccc-4a05-b603-5244acba46b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:56.372635 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba4d24-2ccc-4a05-b603-5244acba46b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:56.373549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba4d24-2ccc-4a05-b603-5244acba46b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:56.386536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba4d24-2ccc-4a05-b603-5244acba46b0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:56.407996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 922/1846] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:33:56.411992 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374da8b-7269-4578-8130-84f022a8a77f admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:56.423836 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374da8b-7269-4578-8130-84f022a8a77f admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:56.437277 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f7927-6d80-4839-80ab-dbab603bd8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:56.439181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f7927-6d80-4839-80ab-dbab603bd8e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:56.439542 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f7927-6d80-4839-80ab-dbab603bd8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:56.439826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f7927-6d80-4839-80ab-dbab603bd8e4 admin admin] PATH_INFO: `/v3/projects/04fadd09f3da47f4bfec53f32abce207/users/08f625caa0c742e9a877a1255b201712/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:56.486269 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f7927-6d80-4839-80ab-dbab603bd8e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04fadd09f3da47f4bfec53f32abce207, user_id=08f625caa0c742e9a877a1255b201712, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:56.495331 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f7927-6d80-4839-80ab-dbab603bd8e4 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:56.526010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 925/1847] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:56 2022] PUT /identity/v3/projects/04fadd09f3da47f4bfec53f32abce207/users/08f625caa0c742e9a877a1255b201712/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:33:56.536786 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79465c-7f86-419e-a8b9-f0e3d829f5f2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:56.537094 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79465c-7f86-419e-a8b9-f0e3d829f5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:56.537380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79465c-7f86-419e-a8b9-f0e3d829f5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:56.578240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7f79465c-7f86-419e-a8b9-f0e3d829f5f2 None None] MFA Rules not processed for user `08f625caa0c742e9a877a1255b201712`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:56.579699 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7f79465c-7f86-419e-a8b9-f0e3d829f5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:56.605413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f7927-6d80-4839-80ab-dbab603bd8e4 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:56.607121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:56.607672 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-d72f7927-6d80-4839-80ab-dbab603bd8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:56.665940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 923/1848] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:56 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:56.670737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79465c-7f86-419e-a8b9-f0e3d829f5f2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:56.686429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f7927-6d80-4839-80ab-dbab603bd8e4 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:56.691439 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24231b-0e57-45c6-b859-00901db1a978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:56.692300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24231b-0e57-45c6-b859-00901db1a978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:56.692585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24231b-0e57-45c6-b859-00901db1a978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:56.692858 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24231b-0e57-45c6-b859-00901db1a978 admin admin] PATH_INFO: `/v3/projects/0c9bcc0098be48adabf1d919ce9ed2e5` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:56.694369 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24231b-0e57-45c6-b859-00901db1a978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c9bcc0098be48adabf1d919ce9ed2e5)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:56.696382 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24231b-0e57-45c6-b859-00901db1a978 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:56.698107 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:56.740609 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79465c-7f86-419e-a8b9-f0e3d829f5f2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:56.757859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-2b24231b-0e57-45c6-b859-00901db1a978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c9bcc0098be48adabf1d919ce9ed2e5', 'request_id': 'req-2b24231b-0e57-45c6-b859-00901db1a978'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:56.766553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-2b24231b-0e57-45c6-b859-00901db1a978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c9bcc0098be48adabf1d919ce9ed2e5', 'request_id': 'req-2b24231b-0e57-45c6-b859-00901db1a978'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:56.788744 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-2b24231b-0e57-45c6-b859-00901db1a978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c9bcc0098be48adabf1d919ce9ed2e5', 'request_id': 'req-2b24231b-0e57-45c6-b859-00901db1a978'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:56.805927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-2b24231b-0e57-45c6-b859-00901db1a978 admin admin] The token cache is being invalidate because project 0c9bcc0098be48adabf1d919ce9ed2e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:33:56.806240 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-2b24231b-0e57-45c6-b859-00901db1a978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:56.811449 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-2b24231b-0e57-45c6-b859-00901db1a978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:56.813440 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 926/1849] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:33:56 2022] DELETE /identity/v3/projects/0c9bcc0098be48adabf1d919ce9ed2e5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:56.818811 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d738667-689f-4297-aa33-20641e9430e6 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:56.819057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d738667-689f-4297-aa33-20641e9430e6 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:56.819351 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d738667-689f-4297-aa33-20641e9430e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:56.823494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa87fc8-8569-4cd8-ad76-0d1efef8c2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:56.824884 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa87fc8-8569-4cd8-ad76-0d1efef8c2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:56.825424 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa87fc8-8569-4cd8-ad76-0d1efef8c2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:56.825945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa87fc8-8569-4cd8-ad76-0d1efef8c2a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:56.827367 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa87fc8-8569-4cd8-ad76-0d1efef8c2a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:56.831460 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa87fc8-8569-4cd8-ad76-0d1efef8c2a7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:56.841994 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-1d738667-689f-4297-aa33-20641e9430e6 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:56.843634 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-1d738667-689f-4297-aa33-20641e9430e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:56.861412 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 927/1850] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:56.861412 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504adf83-ef23-4470-baf2-3ce8be8789a2 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:56.861412 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504adf83-ef23-4470-baf2-3ce8be8789a2 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:56.861412 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504adf83-ef23-4470-baf2-3ce8be8789a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:56.882282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 924/1851] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:56 2022] POST /identity/v3/projects => generated 363 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:33:56.882405 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-504adf83-ef23-4470-baf2-3ce8be8789a2 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:56.883637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-504adf83-ef23-4470-baf2-3ce8be8789a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:56.887228 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa87fc8-8569-4cd8-ad76-0d1efef8c2a7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:56.888926 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7aa87fc8-8569-4cd8-ad76-0d1efef8c2a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:56.951456 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:56.958970 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 928/1852] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:56.963668 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504adf83-ef23-4470-baf2-3ce8be8789a2 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:56.969988 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa87fc8-8569-4cd8-ad76-0d1efef8c2a7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:56.972686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504adf83-ef23-4470-baf2-3ce8be8789a2 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:56.975198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d803a2c-8a85-4eff-ba68-f37563393850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:56.975974 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d803a2c-8a85-4eff-ba68-f37563393850 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:56.976330 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d803a2c-8a85-4eff-ba68-f37563393850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:56.976617 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d803a2c-8a85-4eff-ba68-f37563393850 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:56.977253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acd6aa-533e-460f-a275-32e57acf6cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:56.977382 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d803a2c-8a85-4eff-ba68-f37563393850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:56.977894 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acd6aa-533e-460f-a275-32e57acf6cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:56.978184 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acd6aa-533e-460f-a275-32e57acf6cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:56.978463 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acd6aa-533e-460f-a275-32e57acf6cf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:56.979820 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acd6aa-533e-460f-a275-32e57acf6cf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:33:56.979928 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d803a2c-8a85-4eff-ba68-f37563393850 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:56.980136 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acd6aa-533e-460f-a275-32e57acf6cf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:56.981719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acd6aa-533e-460f-a275-32e57acf6cf9 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:56.994318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 929/1853] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:33:56.998712 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acd6aa-533e-460f-a275-32e57acf6cf9 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:57.005190 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 925/1854] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:56 2022] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:57.006251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d803a2c-8a85-4eff-ba68-f37563393850 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:57.009150 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acd6aa-533e-460f-a275-32e57acf6cf9 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:57.014415 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5555b8-b119-4ce7-960f-591e85166c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:57.015121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5555b8-b119-4ce7-960f-591e85166c41 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:57.015413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5555b8-b119-4ce7-960f-591e85166c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:57.015696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5555b8-b119-4ce7-960f-591e85166c41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:57.016430 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5555b8-b119-4ce7-960f-591e85166c41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:57.018392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5555b8-b119-4ce7-960f-591e85166c41 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:57.019595 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d803a2c-8a85-4eff-ba68-f37563393850 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:57.024790 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e255de-3e8f-452c-8fc3-6282811d84d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:57.026178 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e255de-3e8f-452c-8fc3-6282811d84d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:57.026467 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e255de-3e8f-452c-8fc3-6282811d84d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:57.026779 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e255de-3e8f-452c-8fc3-6282811d84d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:57.027517 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e255de-3e8f-452c-8fc3-6282811d84d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:57.029150 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e255de-3e8f-452c-8fc3-6282811d84d6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:57.044221 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 926/1855] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:57.048107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e255de-3e8f-452c-8fc3-6282811d84d6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:57.051570 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 930/1856] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:56 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:33:57.052589 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5555b8-b119-4ce7-960f-591e85166c41 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:57.058657 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e255de-3e8f-452c-8fc3-6282811d84d6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:57.107536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:57.125321 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5555b8-b119-4ce7-960f-591e85166c41 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:57.127942 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fefd7-597f-4151-94fb-c85d87f6c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:57.128847 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fefd7-597f-4151-94fb-c85d87f6c58f admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:57.129137 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fefd7-597f-4151-94fb-c85d87f6c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:57.129447 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fefd7-597f-4151-94fb-c85d87f6c58f admin admin] PATH_INFO: `/v3/projects/8d14051da6c34da3876ce80238cfd7b9/users/05eb21fa0b0747659a335bb7a29d5b78/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:57.130873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48ab82-5ede-4083-abfd-bdbeb5052c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:57.131676 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48ab82-5ede-4083-abfd-bdbeb5052c04 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:57.131969 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48ab82-5ede-4083-abfd-bdbeb5052c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:57.132564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48ab82-5ede-4083-abfd-bdbeb5052c04 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:57.133260 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48ab82-5ede-4083-abfd-bdbeb5052c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:57.136451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48ab82-5ede-4083-abfd-bdbeb5052c04 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:57.146474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fefd7-597f-4151-94fb-c85d87f6c58f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d14051da6c34da3876ce80238cfd7b9, user_id=05eb21fa0b0747659a335bb7a29d5b78, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:57.149799 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fefd7-597f-4151-94fb-c85d87f6c58f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:57.159880 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 931/1857] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:57 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:33:57.160916 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48ab82-5ede-4083-abfd-bdbeb5052c04 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:57.166978 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 927/1858] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:57 2022] PUT /identity/v3/projects/8d14051da6c34da3876ce80238cfd7b9/users/05eb21fa0b0747659a335bb7a29d5b78/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:33:57.170519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fefd7-597f-4151-94fb-c85d87f6c58f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:57.170990 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48ab82-5ede-4083-abfd-bdbeb5052c04 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:57.233647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fefd7-597f-4151-94fb-c85d87f6c58f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:57.239045 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8712222-22e8-4930-9995-bd9170563ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:57.239624 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59192f-6877-4904-a679-57742fa293e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:57.240003 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8712222-22e8-4930-9995-bd9170563ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:57.240297 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59192f-6877-4904-a679-57742fa293e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:57.240389 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8712222-22e8-4930-9995-bd9170563ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:57.240587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59192f-6877-4904-a679-57742fa293e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:57.240676 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8712222-22e8-4930-9995-bd9170563ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:57.240870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59192f-6877-4904-a679-57742fa293e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:57.241418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8712222-22e8-4930-9995-bd9170563ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:57.241625 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59192f-6877-4904-a679-57742fa293e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:57.243047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8712222-22e8-4930-9995-bd9170563ef9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:57.243314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59192f-6877-4904-a679-57742fa293e8 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:57.253179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 932/1859] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:33:57.253835 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 928/1860] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:33:57.257758 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8712222-22e8-4930-9995-bd9170563ef9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:57.257891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59192f-6877-4904-a679-57742fa293e8 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:57.268212 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8712222-22e8-4930-9995-bd9170563ef9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:57.269459 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59192f-6877-4904-a679-57742fa293e8 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:57.272998 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b979f10-6332-452f-9ac4-4a0693a8914f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:57.273964 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b979f10-6332-452f-9ac4-4a0693a8914f admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:57.274162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27b992-5d35-41e8-a664-fac9cfb6bb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:57.274291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b979f10-6332-452f-9ac4-4a0693a8914f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:57.274533 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b979f10-6332-452f-9ac4-4a0693a8914f admin admin] PATH_INFO: `/v3/projects/8d14051da6c34da3876ce80238cfd7b9/users/05eb21fa0b0747659a335bb7a29d5b78/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:57.274855 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27b992-5d35-41e8-a664-fac9cfb6bb03 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:57.275144 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27b992-5d35-41e8-a664-fac9cfb6bb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:57.275455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27b992-5d35-41e8-a664-fac9cfb6bb03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:57.276734 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27b992-5d35-41e8-a664-fac9cfb6bb03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:57.277358 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b979f10-6332-452f-9ac4-4a0693a8914f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d14051da6c34da3876ce80238cfd7b9, user_id=05eb21fa0b0747659a335bb7a29d5b78, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:57.278453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27b992-5d35-41e8-a664-fac9cfb6bb03 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:57.280171 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b979f10-6332-452f-9ac4-4a0693a8914f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:57.289255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 933/1861] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:57.293147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27b992-5d35-41e8-a664-fac9cfb6bb03 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:57.294483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 929/1862] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:57 2022] PUT /identity/v3/projects/8d14051da6c34da3876ce80238cfd7b9/users/05eb21fa0b0747659a335bb7a29d5b78/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:57.309039 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c47c0d-8e31-418e-ad83-9041e6f96107 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:57.310192 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c47c0d-8e31-418e-ad83-9041e6f96107 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:57.310549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c47c0d-8e31-418e-ad83-9041e6f96107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:57.312742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27b992-5d35-41e8-a664-fac9cfb6bb03 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:57.341908 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-54c47c0d-8e31-418e-ad83-9041e6f96107 None None] MFA Rules not processed for user `05eb21fa0b0747659a335bb7a29d5b78`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:57.343197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-54c47c0d-8e31-418e-ad83-9041e6f96107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:57.374232 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:57.377420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8f9f4-21c9-4b92-96a1-0f4bf317a8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:57.378354 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8f9f4-21c9-4b92-96a1-0f4bf317a8a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:57.378686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8f9f4-21c9-4b92-96a1-0f4bf317a8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:57.379029 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8f9f4-21c9-4b92-96a1-0f4bf317a8a7 admin admin] PATH_INFO: `/v3/projects/07ad18d7f356412489809226726b1869/users/daaef5c2d65c4b3ca8d4a29ac99f8d0e/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:57.395771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8f9f4-21c9-4b92-96a1-0f4bf317a8a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ad18d7f356412489809226726b1869, user_id=daaef5c2d65c4b3ca8d4a29ac99f8d0e, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:57.398492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8f9f4-21c9-4b92-96a1-0f4bf317a8a7 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:57.422770 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 934/1863] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:57 2022] PUT /identity/v3/projects/07ad18d7f356412489809226726b1869/users/daaef5c2d65c4b3ca8d4a29ac99f8d0e/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:33:57.428477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8dfc8-8fca-492a-8d6a-9bce63bd6f59 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:57.429033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8dfc8-8fca-492a-8d6a-9bce63bd6f59 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:57.429387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8dfc8-8fca-492a-8d6a-9bce63bd6f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:57.452639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 930/1864] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:57 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:57.462186 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c47c0d-8e31-418e-ad83-9041e6f96107 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:57.464767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-54c47c0d-8e31-418e-ad83-9041e6f96107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:57.467696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-24e8dfc8-8fca-492a-8d6a-9bce63bd6f59 None None] MFA Rules not processed for user `daaef5c2d65c4b3ca8d4a29ac99f8d0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:57.469029 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-24e8dfc8-8fca-492a-8d6a-9bce63bd6f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:57.541146 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:57.571132 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c47c0d-8e31-418e-ad83-9041e6f96107 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:57.597805 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 935/1865] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:57.603181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8dfc8-8fca-492a-8d6a-9bce63bd6f59 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:57.678393 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52c4a2-d9bb-495f-8d6c-49c5e5213d23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:57.679222 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52c4a2-d9bb-495f-8d6c-49c5e5213d23 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:57.679637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52c4a2-d9bb-495f-8d6c-49c5e5213d23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:57.679920 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52c4a2-d9bb-495f-8d6c-49c5e5213d23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:57.761702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8dfc8-8fca-492a-8d6a-9bce63bd6f59 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:57.767493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050c753-34a8-4a0d-bade-e9b2a4237ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:57.768486 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050c753-34a8-4a0d-bade-e9b2a4237ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:57.768963 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050c753-34a8-4a0d-bade-e9b2a4237ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:57.769430 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050c753-34a8-4a0d-bade-e9b2a4237ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:57.770619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050c753-34a8-4a0d-bade-e9b2a4237ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:57.772791 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050c753-34a8-4a0d-bade-e9b2a4237ee8 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:57.775924 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52c4a2-d9bb-495f-8d6c-49c5e5213d23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:57.778257 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52c4a2-d9bb-495f-8d6c-49c5e5213d23 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:57.796508 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 931/1866] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:57 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:57.817282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52c4a2-d9bb-495f-8d6c-49c5e5213d23 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:57.818780 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 936/1867] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:33:57 2022] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:33:57.833768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52c4a2-d9bb-495f-8d6c-49c5e5213d23 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:57.897233 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:57.958124 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48501005-ff62-4df2-9e89-205a423e5966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:57.959340 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48501005-ff62-4df2-9e89-205a423e5966 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:57.959896 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48501005-ff62-4df2-9e89-205a423e5966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:57.960299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48501005-ff62-4df2-9e89-205a423e5966 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:57.961974 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48501005-ff62-4df2-9e89-205a423e5966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:57.964481 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48501005-ff62-4df2-9e89-205a423e5966 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:57.996332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 932/1868] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:33:57 2022] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:33:58.000347 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050c753-34a8-4a0d-bade-e9b2a4237ee8 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:58.015768 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050c753-34a8-4a0d-bade-e9b2a4237ee8 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:58.030245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f75f0-2337-4d43-9f8a-6ac384aa5183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:58.031152 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f75f0-2337-4d43-9f8a-6ac384aa5183 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:58.032703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f75f0-2337-4d43-9f8a-6ac384aa5183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:58.034434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f75f0-2337-4d43-9f8a-6ac384aa5183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:58.035462 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f75f0-2337-4d43-9f8a-6ac384aa5183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:58.051519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f75f0-2337-4d43-9f8a-6ac384aa5183 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:58.089002 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 937/1869] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:58.092008 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48501005-ff62-4df2-9e89-205a423e5966 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:58.105339 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48501005-ff62-4df2-9e89-205a423e5966 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:58.125449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4747b-2117-49e4-b7cd-a2e5d0277486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:58.126405 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4747b-2117-49e4-b7cd-a2e5d0277486 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:58.126752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4747b-2117-49e4-b7cd-a2e5d0277486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:58.127091 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4747b-2117-49e4-b7cd-a2e5d0277486 admin admin] PATH_INFO: `/v3/projects/a59c6c8e67ba42e9986269b2282dc8b7/users/7d47cf8d64af490ab2a001aa4c11a7a4/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:58.166637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4747b-2117-49e4-b7cd-a2e5d0277486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a59c6c8e67ba42e9986269b2282dc8b7, user_id=7d47cf8d64af490ab2a001aa4c11a7a4, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:58.170099 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4747b-2117-49e4-b7cd-a2e5d0277486 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:58.199292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 933/1870] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:58 2022] PUT /identity/v3/projects/a59c6c8e67ba42e9986269b2282dc8b7/users/7d47cf8d64af490ab2a001aa4c11a7a4/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:58.202959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f75f0-2337-4d43-9f8a-6ac384aa5183 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:58.214200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f75f0-2337-4d43-9f8a-6ac384aa5183 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:58.318863 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f6db4-9477-4ec5-ad71-da196622ba19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:58.319824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f6db4-9477-4ec5-ad71-da196622ba19 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:58.320276 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f6db4-9477-4ec5-ad71-da196622ba19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:58.320659 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f6db4-9477-4ec5-ad71-da196622ba19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:58.321463 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f6db4-9477-4ec5-ad71-da196622ba19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:58.324427 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f6db4-9477-4ec5-ad71-da196622ba19 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:58.339218 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 938/1871] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:33:58.340408 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4747b-2117-49e4-b7cd-a2e5d0277486 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:58.353949 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4747b-2117-49e4-b7cd-a2e5d0277486 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:58.366264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03fd819-a96c-441d-9c69-220caf87c5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:58.366264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fd819-a96c-441d-9c69-220caf87c5b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:58.366264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fd819-a96c-441d-9c69-220caf87c5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:58.366264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fd819-a96c-441d-9c69-220caf87c5b3 admin admin] PATH_INFO: `/v3/projects/a59c6c8e67ba42e9986269b2282dc8b7/users/7d47cf8d64af490ab2a001aa4c11a7a4/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:58.368246 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03fd819-a96c-441d-9c69-220caf87c5b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a59c6c8e67ba42e9986269b2282dc8b7, user_id=7d47cf8d64af490ab2a001aa4c11a7a4, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:58.373962 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03fd819-a96c-441d-9c69-220caf87c5b3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:58.383208 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 934/1872] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:33:58 2022] PUT /identity/v3/projects/a59c6c8e67ba42e9986269b2282dc8b7/users/7d47cf8d64af490ab2a001aa4c11a7a4/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:58.395156 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dd1d1-b84b-4a4e-a391-79b3b47b3233 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:58.395535 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dd1d1-b84b-4a4e-a391-79b3b47b3233 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:58.395888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dd1d1-b84b-4a4e-a391-79b3b47b3233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:58.425113 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-767dd1d1-b84b-4a4e-a391-79b3b47b3233 None None] MFA Rules not processed for user `7d47cf8d64af490ab2a001aa4c11a7a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:58.426690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-767dd1d1-b84b-4a4e-a391-79b3b47b3233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:58.464344 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:58.503580 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 939/1873] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:33:58.515856 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03fd819-a96c-441d-9c69-220caf87c5b3 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:58.532271 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767dd1d1-b84b-4a4e-a391-79b3b47b3233 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:58.576993 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03fd819-a96c-441d-9c69-220caf87c5b3 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:58.581085 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8bf4e-3bf1-4aad-a96f-c33f0015aa96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:58.581914 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8bf4e-3bf1-4aad-a96f-c33f0015aa96 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:58.582271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8bf4e-3bf1-4aad-a96f-c33f0015aa96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:58.582720 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8bf4e-3bf1-4aad-a96f-c33f0015aa96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:58.592583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8bf4e-3bf1-4aad-a96f-c33f0015aa96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:58.594030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8bf4e-3bf1-4aad-a96f-c33f0015aa96 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:58.596749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767dd1d1-b84b-4a4e-a391-79b3b47b3233 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:58.601404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d6161-10be-45b8-8362-49baa03e3b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:58.602302 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d6161-10be-45b8-8362-49baa03e3b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:58.602624 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d6161-10be-45b8-8362-49baa03e3b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:58.602904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d6161-10be-45b8-8362-49baa03e3b41 admin admin] PATH_INFO: `/v3/users/08f625caa0c742e9a877a1255b201712` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:58.604030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 935/1874] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:58.606627 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d6161-10be-45b8-8362-49baa03e3b41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08f625caa0c742e9a877a1255b201712)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:58.612998 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d6161-10be-45b8-8362-49baa03e3b41 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:58.676035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-585d6161-10be-45b8-8362-49baa03e3b41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08f625caa0c742e9a877a1255b201712'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:58.683921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-585d6161-10be-45b8-8362-49baa03e3b41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08f625caa0c742e9a877a1255b201712'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:58.697086 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-585d6161-10be-45b8-8362-49baa03e3b41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08f625caa0c742e9a877a1255b201712'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:58.703438 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8bf4e-3bf1-4aad-a96f-c33f0015aa96 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:58.705892 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-585d6161-10be-45b8-8362-49baa03e3b41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08f625caa0c742e9a877a1255b201712'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:58.706695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-585d6161-10be-45b8-8362-49baa03e3b41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08f625caa0c742e9a877a1255b201712'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:58.712350 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8bf4e-3bf1-4aad-a96f-c33f0015aa96 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:58.713725 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 940/1875] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:33:58 2022] DELETE /identity/v3/users/08f625caa0c742e9a877a1255b201712 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:33:58.718534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6a503-a8a3-44a9-b1c1-64b9edf0e9a0 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:58.718534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6a503-a8a3-44a9-b1c1-64b9edf0e9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:58.718759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6a503-a8a3-44a9-b1c1-64b9edf0e9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:58.735452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-69d6a503-a8a3-44a9-b1c1-64b9edf0e9a0 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:58.736710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-69d6a503-a8a3-44a9-b1c1-64b9edf0e9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:58.773866 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a06e3b-fb33-4856-9d58-005b6f79904a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:58.774544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a06e3b-fb33-4856-9d58-005b6f79904a service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:58.774882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a06e3b-fb33-4856-9d58-005b6f79904a service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:58.775166 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a06e3b-fb33-4856-9d58-005b6f79904a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:58.777620 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f7a06e3b-fb33-4856-9d58-005b6f79904a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:58.795242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:58.813151 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 941/1876] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:33:58.825315 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6a503-a8a3-44a9-b1c1-64b9edf0e9a0 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:58.826990 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-69d6a503-a8a3-44a9-b1c1-64b9edf0e9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:58.827261 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:58.857308 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a06e3b-fb33-4856-9d58-005b6f79904a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:58.858965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a06e3b-fb33-4856-9d58-005b6f79904a service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:58.870165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 936/1877] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:33:58.899055 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6a503-a8a3-44a9-b1c1-64b9edf0e9a0 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:58.903876 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db381405-41ae-4e3c-865e-35befa572c8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:58.904750 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db381405-41ae-4e3c-865e-35befa572c8e service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:58.906787 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db381405-41ae-4e3c-865e-35befa572c8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:58.907200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db381405-41ae-4e3c-865e-35befa572c8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:58.920714 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db381405-41ae-4e3c-865e-35befa572c8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:58.922322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db381405-41ae-4e3c-865e-35befa572c8e service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:58.934948 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 942/1878] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:33:59.167195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a06e3b-fb33-4856-9d58-005b6f79904a service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:59.168889 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f7a06e3b-fb33-4856-9d58-005b6f79904a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:59.183982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a06e3b-fb33-4856-9d58-005b6f79904a service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:59.192598 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3f674-12d0-40b6-a0fc-b7a987d0f560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:59.193924 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3f674-12d0-40b6-a0fc-b7a987d0f560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:59.194282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3f674-12d0-40b6-a0fc-b7a987d0f560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:59.194682 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3f674-12d0-40b6-a0fc-b7a987d0f560 admin admin] PATH_INFO: `/v3/users/daaef5c2d65c4b3ca8d4a29ac99f8d0e` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:59.196275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3f674-12d0-40b6-a0fc-b7a987d0f560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daaef5c2d65c4b3ca8d4a29ac99f8d0e)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:59.198959 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3f674-12d0-40b6-a0fc-b7a987d0f560 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:59.265996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0ec3f674-12d0-40b6-a0fc-b7a987d0f560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daaef5c2d65c4b3ca8d4a29ac99f8d0e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:59.278565 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0ec3f674-12d0-40b6-a0fc-b7a987d0f560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daaef5c2d65c4b3ca8d4a29ac99f8d0e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:59.279599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0ec3f674-12d0-40b6-a0fc-b7a987d0f560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daaef5c2d65c4b3ca8d4a29ac99f8d0e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:59.280370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0ec3f674-12d0-40b6-a0fc-b7a987d0f560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daaef5c2d65c4b3ca8d4a29ac99f8d0e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:59.297902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0ec3f674-12d0-40b6-a0fc-b7a987d0f560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daaef5c2d65c4b3ca8d4a29ac99f8d0e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:59.328444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 937/1879] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:33:59 2022] DELETE /identity/v3/users/daaef5c2d65c4b3ca8d4a29ac99f8d0e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:59.333067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab1964-2f76-4945-bf61-5ecd66e49f6b None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:59.333338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab1964-2f76-4945-bf61-5ecd66e49f6b None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:59.333670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab1964-2f76-4945-bf61-5ecd66e49f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:59.367956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-d6ab1964-2f76-4945-bf61-5ecd66e49f6b None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:33:59.370280 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-d6ab1964-2f76-4945-bf61-5ecd66e49f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:59.503623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3f674-12d0-40b6-a0fc-b7a987d0f560 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:59.505839 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0ec3f674-12d0-40b6-a0fc-b7a987d0f560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:59.590211 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 943/1880] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:33:59.600572 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab1964-2f76-4945-bf61-5ecd66e49f6b None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:59.604066 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-d6ab1964-2f76-4945-bf61-5ecd66e49f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:33:59.640367 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3f674-12d0-40b6-a0fc-b7a987d0f560 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:59.645637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8741a35-a6e2-4ba4-b989-f9bd7f295011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:59.646674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8741a35-a6e2-4ba4-b989-f9bd7f295011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:59.647197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8741a35-a6e2-4ba4-b989-f9bd7f295011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:59.647835 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8741a35-a6e2-4ba4-b989-f9bd7f295011 admin admin] PATH_INFO: `/v3/projects/04fadd09f3da47f4bfec53f32abce207` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:59.648902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8741a35-a6e2-4ba4-b989-f9bd7f295011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04fadd09f3da47f4bfec53f32abce207)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:59.651796 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8741a35-a6e2-4ba4-b989-f9bd7f295011 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:59.689776 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab1964-2f76-4945-bf61-5ecd66e49f6b None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:59.696520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce7b25-c83e-472a-99fc-8dfd129aea76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:59.698178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce7b25-c83e-472a-99fc-8dfd129aea76 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:59.698784 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce7b25-c83e-472a-99fc-8dfd129aea76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:59.699124 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce7b25-c83e-472a-99fc-8dfd129aea76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:59.709505 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e8741a35-a6e2-4ba4-b989-f9bd7f295011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04fadd09f3da47f4bfec53f32abce207', 'request_id': 'req-e8741a35-a6e2-4ba4-b989-f9bd7f295011'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:59.712122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:59.713342 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce7b25-c83e-472a-99fc-8dfd129aea76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:59.714912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce7b25-c83e-472a-99fc-8dfd129aea76 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:59.724942 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e8741a35-a6e2-4ba4-b989-f9bd7f295011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04fadd09f3da47f4bfec53f32abce207', 'request_id': 'req-e8741a35-a6e2-4ba4-b989-f9bd7f295011'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:59.725133 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e8741a35-a6e2-4ba4-b989-f9bd7f295011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04fadd09f3da47f4bfec53f32abce207', 'request_id': 'req-e8741a35-a6e2-4ba4-b989-f9bd7f295011'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:59.726585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 944/1881] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:33:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:33:59.741728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e8741a35-a6e2-4ba4-b989-f9bd7f295011 admin admin] The token cache is being invalidate because project 04fadd09f3da47f4bfec53f32abce207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:33:59.742027 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e8741a35-a6e2-4ba4-b989-f9bd7f295011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:59.742852 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e8741a35-a6e2-4ba4-b989-f9bd7f295011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:59.744960 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 938/1882] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:33:59 2022] DELETE /identity/v3/projects/04fadd09f3da47f4bfec53f32abce207 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:33:59.749135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce7b25-c83e-472a-99fc-8dfd129aea76 service neutron] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:33:59.761025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce7b25-c83e-472a-99fc-8dfd129aea76 service neutron] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:33:59.799806 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:33:59.828801 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64121d-4157-4f01-bde5-9e0348d4024f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:33:59.829686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64121d-4157-4f01-bde5-9e0348d4024f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:33:59.829979 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64121d-4157-4f01-bde5-9e0348d4024f admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:33:59.830260 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64121d-4157-4f01-bde5-9e0348d4024f admin admin] PATH_INFO: `/v3/users/05eb21fa0b0747659a335bb7a29d5b78` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:33:59.831507 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64121d-4157-4f01-bde5-9e0348d4024f admin admin] RBAC: Authorizing `identity:delete_user(user_id=05eb21fa0b0747659a335bb7a29d5b78)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:33:59.833454 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64121d-4157-4f01-bde5-9e0348d4024f admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:33:59.895486 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9c64121d-4157-4f01-bde5-9e0348d4024f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05eb21fa0b0747659a335bb7a29d5b78'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:59.904095 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9c64121d-4157-4f01-bde5-9e0348d4024f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05eb21fa0b0747659a335bb7a29d5b78'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:59.918638 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9c64121d-4157-4f01-bde5-9e0348d4024f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05eb21fa0b0747659a335bb7a29d5b78'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:59.927939 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9c64121d-4157-4f01-bde5-9e0348d4024f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05eb21fa0b0747659a335bb7a29d5b78'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:59.928965 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9c64121d-4157-4f01-bde5-9e0348d4024f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05eb21fa0b0747659a335bb7a29d5b78'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:33:59.946537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 945/1883] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:33:59 2022] DELETE /identity/v3/users/05eb21fa0b0747659a335bb7a29d5b78 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:00.091940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8741a35-a6e2-4ba4-b989-f9bd7f295011 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:00.095944 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e8741a35-a6e2-4ba4-b989-f9bd7f295011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:00.138839 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8741a35-a6e2-4ba4-b989-f9bd7f295011 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:00.223838 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc06214-af7c-4e6f-ae50-ff54f6b2b08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:00.224811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc06214-af7c-4e6f-ae50-ff54f6b2b08f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:00.225195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc06214-af7c-4e6f-ae50-ff54f6b2b08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:00.225656 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc06214-af7c-4e6f-ae50-ff54f6b2b08f admin admin] PATH_INFO: `/v3/projects/07ad18d7f356412489809226726b1869` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:00.226897 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc06214-af7c-4e6f-ae50-ff54f6b2b08f admin admin] RBAC: Authorizing `identity:delete_project(project_id=07ad18d7f356412489809226726b1869)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:00.229427 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc06214-af7c-4e6f-ae50-ff54f6b2b08f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:00.279590 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3bc06214-af7c-4e6f-ae50-ff54f6b2b08f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07ad18d7f356412489809226726b1869', 'request_id': 'req-3bc06214-af7c-4e6f-ae50-ff54f6b2b08f'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:00.285856 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3bc06214-af7c-4e6f-ae50-ff54f6b2b08f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07ad18d7f356412489809226726b1869', 'request_id': 'req-3bc06214-af7c-4e6f-ae50-ff54f6b2b08f'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:00.292007 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3bc06214-af7c-4e6f-ae50-ff54f6b2b08f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07ad18d7f356412489809226726b1869', 'request_id': 'req-3bc06214-af7c-4e6f-ae50-ff54f6b2b08f'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:00.305808 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3bc06214-af7c-4e6f-ae50-ff54f6b2b08f admin admin] The token cache is being invalidate because project 07ad18d7f356412489809226726b1869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:00.306227 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3bc06214-af7c-4e6f-ae50-ff54f6b2b08f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:00.307212 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3bc06214-af7c-4e6f-ae50-ff54f6b2b08f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:00.308994 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 939/1884] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:00 2022] DELETE /identity/v3/projects/07ad18d7f356412489809226726b1869 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:00.313352 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64121d-4157-4f01-bde5-9e0348d4024f admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:00.314915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-9c64121d-4157-4f01-bde5-9e0348d4024f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:00.330009 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64121d-4157-4f01-bde5-9e0348d4024f admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:00.350493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc06214-af7c-4e6f-ae50-ff54f6b2b08f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:00.352686 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3bc06214-af7c-4e6f-ae50-ff54f6b2b08f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:00.449819 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee25d6-ad2f-4779-8e5c-9974f80edcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:00.450731 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee25d6-ad2f-4779-8e5c-9974f80edcd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:00.451019 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee25d6-ad2f-4779-8e5c-9974f80edcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:00.451295 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee25d6-ad2f-4779-8e5c-9974f80edcd0 admin admin] PATH_INFO: `/v3/users/7d47cf8d64af490ab2a001aa4c11a7a4` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:00.452500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee25d6-ad2f-4779-8e5c-9974f80edcd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d47cf8d64af490ab2a001aa4c11a7a4)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:00.454456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee25d6-ad2f-4779-8e5c-9974f80edcd0 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:00.457046 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc06214-af7c-4e6f-ae50-ff54f6b2b08f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:00.464358 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ab6c1-be33-421a-bbca-124da969daec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:00.466448 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ab6c1-be33-421a-bbca-124da969daec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:00.466894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ab6c1-be33-421a-bbca-124da969daec admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:00.467268 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ab6c1-be33-421a-bbca-124da969daec admin admin] PATH_INFO: `/v3/projects/8d14051da6c34da3876ce80238cfd7b9` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:00.468597 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ab6c1-be33-421a-bbca-124da969daec admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d14051da6c34da3876ce80238cfd7b9)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:00.470715 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ab6c1-be33-421a-bbca-124da969daec admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:00.484811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:00.533621 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-015ab6c1-be33-421a-bbca-124da969daec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d14051da6c34da3876ce80238cfd7b9', 'request_id': 'req-015ab6c1-be33-421a-bbca-124da969daec'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:00.534220 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-5fee25d6-ad2f-4779-8e5c-9974f80edcd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d47cf8d64af490ab2a001aa4c11a7a4'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:00.540360 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-015ab6c1-be33-421a-bbca-124da969daec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d14051da6c34da3876ce80238cfd7b9', 'request_id': 'req-015ab6c1-be33-421a-bbca-124da969daec'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:00.545888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-5fee25d6-ad2f-4779-8e5c-9974f80edcd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d47cf8d64af490ab2a001aa4c11a7a4'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:00.549116 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-015ab6c1-be33-421a-bbca-124da969daec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d14051da6c34da3876ce80238cfd7b9', 'request_id': 'req-015ab6c1-be33-421a-bbca-124da969daec'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:00.551115 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:00.567015 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-5fee25d6-ad2f-4779-8e5c-9974f80edcd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d47cf8d64af490ab2a001aa4c11a7a4'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:00.573620 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-015ab6c1-be33-421a-bbca-124da969daec admin admin] The token cache is being invalidate because project 8d14051da6c34da3876ce80238cfd7b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:00.573941 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-015ab6c1-be33-421a-bbca-124da969daec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:00.574770 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-015ab6c1-be33-421a-bbca-124da969daec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:00.576739 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 940/1885] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:00 2022] DELETE /identity/v3/projects/8d14051da6c34da3876ce80238cfd7b9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:00.580560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-5fee25d6-ad2f-4779-8e5c-9974f80edcd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d47cf8d64af490ab2a001aa4c11a7a4'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:00.581510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-5fee25d6-ad2f-4779-8e5c-9974f80edcd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d47cf8d64af490ab2a001aa4c11a7a4'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:00.583353 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ac606-a023-4500-861a-9a92b6edfd49 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:00.584175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ac606-a023-4500-861a-9a92b6edfd49 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:00.584667 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ac606-a023-4500-861a-9a92b6edfd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:00.594676 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 946/1886] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:00 2022] DELETE /identity/v3/users/7d47cf8d64af490ab2a001aa4c11a7a4 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:00.608774 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-980ac606-a023-4500-861a-9a92b6edfd49 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:00.611578 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-980ac606-a023-4500-861a-9a92b6edfd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:00.733432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 941/1887] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:34:00.741062 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2d77c-d964-4fb1-bc83-5e2f76d3beef None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:00.741355 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2d77c-d964-4fb1-bc83-5e2f76d3beef None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:00.741647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2d77c-d964-4fb1-bc83-5e2f76d3beef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:00.780434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-edf2d77c-d964-4fb1-bc83-5e2f76d3beef None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:00.781927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-edf2d77c-d964-4fb1-bc83-5e2f76d3beef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:00.793306 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 947/1888] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:00.797503 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ac606-a023-4500-861a-9a92b6edfd49 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:00.822187 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ac606-a023-4500-861a-9a92b6edfd49 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:00.827929 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af41e2-f592-4c21-abaa-5e96ea0b85f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:00.828950 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af41e2-f592-4c21-abaa-5e96ea0b85f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:00.829237 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af41e2-f592-4c21-abaa-5e96ea0b85f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:00.829516 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af41e2-f592-4c21-abaa-5e96ea0b85f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:00.830251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af41e2-f592-4c21-abaa-5e96ea0b85f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:00.830584 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af41e2-f592-4c21-abaa-5e96ea0b85f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:00.833263 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af41e2-f592-4c21-abaa-5e96ea0b85f7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:00.854169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 942/1889] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:00.858672 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2d77c-d964-4fb1-bc83-5e2f76d3beef None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:00.872861 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2d77c-d964-4fb1-bc83-5e2f76d3beef None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:00.878849 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada13881-8535-4dab-90eb-bff948c1d84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:00.879456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada13881-8535-4dab-90eb-bff948c1d84b admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:00.879745 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada13881-8535-4dab-90eb-bff948c1d84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:00.880172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada13881-8535-4dab-90eb-bff948c1d84b admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:00.881819 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada13881-8535-4dab-90eb-bff948c1d84b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:00.884059 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada13881-8535-4dab-90eb-bff948c1d84b admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:00.932991 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af41e2-f592-4c21-abaa-5e96ea0b85f7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:00.942755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 948/1890] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:00 2022] POST /identity/v3/projects => generated 363 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:00.945991 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af41e2-f592-4c21-abaa-5e96ea0b85f7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:00.999097 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada13881-8535-4dab-90eb-bff948c1d84b admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:01.001006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ada13881-8535-4dab-90eb-bff948c1d84b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:01.042037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6210a-000f-4f03-8901-f46184bb7384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:01.042948 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6210a-000f-4f03-8901-f46184bb7384 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.043230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6210a-000f-4f03-8901-f46184bb7384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.043515 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6210a-000f-4f03-8901-f46184bb7384 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.044231 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6210a-000f-4f03-8901-f46184bb7384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:01.046539 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6210a-000f-4f03-8901-f46184bb7384 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:01.072815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 943/1891] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:00 2022] POST /identity/v3/users => generated 282 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:01.076739 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6210a-000f-4f03-8901-f46184bb7384 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:01.087218 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6210a-000f-4f03-8901-f46184bb7384 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:01.092479 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48611aaf-0621-4aa3-9ed3-ea45878b258e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:01.093173 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48611aaf-0621-4aa3-9ed3-ea45878b258e admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.093589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48611aaf-0621-4aa3-9ed3-ea45878b258e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.093886 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48611aaf-0621-4aa3-9ed3-ea45878b258e admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.094662 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48611aaf-0621-4aa3-9ed3-ea45878b258e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:01.096428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48611aaf-0621-4aa3-9ed3-ea45878b258e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:01.107740 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 944/1892] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:01.112220 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48611aaf-0621-4aa3-9ed3-ea45878b258e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:01.120602 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada13881-8535-4dab-90eb-bff948c1d84b admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:01.127586 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b4e00-abcb-46d4-bc03-7412e16066e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:01.128762 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b4e00-abcb-46d4-bc03-7412e16066e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.129308 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b4e00-abcb-46d4-bc03-7412e16066e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.129944 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b4e00-abcb-46d4-bc03-7412e16066e2 admin admin] PATH_INFO: `/v3/users/e67b1124e5024b19889e7275536c7694` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.130856 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48611aaf-0621-4aa3-9ed3-ea45878b258e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:01.132195 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b4e00-abcb-46d4-bc03-7412e16066e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e67b1124e5024b19889e7275536c7694)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:01.134288 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b4e00-abcb-46d4-bc03-7412e16066e2 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:01.135898 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246e33f-1d11-48d4-add7-5ebea72e484b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:01.136623 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246e33f-1d11-48d4-add7-5ebea72e484b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.136924 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246e33f-1d11-48d4-add7-5ebea72e484b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.137206 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246e33f-1d11-48d4-add7-5ebea72e484b admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.139455 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246e33f-1d11-48d4-add7-5ebea72e484b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:01.141221 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246e33f-1d11-48d4-add7-5ebea72e484b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:01.142877 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:01.155869 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 945/1893] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:01.160288 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246e33f-1d11-48d4-add7-5ebea72e484b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:01.175787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246e33f-1d11-48d4-add7-5ebea72e484b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:01.187481 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb511fab-b82c-4d76-a2d0-4fce570902f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:01.189241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb511fab-b82c-4d76-a2d0-4fce570902f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.190479 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb511fab-b82c-4d76-a2d0-4fce570902f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.190807 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb511fab-b82c-4d76-a2d0-4fce570902f7 admin admin] PATH_INFO: `/v3/projects/982b384989a246f8a11dec3f9c0b7c3f/users/da294dbddf6e4d84b33312d2bc39f6a9/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.210324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-363b4e00-abcb-46d4-bc03-7412e16066e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e67b1124e5024b19889e7275536c7694'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:01.213870 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb511fab-b82c-4d76-a2d0-4fce570902f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=982b384989a246f8a11dec3f9c0b7c3f, user_id=da294dbddf6e4d84b33312d2bc39f6a9, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:01.216842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb511fab-b82c-4d76-a2d0-4fce570902f7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:01.223929 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-363b4e00-abcb-46d4-bc03-7412e16066e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e67b1124e5024b19889e7275536c7694'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:01.238159 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 946/1894] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:01 2022] PUT /identity/v3/projects/982b384989a246f8a11dec3f9c0b7c3f/users/da294dbddf6e4d84b33312d2bc39f6a9/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:01.247968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-363b4e00-abcb-46d4-bc03-7412e16066e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e67b1124e5024b19889e7275536c7694'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:01.250183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461632f-2b28-40f1-a20f-2ab56d46fc40 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.250485 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461632f-2b28-40f1-a20f-2ab56d46fc40 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.250856 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461632f-2b28-40f1-a20f-2ab56d46fc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.257317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-363b4e00-abcb-46d4-bc03-7412e16066e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e67b1124e5024b19889e7275536c7694'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:01.258010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-363b4e00-abcb-46d4-bc03-7412e16066e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e67b1124e5024b19889e7275536c7694'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:01.269831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 949/1895] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:00 2022] DELETE /identity/v3/users/e67b1124e5024b19889e7275536c7694 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:01.274000 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54607a87-0810-4b4d-be1a-6fd13a76fbe3 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.274306 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54607a87-0810-4b4d-be1a-6fd13a76fbe3 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.274664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54607a87-0810-4b4d-be1a-6fd13a76fbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.286178 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1461632f-2b28-40f1-a20f-2ab56d46fc40 None None] MFA Rules not processed for user `da294dbddf6e4d84b33312d2bc39f6a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:01.288172 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1461632f-2b28-40f1-a20f-2ab56d46fc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:01.302982 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-54607a87-0810-4b4d-be1a-6fd13a76fbe3 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:01.304228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-54607a87-0810-4b4d-be1a-6fd13a76fbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:01.328135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:01.386370 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 950/1896] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:34:01.388062 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54607a87-0810-4b4d-be1a-6fd13a76fbe3 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:01.390309 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-54607a87-0810-4b4d-be1a-6fd13a76fbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:01.403973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54607a87-0810-4b4d-be1a-6fd13a76fbe3 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:01.411276 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00c3dc-a8fd-4edf-8d83-f8cfe3d6c1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:01.412272 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00c3dc-a8fd-4edf-8d83-f8cfe3d6c1e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.412666 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00c3dc-a8fd-4edf-8d83-f8cfe3d6c1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.413048 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00c3dc-a8fd-4edf-8d83-f8cfe3d6c1e6 admin admin] PATH_INFO: `/v3/projects/a59c6c8e67ba42e9986269b2282dc8b7` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.415388 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00c3dc-a8fd-4edf-8d83-f8cfe3d6c1e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a59c6c8e67ba42e9986269b2282dc8b7)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:01.417656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00c3dc-a8fd-4edf-8d83-f8cfe3d6c1e6 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:01.439981 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 947/1897] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:01 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:34:01.439981 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461632f-2b28-40f1-a20f-2ab56d46fc40 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:01.440998 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1461632f-2b28-40f1-a20f-2ab56d46fc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:01.484704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-3a00c3dc-a8fd-4edf-8d83-f8cfe3d6c1e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a59c6c8e67ba42e9986269b2282dc8b7', 'request_id': 'req-3a00c3dc-a8fd-4edf-8d83-f8cfe3d6c1e6'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:01.512925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-3a00c3dc-a8fd-4edf-8d83-f8cfe3d6c1e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a59c6c8e67ba42e9986269b2282dc8b7', 'request_id': 'req-3a00c3dc-a8fd-4edf-8d83-f8cfe3d6c1e6'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:01.533219 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-3a00c3dc-a8fd-4edf-8d83-f8cfe3d6c1e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a59c6c8e67ba42e9986269b2282dc8b7', 'request_id': 'req-3a00c3dc-a8fd-4edf-8d83-f8cfe3d6c1e6'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:01.563932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-3a00c3dc-a8fd-4edf-8d83-f8cfe3d6c1e6 admin admin] The token cache is being invalidate because project a59c6c8e67ba42e9986269b2282dc8b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:01.564239 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-3a00c3dc-a8fd-4edf-8d83-f8cfe3d6c1e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:01.565049 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-3a00c3dc-a8fd-4edf-8d83-f8cfe3d6c1e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:01.567538 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 951/1898] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:01 2022] DELETE /identity/v3/projects/a59c6c8e67ba42e9986269b2282dc8b7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:01.572924 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00c3dc-a8fd-4edf-8d83-f8cfe3d6c1e6 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:01.574727 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-3a00c3dc-a8fd-4edf-8d83-f8cfe3d6c1e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:01.619955 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461632f-2b28-40f1-a20f-2ab56d46fc40 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:01.746603 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b572d1-3f8e-4371-af1c-810653a2d71e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:01.747352 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b572d1-3f8e-4371-af1c-810653a2d71e service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.747640 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b572d1-3f8e-4371-af1c-810653a2d71e service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.747918 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b572d1-3f8e-4371-af1c-810653a2d71e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.750975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00c3dc-a8fd-4edf-8d83-f8cfe3d6c1e6 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:01.758098 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e0b572d1-3f8e-4371-af1c-810653a2d71e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:01.770662 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de005dd-f8c2-4b54-a394-00ee199336dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:01.773708 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de005dd-f8c2-4b54-a394-00ee199336dd admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.774199 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de005dd-f8c2-4b54-a394-00ee199336dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.774617 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de005dd-f8c2-4b54-a394-00ee199336dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.779817 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de005dd-f8c2-4b54-a394-00ee199336dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:01.782423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de005dd-f8c2-4b54-a394-00ee199336dd admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:01.789235 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b572d1-3f8e-4371-af1c-810653a2d71e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:01.791285 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b572d1-3f8e-4371-af1c-810653a2d71e service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:01.809707 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 948/1899] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:01.810327 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e86f7-5b57-4c1a-bcf3-72f12b8d91b5 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.812361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e86f7-5b57-4c1a-bcf3-72f12b8d91b5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.813073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e86f7-5b57-4c1a-bcf3-72f12b8d91b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:01.846988 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-885e86f7-5b57-4c1a-bcf3-72f12b8d91b5 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:01.848544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-885e86f7-5b57-4c1a-bcf3-72f12b8d91b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:01.855944 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 952/1900] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:01 2022] POST /identity/v3/projects => generated 365 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:01.856978 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de005dd-f8c2-4b54-a394-00ee199336dd admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:01.868114 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:01.947963 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:01.990558 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 949/1901] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:01.995913 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62804e74-d809-4a83-b7fb-3e7c46719a92 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:01.996218 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62804e74-d809-4a83-b7fb-3e7c46719a92 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:01.996762 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62804e74-d809-4a83-b7fb-3e7c46719a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.008479 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de005dd-f8c2-4b54-a394-00ee199336dd admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.022127 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf87de0-92e9-4bfc-bc68-22f953cfeef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.023019 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf87de0-92e9-4bfc-bc68-22f953cfeef3 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.023410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf87de0-92e9-4bfc-bc68-22f953cfeef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.023792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf87de0-92e9-4bfc-bc68-22f953cfeef3 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.024595 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf87de0-92e9-4bfc-bc68-22f953cfeef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:02.026784 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-62804e74-d809-4a83-b7fb-3e7c46719a92 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:02.028163 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-62804e74-d809-4a83-b7fb-3e7c46719a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:02.028768 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf87de0-92e9-4bfc-bc68-22f953cfeef3 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:02.037108 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 950/1902] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:34:02.042038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62804e74-d809-4a83-b7fb-3e7c46719a92 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.052890 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 953/1903] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:01 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:02.056993 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62804e74-d809-4a83-b7fb-3e7c46719a92 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.058310 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf87de0-92e9-4bfc-bc68-22f953cfeef3 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.060525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1569973-577d-47d7-b938-8c334ff77834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.061481 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1569973-577d-47d7-b938-8c334ff77834 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.061818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1569973-577d-47d7-b938-8c334ff77834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.062135 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1569973-577d-47d7-b938-8c334ff77834 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.063139 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1569973-577d-47d7-b938-8c334ff77834 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:02.063487 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1569973-577d-47d7-b938-8c334ff77834 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:02.065394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1569973-577d-47d7-b938-8c334ff77834 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:02.074327 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf87de0-92e9-4bfc-bc68-22f953cfeef3 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.082091 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb53d00-756e-4f61-a0f4-59f8fb9830f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.083319 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb53d00-756e-4f61-a0f4-59f8fb9830f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.084233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb53d00-756e-4f61-a0f4-59f8fb9830f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.084706 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb53d00-756e-4f61-a0f4-59f8fb9830f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.085682 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb53d00-756e-4f61-a0f4-59f8fb9830f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:02.088726 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb53d00-756e-4f61-a0f4-59f8fb9830f0 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:02.102813 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 951/1904] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:02.108096 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1569973-577d-47d7-b938-8c334ff77834 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.124469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1569973-577d-47d7-b938-8c334ff77834 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.127400 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 954/1905] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:02.128857 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb53d00-756e-4f61-a0f4-59f8fb9830f0 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.132645 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e757c2f-e78a-48fb-af4b-17e3365b7016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.132797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e757c2f-e78a-48fb-af4b-17e3365b7016 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.133000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e757c2f-e78a-48fb-af4b-17e3365b7016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.133285 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e757c2f-e78a-48fb-af4b-17e3365b7016 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.133993 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e757c2f-e78a-48fb-af4b-17e3365b7016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:02.136261 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e757c2f-e78a-48fb-af4b-17e3365b7016 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:02.170478 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb53d00-756e-4f61-a0f4-59f8fb9830f0 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.178102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 952/1906] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:02 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:02.186654 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aef4cb-263f-4f80-9586-40b9f4a0332a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.186654 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aef4cb-263f-4f80-9586-40b9f4a0332a admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.186654 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aef4cb-263f-4f80-9586-40b9f4a0332a admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.186654 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aef4cb-263f-4f80-9586-40b9f4a0332a admin admin] PATH_INFO: `/v3/projects/4231a5866e2b4dea860420f3db3d715d/users/cddc7ccb932941c09074b53fb26fc27a/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.189307 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e757c2f-e78a-48fb-af4b-17e3365b7016 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.221322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aef4cb-263f-4f80-9586-40b9f4a0332a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4231a5866e2b4dea860420f3db3d715d, user_id=cddc7ccb932941c09074b53fb26fc27a, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:02.225956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aef4cb-263f-4f80-9586-40b9f4a0332a admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:02.250926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 955/1907] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:02 2022] PUT /identity/v3/projects/4231a5866e2b4dea860420f3db3d715d/users/cddc7ccb932941c09074b53fb26fc27a/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:02.255433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aef4cb-263f-4f80-9586-40b9f4a0332a admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.288280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e757c2f-e78a-48fb-af4b-17e3365b7016 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.403269 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909424c-2f06-40c4-ac95-68726e80853a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.404022 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909424c-2f06-40c4-ac95-68726e80853a admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.404377 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909424c-2f06-40c4-ac95-68726e80853a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.404575 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909424c-2f06-40c4-ac95-68726e80853a admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.405549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909424c-2f06-40c4-ac95-68726e80853a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:02.407759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909424c-2f06-40c4-ac95-68726e80853a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:02.413721 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aef4cb-263f-4f80-9586-40b9f4a0332a admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.420990 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b75d1-030e-42fc-b993-3887b017d766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.421683 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b75d1-030e-42fc-b993-3887b017d766 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.421954 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b75d1-030e-42fc-b993-3887b017d766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.422221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b75d1-030e-42fc-b993-3887b017d766 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.422991 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b75d1-030e-42fc-b993-3887b017d766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:02.424631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b75d1-030e-42fc-b993-3887b017d766 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:02.433514 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 953/1908] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:02 2022] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:02.437570 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909424c-2f06-40c4-ac95-68726e80853a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.443747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 956/1909] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:34:02.445924 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b75d1-030e-42fc-b993-3887b017d766 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.449264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909424c-2f06-40c4-ac95-68726e80853a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.454894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fe7eb-cece-4512-89e3-54a78b07cb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.455759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fe7eb-cece-4512-89e3-54a78b07cb97 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.456274 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fe7eb-cece-4512-89e3-54a78b07cb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.457070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fe7eb-cece-4512-89e3-54a78b07cb97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.457781 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fe7eb-cece-4512-89e3-54a78b07cb97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:02.459574 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fe7eb-cece-4512-89e3-54a78b07cb97 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:02.460209 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b75d1-030e-42fc-b993-3887b017d766 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.466910 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d90c2d-0c72-4aa8-ae16-c501ba5d0b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.471415 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d90c2d-0c72-4aa8-ae16-c501ba5d0b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.471810 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d90c2d-0c72-4aa8-ae16-c501ba5d0b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.472687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d90c2d-0c72-4aa8-ae16-c501ba5d0b87 admin admin] PATH_INFO: `/v3/projects/4231a5866e2b4dea860420f3db3d715d/users/cddc7ccb932941c09074b53fb26fc27a/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.479001 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 954/1910] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:02.480543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d90c2d-0c72-4aa8-ae16-c501ba5d0b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4231a5866e2b4dea860420f3db3d715d, user_id=cddc7ccb932941c09074b53fb26fc27a, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:02.483269 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fe7eb-cece-4512-89e3-54a78b07cb97 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.484435 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d90c2d-0c72-4aa8-ae16-c501ba5d0b87 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:02.492941 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:02.500071 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fe7eb-cece-4512-89e3-54a78b07cb97 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.503327 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 957/1911] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:02 2022] PUT /identity/v3/projects/4231a5866e2b4dea860420f3db3d715d/users/cddc7ccb932941c09074b53fb26fc27a/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:02.513786 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e48f7-72de-4f47-b522-98a96eab7434 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.514208 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e48f7-72de-4f47-b522-98a96eab7434 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.515252 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e48f7-72de-4f47-b522-98a96eab7434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.578121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-610e48f7-72de-4f47-b522-98a96eab7434 None None] MFA Rules not processed for user `cddc7ccb932941c09074b53fb26fc27a`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:02.579758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-610e48f7-72de-4f47-b522-98a96eab7434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:02.584694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1f26c-a5dd-4ffb-bf0f-cf0cb132847c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.586628 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1f26c-a5dd-4ffb-bf0f-cf0cb132847c admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.587093 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1f26c-a5dd-4ffb-bf0f-cf0cb132847c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.587517 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1f26c-a5dd-4ffb-bf0f-cf0cb132847c admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.588525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1f26c-a5dd-4ffb-bf0f-cf0cb132847c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:02.590477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1f26c-a5dd-4ffb-bf0f-cf0cb132847c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:02.623627 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 955/1912] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:34:02.624491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1f26c-a5dd-4ffb-bf0f-cf0cb132847c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.629870 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a7a1f26c-a5dd-4ffb-bf0f-cf0cb132847c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:02.645070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1f26c-a5dd-4ffb-bf0f-cf0cb132847c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.655341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e249f-7bfa-49b4-95bc-076528f45b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.656121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e249f-7bfa-49b4-95bc-076528f45b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.656409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e249f-7bfa-49b4-95bc-076528f45b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.656687 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e249f-7bfa-49b4-95bc-076528f45b31 admin admin] PATH_INFO: `/v3/projects/ccbc9e819d044f598810c140cf648ded` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.658155 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e249f-7bfa-49b4-95bc-076528f45b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccbc9e819d044f598810c140cf648ded)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:02.660590 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e249f-7bfa-49b4-95bc-076528f45b31 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:02.670676 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:02.688951 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 958/1913] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:34:02.690256 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e48f7-72de-4f47-b522-98a96eab7434 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.726588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b71e249f-7bfa-49b4-95bc-076528f45b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccbc9e819d044f598810c140cf648ded', 'request_id': 'req-b71e249f-7bfa-49b4-95bc-076528f45b31'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:02.726871 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e48f7-72de-4f47-b522-98a96eab7434 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.737945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b71e249f-7bfa-49b4-95bc-076528f45b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccbc9e819d044f598810c140cf648ded', 'request_id': 'req-b71e249f-7bfa-49b4-95bc-076528f45b31'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:02.745414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b71e249f-7bfa-49b4-95bc-076528f45b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccbc9e819d044f598810c140cf648ded', 'request_id': 'req-b71e249f-7bfa-49b4-95bc-076528f45b31'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:02.764407 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b71e249f-7bfa-49b4-95bc-076528f45b31 admin admin] The token cache is being invalidate because project ccbc9e819d044f598810c140cf648ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:02.765845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b71e249f-7bfa-49b4-95bc-076528f45b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:02.767283 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b71e249f-7bfa-49b4-95bc-076528f45b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:02.773499 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 956/1914] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:02 2022] DELETE /identity/v3/projects/ccbc9e819d044f598810c140cf648ded => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:02.773499 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e249f-7bfa-49b4-95bc-076528f45b31 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.773499 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b71e249f-7bfa-49b4-95bc-076528f45b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:02.843447 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e249f-7bfa-49b4-95bc-076528f45b31 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.846249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0115c-3dca-44f1-8293-e9d8dfe7f764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.847852 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2a316-e482-4aa0-a56d-05f2ca0059ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.848522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2a316-e482-4aa0-a56d-05f2ca0059ad service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.848859 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2a316-e482-4aa0-a56d-05f2ca0059ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.849188 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2a316-e482-4aa0-a56d-05f2ca0059ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.851093 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0115c-3dca-44f1-8293-e9d8dfe7f764 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.851246 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d3c2a316-e482-4aa0-a56d-05f2ca0059ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:02.851811 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0115c-3dca-44f1-8293-e9d8dfe7f764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.852208 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0115c-3dca-44f1-8293-e9d8dfe7f764 admin admin] PATH_INFO: `/v3/projects/8abe6fe55875470b9c1986e77f5f92c8/users/58fd7ffc15534581b20f6f6b48241934/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.874716 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0115c-3dca-44f1-8293-e9d8dfe7f764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8abe6fe55875470b9c1986e77f5f92c8, user_id=58fd7ffc15534581b20f6f6b48241934, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:02.877542 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0115c-3dca-44f1-8293-e9d8dfe7f764 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:02.896292 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 959/1915] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:02 2022] PUT /identity/v3/projects/8abe6fe55875470b9c1986e77f5f92c8/users/58fd7ffc15534581b20f6f6b48241934/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:02.897479 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0115c-3dca-44f1-8293-e9d8dfe7f764 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:02.899702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-7ee0115c-3dca-44f1-8293-e9d8dfe7f764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:02.902946 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:02.936974 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2a316-e482-4aa0-a56d-05f2ca0059ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:02.939108 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2a316-e482-4aa0-a56d-05f2ca0059ad service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:02.951244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 957/1916] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:02.960328 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a6fee-2a2c-4d71-a341-afa1675188d4 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.961070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a6fee-2a2c-4d71-a341-afa1675188d4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.961521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a6fee-2a2c-4d71-a341-afa1675188d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.988917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0115c-3dca-44f1-8293-e9d8dfe7f764 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:02.994092 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd565ba-aec3-4fc5-9c95-cb4f266bf923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:02.994543 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6e9a6fee-2a2c-4d71-a341-afa1675188d4 None None] MFA Rules not processed for user `58fd7ffc15534581b20f6f6b48241934`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:02.995056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd565ba-aec3-4fc5-9c95-cb4f266bf923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:02.995380 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd565ba-aec3-4fc5-9c95-cb4f266bf923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:02.995690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd565ba-aec3-4fc5-9c95-cb4f266bf923 admin admin] PATH_INFO: `/v3/users/70aac314b01b45c198b61daeab9e5d9d` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:02.995793 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6e9a6fee-2a2c-4d71-a341-afa1675188d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:02.997005 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd565ba-aec3-4fc5-9c95-cb4f266bf923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70aac314b01b45c198b61daeab9e5d9d)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:02.999481 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd565ba-aec3-4fc5-9c95-cb4f266bf923 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:03.082409 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-3bd565ba-aec3-4fc5-9c95-cb4f266bf923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70aac314b01b45c198b61daeab9e5d9d'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:03.092603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-3bd565ba-aec3-4fc5-9c95-cb4f266bf923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70aac314b01b45c198b61daeab9e5d9d'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:03.106477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-3bd565ba-aec3-4fc5-9c95-cb4f266bf923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70aac314b01b45c198b61daeab9e5d9d'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:03.118161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-3bd565ba-aec3-4fc5-9c95-cb4f266bf923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70aac314b01b45c198b61daeab9e5d9d'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:03.119939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 958/1917] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:03.120418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a6fee-2a2c-4d71-a341-afa1675188d4 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:03.131577 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-3bd565ba-aec3-4fc5-9c95-cb4f266bf923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70aac314b01b45c198b61daeab9e5d9d'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:03.137822 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:03.151489 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 960/1918] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:02 2022] DELETE /identity/v3/users/70aac314b01b45c198b61daeab9e5d9d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:03.151489 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd565ba-aec3-4fc5-9c95-cb4f266bf923 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:03.151787 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-3bd565ba-aec3-4fc5-9c95-cb4f266bf923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:03.229499 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd565ba-aec3-4fc5-9c95-cb4f266bf923 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:03.233583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a6fee-2a2c-4d71-a341-afa1675188d4 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:03.242362 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87b4a0-013c-47c1-b931-d3f2e00e3796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:03.243594 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87b4a0-013c-47c1-b931-d3f2e00e3796 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:03.244201 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87b4a0-013c-47c1-b931-d3f2e00e3796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:03.244710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87b4a0-013c-47c1-b931-d3f2e00e3796 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:03.245650 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87b4a0-013c-47c1-b931-d3f2e00e3796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:03.248091 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87b4a0-013c-47c1-b931-d3f2e00e3796 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:03.286324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 961/1919] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:03 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:03.290434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87b4a0-013c-47c1-b931-d3f2e00e3796 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:03.342920 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ec149-b7be-42cc-bd37-9194b3585cb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:03.344376 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ec149-b7be-42cc-bd37-9194b3585cb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:03.344676 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ec149-b7be-42cc-bd37-9194b3585cb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:03.345436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ec149-b7be-42cc-bd37-9194b3585cb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:03.347713 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-059ec149-b7be-42cc-bd37-9194b3585cb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:03.388694 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87b4a0-013c-47c1-b931-d3f2e00e3796 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:03.398736 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:03.402669 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea2f70-7d4d-4087-9939-1685921301c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:03.404553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea2f70-7d4d-4087-9939-1685921301c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:03.404847 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea2f70-7d4d-4087-9939-1685921301c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:03.405129 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea2f70-7d4d-4087-9939-1685921301c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:03.406963 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea2f70-7d4d-4087-9939-1685921301c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:03.409035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea2f70-7d4d-4087-9939-1685921301c4 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:03.443842 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 962/1920] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:03 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:34:03.443842 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea2f70-7d4d-4087-9939-1685921301c4 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:03.444060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-5cea2f70-7d4d-4087-9939-1685921301c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:03.459509 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ec149-b7be-42cc-bd37-9194b3585cb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:03.459740 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea2f70-7d4d-4087-9939-1685921301c4 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:03.461489 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ec149-b7be-42cc-bd37-9194b3585cb4 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:03.465973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43aae0-b32a-4d45-b981-973f3921e1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:03.467115 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43aae0-b32a-4d45-b981-973f3921e1ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:03.467404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43aae0-b32a-4d45-b981-973f3921e1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:03.467684 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43aae0-b32a-4d45-b981-973f3921e1ce admin admin] PATH_INFO: `/v3/users/9a03ce3999704599a00596336d2097eb` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:03.468998 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43aae0-b32a-4d45-b981-973f3921e1ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a03ce3999704599a00596336d2097eb)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:03.471345 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43aae0-b32a-4d45-b981-973f3921e1ce admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:03.495509 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 959/1921] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:03 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:03.501334 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ec149-b7be-42cc-bd37-9194b3585cb4 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:03.525822 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ec149-b7be-42cc-bd37-9194b3585cb4 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:03.538080 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0f43aae0-b32a-4d45-b981-973f3921e1ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a03ce3999704599a00596336d2097eb'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:03.539532 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554cc27-d183-41c5-ae1c-78588a2a8dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:03.540225 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554cc27-d183-41c5-ae1c-78588a2a8dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:03.540674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554cc27-d183-41c5-ae1c-78588a2a8dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:03.541002 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554cc27-d183-41c5-ae1c-78588a2a8dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:03.541743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554cc27-d183-41c5-ae1c-78588a2a8dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:03.543464 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554cc27-d183-41c5-ae1c-78588a2a8dd4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:03.562318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0f43aae0-b32a-4d45-b981-973f3921e1ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a03ce3999704599a00596336d2097eb'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:03.570916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 960/1922] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:03.571821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554cc27-d183-41c5-ae1c-78588a2a8dd4 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:03.580864 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:03.582533 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0f43aae0-b32a-4d45-b981-973f3921e1ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a03ce3999704599a00596336d2097eb'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:03.593819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554cc27-d183-41c5-ae1c-78588a2a8dd4 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:03.604303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909d6eb-7136-48fe-8824-b9217e8da3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:03.605223 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909d6eb-7136-48fe-8824-b9217e8da3f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:03.605512 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909d6eb-7136-48fe-8824-b9217e8da3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:03.605794 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909d6eb-7136-48fe-8824-b9217e8da3f6 admin admin] PATH_INFO: `/v3/projects/dac86c7953604ed780b1978608224833/users/aecdaf28d7584678b92bd61c3313c633/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:03.619637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0f43aae0-b32a-4d45-b981-973f3921e1ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a03ce3999704599a00596336d2097eb'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:03.623311 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0f43aae0-b32a-4d45-b981-973f3921e1ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a03ce3999704599a00596336d2097eb'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:03.642210 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909d6eb-7136-48fe-8824-b9217e8da3f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac86c7953604ed780b1978608224833, user_id=aecdaf28d7584678b92bd61c3313c633, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:03.644959 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909d6eb-7136-48fe-8824-b9217e8da3f6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:03.645396 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 963/1923] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:03 2022] DELETE /identity/v3/users/9a03ce3999704599a00596336d2097eb => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:03.646373 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43aae0-b32a-4d45-b981-973f3921e1ce admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:03.648217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-0f43aae0-b32a-4d45-b981-973f3921e1ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:03.675319 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 961/1924] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:03 2022] PUT /identity/v3/projects/dac86c7953604ed780b1978608224833/users/aecdaf28d7584678b92bd61c3313c633/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:03.676496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b90d85-88f6-4ac7-a2df-a4b4008c2d51 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:03.676794 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b90d85-88f6-4ac7-a2df-a4b4008c2d51 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:03.677069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b90d85-88f6-4ac7-a2df-a4b4008c2d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:03.722200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-e8b90d85-88f6-4ac7-a2df-a4b4008c2d51 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:03.725725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e8b90d85-88f6-4ac7-a2df-a4b4008c2d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:03.772151 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43aae0-b32a-4d45-b981-973f3921e1ce admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:03.808887 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 962/1925] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:03.809654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b90d85-88f6-4ac7-a2df-a4b4008c2d51 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:03.811004 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e8b90d85-88f6-4ac7-a2df-a4b4008c2d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:03.828892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b90d85-88f6-4ac7-a2df-a4b4008c2d51 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:03.835340 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7e3cd-427e-47f4-8282-49d494bbad72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:03.836019 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7e3cd-427e-47f4-8282-49d494bbad72 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:03.836307 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7e3cd-427e-47f4-8282-49d494bbad72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:03.836945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7e3cd-427e-47f4-8282-49d494bbad72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:03.837323 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7e3cd-427e-47f4-8282-49d494bbad72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:03.839801 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7e3cd-427e-47f4-8282-49d494bbad72 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:03.845788 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc2d9e-3ce2-43f0-a97f-4fc1665d5dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:03.846805 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc2d9e-3ce2-43f0-a97f-4fc1665d5dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:03.847378 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc2d9e-3ce2-43f0-a97f-4fc1665d5dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:03.847477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc2d9e-3ce2-43f0-a97f-4fc1665d5dcd admin admin] PATH_INFO: `/v3/projects/0d140d1b765c425cb11640093d98fb55` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:03.848759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc2d9e-3ce2-43f0-a97f-4fc1665d5dcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d140d1b765c425cb11640093d98fb55)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:03.850785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc2d9e-3ce2-43f0-a97f-4fc1665d5dcd admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:03.851324 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 963/1926] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:03.852212 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7e3cd-427e-47f4-8282-49d494bbad72 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:03.854113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-50a7e3cd-427e-47f4-8282-49d494bbad72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:03.911188 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ecfc2d9e-3ce2-43f0-a97f-4fc1665d5dcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d140d1b765c425cb11640093d98fb55', 'request_id': 'req-ecfc2d9e-3ce2-43f0-a97f-4fc1665d5dcd'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:03.917848 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7e3cd-427e-47f4-8282-49d494bbad72 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:03.918409 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ecfc2d9e-3ce2-43f0-a97f-4fc1665d5dcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d140d1b765c425cb11640093d98fb55', 'request_id': 'req-ecfc2d9e-3ce2-43f0-a97f-4fc1665d5dcd'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:03.927419 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ecfc2d9e-3ce2-43f0-a97f-4fc1665d5dcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d140d1b765c425cb11640093d98fb55', 'request_id': 'req-ecfc2d9e-3ce2-43f0-a97f-4fc1665d5dcd'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:03.942555 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ecfc2d9e-3ce2-43f0-a97f-4fc1665d5dcd admin admin] The token cache is being invalidate because project 0d140d1b765c425cb11640093d98fb55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:03.942852 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ecfc2d9e-3ce2-43f0-a97f-4fc1665d5dcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:03.944150 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ecfc2d9e-3ce2-43f0-a97f-4fc1665d5dcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:03.947766 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 964/1927] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:03 2022] DELETE /identity/v3/projects/0d140d1b765c425cb11640093d98fb55 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:03.951684 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc2d9e-3ce2-43f0-a97f-4fc1665d5dcd admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:03.951684 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ecfc2d9e-3ce2-43f0-a97f-4fc1665d5dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:03.970815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:03.983011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc729ebf-9b3d-4fde-99f8-04eafb8c2eae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:03.983903 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc729ebf-9b3d-4fde-99f8-04eafb8c2eae service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:03.984479 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc729ebf-9b3d-4fde-99f8-04eafb8c2eae service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:03.984837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc729ebf-9b3d-4fde-99f8-04eafb8c2eae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:03.987313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:03.988166 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-dc729ebf-9b3d-4fde-99f8-04eafb8c2eae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:04.036575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc2d9e-3ce2-43f0-a97f-4fc1665d5dcd admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:04.044064 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9d3b2-e3b6-49fc-bfc3-7799c582daef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:04.045076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9d3b2-e3b6-49fc-bfc3-7799c582daef admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:04.045387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9d3b2-e3b6-49fc-bfc3-7799c582daef admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:04.045696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9d3b2-e3b6-49fc-bfc3-7799c582daef admin admin] PATH_INFO: `/v3/projects/dac86c7953604ed780b1978608224833/users/aecdaf28d7584678b92bd61c3313c633/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:04.048031 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9d3b2-e3b6-49fc-bfc3-7799c582daef admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac86c7953604ed780b1978608224833, user_id=aecdaf28d7584678b92bd61c3313c633, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:04.052550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9d3b2-e3b6-49fc-bfc3-7799c582daef admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:04.063503 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc729ebf-9b3d-4fde-99f8-04eafb8c2eae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:04.064094 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 965/1928] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:03 2022] PUT /identity/v3/projects/dac86c7953604ed780b1978608224833/users/aecdaf28d7584678b92bd61c3313c633/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:04.065490 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019d75b-0f23-438a-8972-6f78abab486a None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:04.065619 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc729ebf-9b3d-4fde-99f8-04eafb8c2eae service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:04.065786 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019d75b-0f23-438a-8972-6f78abab486a None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:04.066073 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019d75b-0f23-438a-8972-6f78abab486a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:04.078347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 964/1929] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:04.079939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ec702-b551-4698-b4a8-d44d307f1d53 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:04.080407 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ec702-b551-4698-b4a8-d44d307f1d53 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:04.080849 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ec702-b551-4698-b4a8-d44d307f1d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:04.089629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-c019d75b-0f23-438a-8972-6f78abab486a None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:04.090909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-c019d75b-0f23-438a-8972-6f78abab486a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:04.121262 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-879ec702-b551-4698-b4a8-d44d307f1d53 None None] MFA Rules not processed for user `aecdaf28d7584678b92bd61c3313c633`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:04.122924 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-879ec702-b551-4698-b4a8-d44d307f1d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:04.208434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 966/1930] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:04.217140 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ff422-5f8a-4340-9e8e-9cacd16b2acf None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:04.217359 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ff422-5f8a-4340-9e8e-9cacd16b2acf None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:04.217508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ff422-5f8a-4340-9e8e-9cacd16b2acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:04.247207 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-4e4ff422-5f8a-4340-9e8e-9cacd16b2acf None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:04.248855 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-4e4ff422-5f8a-4340-9e8e-9cacd16b2acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:04.263425 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 967/1931] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:04.264356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ff422-5f8a-4340-9e8e-9cacd16b2acf None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:04.273932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ff422-5f8a-4340-9e8e-9cacd16b2acf None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:04.279829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf036ce-7dd8-44e6-8d8e-bc5cb5d97e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:04.280538 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf036ce-7dd8-44e6-8d8e-bc5cb5d97e05 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:04.280828 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf036ce-7dd8-44e6-8d8e-bc5cb5d97e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:04.281116 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf036ce-7dd8-44e6-8d8e-bc5cb5d97e05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:04.282036 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf036ce-7dd8-44e6-8d8e-bc5cb5d97e05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:04.282255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf036ce-7dd8-44e6-8d8e-bc5cb5d97e05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:04.283971 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf036ce-7dd8-44e6-8d8e-bc5cb5d97e05 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:04.289224 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 965/1932] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:04.302915 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ec702-b551-4698-b4a8-d44d307f1d53 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:04.304704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-879ec702-b551-4698-b4a8-d44d307f1d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:04.311266 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 968/1933] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:04.315284 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf036ce-7dd8-44e6-8d8e-bc5cb5d97e05 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:04.343345 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf036ce-7dd8-44e6-8d8e-bc5cb5d97e05 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:04.358240 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b567615-ee2b-458f-a97e-c5b094356ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:04.366703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b567615-ee2b-458f-a97e-c5b094356ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:04.367068 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b567615-ee2b-458f-a97e-c5b094356ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:04.367469 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b567615-ee2b-458f-a97e-c5b094356ae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:04.371250 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b567615-ee2b-458f-a97e-c5b094356ae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:04.392649 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b567615-ee2b-458f-a97e-c5b094356ae3 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:04.401316 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ec702-b551-4698-b4a8-d44d307f1d53 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:04.406307 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb157a9-5d22-4f75-894a-244c3cb35280 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:04.407063 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb157a9-5d22-4f75-894a-244c3cb35280 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:04.407354 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb157a9-5d22-4f75-894a-244c3cb35280 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:04.407679 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb157a9-5d22-4f75-894a-244c3cb35280 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:04.409678 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ccb157a9-5d22-4f75-894a-244c3cb35280 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:04.465504 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:04.468743 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 969/1934] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:04 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:04.482946 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b567615-ee2b-458f-a97e-c5b094356ae3 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:04.502447 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb157a9-5d22-4f75-894a-244c3cb35280 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:04.505667 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb157a9-5d22-4f75-894a-244c3cb35280 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:04.542126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 966/1935] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:04.597450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b567615-ee2b-458f-a97e-c5b094356ae3 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:04.605057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dec8ed-79de-42ac-b071-4a87c4994dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:04.605973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dec8ed-79de-42ac-b071-4a87c4994dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:04.606328 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dec8ed-79de-42ac-b071-4a87c4994dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:04.606648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dec8ed-79de-42ac-b071-4a87c4994dd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:04.607468 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dec8ed-79de-42ac-b071-4a87c4994dd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:04.609861 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dec8ed-79de-42ac-b071-4a87c4994dd2 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:04.653340 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb157a9-5d22-4f75-894a-244c3cb35280 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:04.654903 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ccb157a9-5d22-4f75-894a-244c3cb35280 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:04.676256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb157a9-5d22-4f75-894a-244c3cb35280 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:04.691922 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71284823-465c-46ed-81cc-3cf4e382264e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:04.694169 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 970/1936] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:04 2022] POST /identity/v3/users => generated 291 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:34:04.695192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dec8ed-79de-42ac-b071-4a87c4994dd2 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:04.697836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71284823-465c-46ed-81cc-3cf4e382264e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:04.697963 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71284823-465c-46ed-81cc-3cf4e382264e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:04.698684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71284823-465c-46ed-81cc-3cf4e382264e admin admin] PATH_INFO: `/v3/projects/7d8e707bda43465f803c3f85fe3b7409` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:04.701841 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71284823-465c-46ed-81cc-3cf4e382264e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d8e707bda43465f803c3f85fe3b7409)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:04.709234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71284823-465c-46ed-81cc-3cf4e382264e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:04.711272 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dec8ed-79de-42ac-b071-4a87c4994dd2 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:04.720466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72429d-4ceb-4073-a7d6-56db869eee86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:04.721432 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72429d-4ceb-4073-a7d6-56db869eee86 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:04.721939 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72429d-4ceb-4073-a7d6-56db869eee86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:04.722578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72429d-4ceb-4073-a7d6-56db869eee86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:04.723444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72429d-4ceb-4073-a7d6-56db869eee86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:04.725395 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72429d-4ceb-4073-a7d6-56db869eee86 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:04.727290 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:04.770733 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 971/1937] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:04.774242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72429d-4ceb-4073-a7d6-56db869eee86 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:04.799263 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72429d-4ceb-4073-a7d6-56db869eee86 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:04.814452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1363a61-6f6c-42ce-b125-4b4b117a68e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:04.815294 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1363a61-6f6c-42ce-b125-4b4b117a68e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:04.815689 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1363a61-6f6c-42ce-b125-4b4b117a68e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:04.816075 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1363a61-6f6c-42ce-b125-4b4b117a68e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:04.817041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1363a61-6f6c-42ce-b125-4b4b117a68e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:04.820630 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1363a61-6f6c-42ce-b125-4b4b117a68e0 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:04.864040 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 972/1938] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:04.869837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1363a61-6f6c-42ce-b125-4b4b117a68e0 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:04.871071 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-71284823-465c-46ed-81cc-3cf4e382264e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d8e707bda43465f803c3f85fe3b7409', 'request_id': 'req-71284823-465c-46ed-81cc-3cf4e382264e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:04.885822 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-71284823-465c-46ed-81cc-3cf4e382264e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d8e707bda43465f803c3f85fe3b7409', 'request_id': 'req-71284823-465c-46ed-81cc-3cf4e382264e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:04.893986 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1363a61-6f6c-42ce-b125-4b4b117a68e0 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:04.906012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-71284823-465c-46ed-81cc-3cf4e382264e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d8e707bda43465f803c3f85fe3b7409', 'request_id': 'req-71284823-465c-46ed-81cc-3cf4e382264e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:04.929172 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-71284823-465c-46ed-81cc-3cf4e382264e admin admin] The token cache is being invalidate because project 7d8e707bda43465f803c3f85fe3b7409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:04.929450 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-71284823-465c-46ed-81cc-3cf4e382264e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:04.932504 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-71284823-465c-46ed-81cc-3cf4e382264e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:04.941859 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 967/1939] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:04 2022] DELETE /identity/v3/projects/7d8e707bda43465f803c3f85fe3b7409 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:04.943506 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71284823-465c-46ed-81cc-3cf4e382264e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:04.946045 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-71284823-465c-46ed-81cc-3cf4e382264e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:05.065733 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230331bd-91a5-4f05-9d19-df445f5ef353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:05.068037 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230331bd-91a5-4f05-9d19-df445f5ef353 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:05.068588 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230331bd-91a5-4f05-9d19-df445f5ef353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:05.068897 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230331bd-91a5-4f05-9d19-df445f5ef353 admin admin] PATH_INFO: `/v3/projects/6aa1166c6a10423b88839b8b4ace0c6a/users/28b4d3863cfa4387b22598efee859dae/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:05.109258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71284823-465c-46ed-81cc-3cf4e382264e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:05.121277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bcefa0-bab4-4cbc-96fd-6014011f93c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:05.127882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230331bd-91a5-4f05-9d19-df445f5ef353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa1166c6a10423b88839b8b4ace0c6a, user_id=28b4d3863cfa4387b22598efee859dae, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:05.128054 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcefa0-bab4-4cbc-96fd-6014011f93c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:05.134053 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230331bd-91a5-4f05-9d19-df445f5ef353 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:05.137369 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcefa0-bab4-4cbc-96fd-6014011f93c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:05.137741 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcefa0-bab4-4cbc-96fd-6014011f93c0 admin admin] PATH_INFO: `/v3/users/093efa98e5334b46bb1a58b3b44ec999` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:05.139918 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bcefa0-bab4-4cbc-96fd-6014011f93c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=093efa98e5334b46bb1a58b3b44ec999)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:05.142036 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bcefa0-bab4-4cbc-96fd-6014011f93c0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:05.178235 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 973/1940] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:04 2022] PUT /identity/v3/projects/6aa1166c6a10423b88839b8b4ace0c6a/users/28b4d3863cfa4387b22598efee859dae/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:05.192493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beffc4-ac0c-4d30-a059-81ebee95ce3e None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:05.192731 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beffc4-ac0c-4d30-a059-81ebee95ce3e None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:05.193011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beffc4-ac0c-4d30-a059-81ebee95ce3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:05.269610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-69beffc4-ac0c-4d30-a059-81ebee95ce3e None None] MFA Rules not processed for user `28b4d3863cfa4387b22598efee859dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:05.274740 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-69beffc4-ac0c-4d30-a059-81ebee95ce3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:05.308583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-38bcefa0-bab4-4cbc-96fd-6014011f93c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093efa98e5334b46bb1a58b3b44ec999'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:05.333429 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-38bcefa0-bab4-4cbc-96fd-6014011f93c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093efa98e5334b46bb1a58b3b44ec999'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:05.334764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-38bcefa0-bab4-4cbc-96fd-6014011f93c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093efa98e5334b46bb1a58b3b44ec999'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:05.336136 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-38bcefa0-bab4-4cbc-96fd-6014011f93c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093efa98e5334b46bb1a58b3b44ec999'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:05.351678 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:05.376783 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-38bcefa0-bab4-4cbc-96fd-6014011f93c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093efa98e5334b46bb1a58b3b44ec999'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:05.407648 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 968/1941] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:04 2022] DELETE /identity/v3/users/093efa98e5334b46bb1a58b3b44ec999 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:05.437658 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 974/1942] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:05.439023 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bcefa0-bab4-4cbc-96fd-6014011f93c0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:05.440808 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-38bcefa0-bab4-4cbc-96fd-6014011f93c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:05.609972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bcefa0-bab4-4cbc-96fd-6014011f93c0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:05.624735 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4162e8-a10b-4ed5-bff3-25c7bbb4c399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:05.625512 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4162e8-a10b-4ed5-bff3-25c7bbb4c399 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:05.626621 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4162e8-a10b-4ed5-bff3-25c7bbb4c399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:05.626912 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4162e8-a10b-4ed5-bff3-25c7bbb4c399 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:05.628044 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4162e8-a10b-4ed5-bff3-25c7bbb4c399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:05.631151 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4162e8-a10b-4ed5-bff3-25c7bbb4c399 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:05.677656 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 969/1943] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:05 2022] POST /identity/v3/projects => generated 383 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:05.678847 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69beffc4-ac0c-4d30-a059-81ebee95ce3e None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:05.767446 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:05.777467 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69beffc4-ac0c-4d30-a059-81ebee95ce3e None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:05.879621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfee8f9-7cd9-47ef-9ba0-2ac609e554d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:05.879621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfee8f9-7cd9-47ef-9ba0-2ac609e554d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:05.879621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfee8f9-7cd9-47ef-9ba0-2ac609e554d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:05.880437 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfee8f9-7cd9-47ef-9ba0-2ac609e554d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:05.880890 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfee8f9-7cd9-47ef-9ba0-2ac609e554d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:05.882975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfee8f9-7cd9-47ef-9ba0-2ac609e554d9 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:05.916671 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4162e8-a10b-4ed5-bff3-25c7bbb4c399 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:05.917155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 975/1944] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:05 2022] POST /identity/v3/users => generated 298 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:34:05.929873 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4162e8-a10b-4ed5-bff3-25c7bbb4c399 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:05.941710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a513bf3-c13d-463d-8bb0-e743503504c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:05.942787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a513bf3-c13d-463d-8bb0-e743503504c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:05.943043 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a513bf3-c13d-463d-8bb0-e743503504c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:05.943727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a513bf3-c13d-463d-8bb0-e743503504c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:05.944550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a513bf3-c13d-463d-8bb0-e743503504c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:05.946881 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a513bf3-c13d-463d-8bb0-e743503504c9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:05.963038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 970/1945] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:05.964555 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfee8f9-7cd9-47ef-9ba0-2ac609e554d9 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:05.978177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfee8f9-7cd9-47ef-9ba0-2ac609e554d9 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:05.989030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8a97f-6939-4b51-a5ec-bce58dc21b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:05.990022 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8a97f-6939-4b51-a5ec-bce58dc21b4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:05.990315 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8a97f-6939-4b51-a5ec-bce58dc21b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:05.990663 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8a97f-6939-4b51-a5ec-bce58dc21b4d admin admin] PATH_INFO: `/v3/projects/baa6ddc212d940ed98131c01d17003ae/users/2e6584b9db314fbf9d32ce12efa00ad5/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:06.048541 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8a97f-6939-4b51-a5ec-bce58dc21b4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa6ddc212d940ed98131c01d17003ae, user_id=2e6584b9db314fbf9d32ce12efa00ad5, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:06.052289 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8a97f-6939-4b51-a5ec-bce58dc21b4d admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:06.073376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 976/1946] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:05 2022] PUT /identity/v3/projects/baa6ddc212d940ed98131c01d17003ae/users/2e6584b9db314fbf9d32ce12efa00ad5/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:06.077965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a513bf3-c13d-463d-8bb0-e743503504c9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:06.090053 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a513bf3-c13d-463d-8bb0-e743503504c9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:06.170148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98670d1-830c-4139-86a6-cfadf803ea77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:06.172843 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98670d1-830c-4139-86a6-cfadf803ea77 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:06.173255 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98670d1-830c-4139-86a6-cfadf803ea77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:06.173607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98670d1-830c-4139-86a6-cfadf803ea77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:06.178301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98670d1-830c-4139-86a6-cfadf803ea77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:06.180526 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98670d1-830c-4139-86a6-cfadf803ea77 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:06.204705 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 971/1947] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:06.208921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8a97f-6939-4b51-a5ec-bce58dc21b4d admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:06.223161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8a97f-6939-4b51-a5ec-bce58dc21b4d admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:06.245042 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ee450-975e-49c7-ab8d-54a0cf0b78e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:06.245963 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ee450-975e-49c7-ab8d-54a0cf0b78e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:06.246259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ee450-975e-49c7-ab8d-54a0cf0b78e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:06.246550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ee450-975e-49c7-ab8d-54a0cf0b78e6 admin admin] PATH_INFO: `/v3/projects/baa6ddc212d940ed98131c01d17003ae/users/2e6584b9db314fbf9d32ce12efa00ad5/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:06.256020 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ee450-975e-49c7-ab8d-54a0cf0b78e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa6ddc212d940ed98131c01d17003ae, user_id=2e6584b9db314fbf9d32ce12efa00ad5, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:06.258733 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ee450-975e-49c7-ab8d-54a0cf0b78e6 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:06.289603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 977/1948] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:06 2022] PUT /identity/v3/projects/baa6ddc212d940ed98131c01d17003ae/users/2e6584b9db314fbf9d32ce12efa00ad5/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:06.299593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec96f8-0ece-4c3d-8fcf-b61ca1c0d262 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:06.299968 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec96f8-0ece-4c3d-8fcf-b61ca1c0d262 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:06.300332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec96f8-0ece-4c3d-8fcf-b61ca1c0d262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:06.335128 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-77ec96f8-0ece-4c3d-8fcf-b61ca1c0d262 None None] MFA Rules not processed for user `2e6584b9db314fbf9d32ce12efa00ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:06.336519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-77ec96f8-0ece-4c3d-8fcf-b61ca1c0d262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:06.350310 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ee450-975e-49c7-ab8d-54a0cf0b78e6 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:06.352315 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-b73ee450-975e-49c7-ab8d-54a0cf0b78e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:06.386928 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:06.446739 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 972/1949] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:06.461872 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec96f8-0ece-4c3d-8fcf-b61ca1c0d262 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:06.464137 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-77ec96f8-0ece-4c3d-8fcf-b61ca1c0d262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:06.508915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ee450-975e-49c7-ab8d-54a0cf0b78e6 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:06.527042 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef1d44-a1d1-4e08-9729-c5d86f63f72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:06.527946 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef1d44-a1d1-4e08-9729-c5d86f63f72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:06.528239 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef1d44-a1d1-4e08-9729-c5d86f63f72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:06.528522 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef1d44-a1d1-4e08-9729-c5d86f63f72f admin admin] PATH_INFO: `/v3/projects/06441101a0b24f1cbe0e6adb2970640e` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:06.531277 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef1d44-a1d1-4e08-9729-c5d86f63f72f admin admin] RBAC: Authorizing `identity:delete_project(project_id=06441101a0b24f1cbe0e6adb2970640e)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:06.535662 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef1d44-a1d1-4e08-9729-c5d86f63f72f admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:06.606882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec96f8-0ece-4c3d-8fcf-b61ca1c0d262 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:06.612226 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1a27f-e71a-449a-bacc-978ca26a9fa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:06.612838 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1a27f-e71a-449a-bacc-978ca26a9fa2 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:06.613139 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1a27f-e71a-449a-bacc-978ca26a9fa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:06.613472 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1a27f-e71a-449a-bacc-978ca26a9fa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:06.634096 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1a27f-e71a-449a-bacc-978ca26a9fa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:06.642067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1a27f-e71a-449a-bacc-978ca26a9fa2 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:06.671346 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-08ef1d44-a1d1-4e08-9729-c5d86f63f72f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06441101a0b24f1cbe0e6adb2970640e', 'request_id': 'req-08ef1d44-a1d1-4e08-9729-c5d86f63f72f'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:06.671506 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 973/1950] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:06.685249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-08ef1d44-a1d1-4e08-9729-c5d86f63f72f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06441101a0b24f1cbe0e6adb2970640e', 'request_id': 'req-08ef1d44-a1d1-4e08-9729-c5d86f63f72f'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:06.690029 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:06.716825 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-08ef1d44-a1d1-4e08-9729-c5d86f63f72f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06441101a0b24f1cbe0e6adb2970640e', 'request_id': 'req-08ef1d44-a1d1-4e08-9729-c5d86f63f72f'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:06.730266 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-08ef1d44-a1d1-4e08-9729-c5d86f63f72f admin admin] The token cache is being invalidate because project 06441101a0b24f1cbe0e6adb2970640e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:06.730488 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-08ef1d44-a1d1-4e08-9729-c5d86f63f72f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:06.732662 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-08ef1d44-a1d1-4e08-9729-c5d86f63f72f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:06.735748 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 978/1951] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:06 2022] DELETE /identity/v3/projects/06441101a0b24f1cbe0e6adb2970640e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:06.741966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673deaaf-fc38-4e75-9f59-a5d741c7495a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:06.742440 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673deaaf-fc38-4e75-9f59-a5d741c7495a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:06.742676 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673deaaf-fc38-4e75-9f59-a5d741c7495a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:06.772088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-673deaaf-fc38-4e75-9f59-a5d741c7495a None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:06.773785 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-673deaaf-fc38-4e75-9f59-a5d741c7495a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:06.835540 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef1d44-a1d1-4e08-9729-c5d86f63f72f admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:06.838545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-08ef1d44-a1d1-4e08-9729-c5d86f63f72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:06.885665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 974/1952] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:06.894558 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f281a-8498-4d62-8f91-010db0a792aa None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:06.894861 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f281a-8498-4d62-8f91-010db0a792aa None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:06.895145 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f281a-8498-4d62-8f91-010db0a792aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:06.937458 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-819f281a-8498-4d62-8f91-010db0a792aa None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:06.939858 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-819f281a-8498-4d62-8f91-010db0a792aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:06.950522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 975/1953] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:06.961763 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef1d44-a1d1-4e08-9729-c5d86f63f72f admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:06.968340 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f281a-8498-4d62-8f91-010db0a792aa None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:06.987777 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3256f-b081-4310-899c-e8555a17fa12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:06.988748 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3256f-b081-4310-899c-e8555a17fa12 service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:06.989273 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3256f-b081-4310-899c-e8555a17fa12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:06.993288 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3256f-b081-4310-899c-e8555a17fa12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:07.001813 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f281a-8498-4d62-8f91-010db0a792aa None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:07.002943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-1db3256f-b081-4310-899c-e8555a17fa12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:07.021756 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be4333-4e9d-4c67-8d1d-0e1d5657b2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:07.023869 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be4333-4e9d-4c67-8d1d-0e1d5657b2ae admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:07.026716 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be4333-4e9d-4c67-8d1d-0e1d5657b2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:07.027371 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be4333-4e9d-4c67-8d1d-0e1d5657b2ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:07.029964 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be4333-4e9d-4c67-8d1d-0e1d5657b2ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:07.030725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be4333-4e9d-4c67-8d1d-0e1d5657b2ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:07.035342 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be4333-4e9d-4c67-8d1d-0e1d5657b2ae admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:07.070495 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 976/1954] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:07.075295 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be4333-4e9d-4c67-8d1d-0e1d5657b2ae admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:07.100576 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be4333-4e9d-4c67-8d1d-0e1d5657b2ae admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:07.115422 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066642a-9746-437e-87c9-3421e4e65c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:07.116107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066642a-9746-437e-87c9-3421e4e65c6e admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:07.116395 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066642a-9746-437e-87c9-3421e4e65c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:07.116674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066642a-9746-437e-87c9-3421e4e65c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:07.117378 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066642a-9746-437e-87c9-3421e4e65c6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:07.125769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066642a-9746-437e-87c9-3421e4e65c6e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:07.148810 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3256f-b081-4310-899c-e8555a17fa12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:07.151696 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3256f-b081-4310-899c-e8555a17fa12 service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:07.171289 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 979/1955] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:34:07.189778 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 977/1956] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:07 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:34:07.194098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3256f-b081-4310-899c-e8555a17fa12 service cinder] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:07.223821 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3256f-b081-4310-899c-e8555a17fa12 service cinder] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:07.248909 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066642a-9746-437e-87c9-3421e4e65c6e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:07.252868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3066642a-9746-437e-87c9-3421e4e65c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:07.311462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:07.321296 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbdcbc-f630-4d9c-a357-14d1494b5904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:07.322304 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbdcbc-f630-4d9c-a357-14d1494b5904 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:07.322737 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbdcbc-f630-4d9c-a357-14d1494b5904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:07.323245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbdcbc-f630-4d9c-a357-14d1494b5904 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:07.324057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbdcbc-f630-4d9c-a357-14d1494b5904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:07.328151 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbdcbc-f630-4d9c-a357-14d1494b5904 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:07.359264 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 980/1957] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:07 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:07.362904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbdcbc-f630-4d9c-a357-14d1494b5904 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:07.377259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbdcbc-f630-4d9c-a357-14d1494b5904 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:07.384296 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd74ae-64cf-4c20-a582-4af8251a1826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:07.385255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd74ae-64cf-4c20-a582-4af8251a1826 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:07.386267 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd74ae-64cf-4c20-a582-4af8251a1826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:07.387487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd74ae-64cf-4c20-a582-4af8251a1826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:07.388468 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd74ae-64cf-4c20-a582-4af8251a1826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:07.390822 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd74ae-64cf-4c20-a582-4af8251a1826 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:07.392233 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066642a-9746-437e-87c9-3421e4e65c6e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:07.403071 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f32f2-6442-4aca-b5a3-9d40b85a6f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:07.404667 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 981/1958] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:07.406710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f32f2-6442-4aca-b5a3-9d40b85a6f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:07.407182 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f32f2-6442-4aca-b5a3-9d40b85a6f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:07.407474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f32f2-6442-4aca-b5a3-9d40b85a6f43 admin admin] PATH_INFO: `/v3/users/da294dbddf6e4d84b33312d2bc39f6a9` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:07.408725 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd74ae-64cf-4c20-a582-4af8251a1826 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:07.409898 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f32f2-6442-4aca-b5a3-9d40b85a6f43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da294dbddf6e4d84b33312d2bc39f6a9)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:07.416508 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f32f2-6442-4aca-b5a3-9d40b85a6f43 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:07.426790 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd74ae-64cf-4c20-a582-4af8251a1826 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:07.441924 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92881f98-9123-4060-9a8f-8e0b5f840e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:07.443707 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92881f98-9123-4060-9a8f-8e0b5f840e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:07.444131 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92881f98-9123-4060-9a8f-8e0b5f840e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:07.444525 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92881f98-9123-4060-9a8f-8e0b5f840e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:07.447357 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92881f98-9123-4060-9a8f-8e0b5f840e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:07.450011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92881f98-9123-4060-9a8f-8e0b5f840e10 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:07.468098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 982/1959] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:07.469627 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8a58a-ff04-4523-a587-4326b4cde10c None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:07.470020 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8a58a-ff04-4523-a587-4326b4cde10c None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:07.470635 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8a58a-ff04-4523-a587-4326b4cde10c None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:07.472146 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 983/1960] 10.222.0.25 () {54 vars in 921 bytes} [Mon May 23 12:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:34:07.473849 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8a58a-ff04-4523-a587-4326b4cde10c None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:07.495749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8a58a-ff04-4523-a587-4326b4cde10c None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:07.507283 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a741709-9558-4a50-abf3-014b6014714e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:07.510420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a741709-9558-4a50-abf3-014b6014714e admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:07.510912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a741709-9558-4a50-abf3-014b6014714e admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:07.511308 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a741709-9558-4a50-abf3-014b6014714e admin admin] PATH_INFO: `/v3/projects/0518825f1c5646f489151675b0ff151c/users/38921d99474542d19d661e582fdc154e/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:07.518990 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9d9f32f2-6442-4aca-b5a3-9d40b85a6f43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da294dbddf6e4d84b33312d2bc39f6a9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:07.520227 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:07.532249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9d9f32f2-6442-4aca-b5a3-9d40b85a6f43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da294dbddf6e4d84b33312d2bc39f6a9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:07.532889 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9d9f32f2-6442-4aca-b5a3-9d40b85a6f43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da294dbddf6e4d84b33312d2bc39f6a9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:07.533681 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9d9f32f2-6442-4aca-b5a3-9d40b85a6f43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da294dbddf6e4d84b33312d2bc39f6a9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:07.546978 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a741709-9558-4a50-abf3-014b6014714e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0518825f1c5646f489151675b0ff151c, user_id=38921d99474542d19d661e582fdc154e, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:07.555890 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9d9f32f2-6442-4aca-b5a3-9d40b85a6f43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da294dbddf6e4d84b33312d2bc39f6a9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:07.556550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a741709-9558-4a50-abf3-014b6014714e admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:07.577611 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 978/1961] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:07 2022] DELETE /identity/v3/users/da294dbddf6e4d84b33312d2bc39f6a9 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:07.581346 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28afe0e-3349-4f4c-bf04-6e36d34f089b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:07.581500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 984/1962] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:07 2022] PUT /identity/v3/projects/0518825f1c5646f489151675b0ff151c/users/38921d99474542d19d661e582fdc154e/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:07.581587 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28afe0e-3349-4f4c-bf04-6e36d34f089b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:07.581587 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28afe0e-3349-4f4c-bf04-6e36d34f089b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:07.586038 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31066291-69c9-470b-a433-6f9fdf4b52a3 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:07.586345 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31066291-69c9-470b-a433-6f9fdf4b52a3 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:07.588462 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31066291-69c9-470b-a433-6f9fdf4b52a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:07.618780 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-31066291-69c9-470b-a433-6f9fdf4b52a3 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:07.620875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-31066291-69c9-470b-a433-6f9fdf4b52a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:07.646113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d28afe0e-3349-4f4c-bf04-6e36d34f089b None None] MFA Rules not processed for user `a3fde90ab1e0490ebb7cb514173d984e`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:07.652539 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d28afe0e-3349-4f4c-bf04-6e36d34f089b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:07.776160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 979/1963] 10.222.0.25 () {58 vars in 1018 bytes} [Mon May 23 12:34:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:07.778408 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33db811-2710-4207-a5dc-ce54fb2ec8de None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:07.778857 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33db811-2710-4207-a5dc-ce54fb2ec8de None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:07.779419 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33db811-2710-4207-a5dc-ce54fb2ec8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:07.783688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 985/1964] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:07.784695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31066291-69c9-470b-a433-6f9fdf4b52a3 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:07.786078 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-31066291-69c9-470b-a433-6f9fdf4b52a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:07.801180 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31066291-69c9-470b-a433-6f9fdf4b52a3 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:07.807099 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a78e4-d5e3-4986-bae7-e5fb8d0e15f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:07.808346 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a78e4-d5e3-4986-bae7-e5fb8d0e15f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:07.808733 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a78e4-d5e3-4986-bae7-e5fb8d0e15f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:07.809114 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a78e4-d5e3-4986-bae7-e5fb8d0e15f9 admin admin] PATH_INFO: `/v3/users/d662d743df1f47e88185e9ac3412ef43` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:07.810474 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a78e4-d5e3-4986-bae7-e5fb8d0e15f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d662d743df1f47e88185e9ac3412ef43)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:07.812592 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a78e4-d5e3-4986-bae7-e5fb8d0e15f9 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:07.823613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d33db811-2710-4207-a5dc-ce54fb2ec8de None None] MFA Rules not processed for user `38921d99474542d19d661e582fdc154e`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:07.825885 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d33db811-2710-4207-a5dc-ce54fb2ec8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:07.870892 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-7f4a78e4-d5e3-4986-bae7-e5fb8d0e15f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd662d743df1f47e88185e9ac3412ef43'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:07.871976 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:07.881529 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-7f4a78e4-d5e3-4986-bae7-e5fb8d0e15f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd662d743df1f47e88185e9ac3412ef43'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:07.900405 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-7f4a78e4-d5e3-4986-bae7-e5fb8d0e15f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd662d743df1f47e88185e9ac3412ef43'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:07.905396 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 980/1965] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:07.906686 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33db811-2710-4207-a5dc-ce54fb2ec8de None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:07.908245 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d33db811-2710-4207-a5dc-ce54fb2ec8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:07.908739 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-7f4a78e4-d5e3-4986-bae7-e5fb8d0e15f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd662d743df1f47e88185e9ac3412ef43'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:07.909520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-7f4a78e4-d5e3-4986-bae7-e5fb8d0e15f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd662d743df1f47e88185e9ac3412ef43'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:07.916455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 986/1966] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:07 2022] DELETE /identity/v3/users/d662d743df1f47e88185e9ac3412ef43 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:07.920207 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a78e4-d5e3-4986-bae7-e5fb8d0e15f9 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:07.921776 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-7f4a78e4-d5e3-4986-bae7-e5fb8d0e15f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:07.925712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33db811-2710-4207-a5dc-ce54fb2ec8de None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:08.012785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a78e4-d5e3-4986-bae7-e5fb8d0e15f9 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:08.017733 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ebc5a-b8dc-4a13-8dae-b0b024c9ec48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:08.018119 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ebc5a-b8dc-4a13-8dae-b0b024c9ec48 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.018428 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ebc5a-b8dc-4a13-8dae-b0b024c9ec48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.019142 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ebc5a-b8dc-4a13-8dae-b0b024c9ec48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.020836 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ce0ebc5a-b8dc-4a13-8dae-b0b024c9ec48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:08.024149 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e8356-ca93-4856-9655-fdb958328e65 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fde90ab1e0490ebb7cb514173d984e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:08.025685 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e8356-ca93-4856-9655-fdb958328e65 service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.026159 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e8356-ca93-4856-9655-fdb958328e65 service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.028493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e8356-ca93-4856-9655-fdb958328e65 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.030379 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-941e8356-ca93-4856-9655-fdb958328e65 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:08.032923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:08.046847 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e8356-ca93-4856-9655-fdb958328e65 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:08.049109 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e8356-ca93-4856-9655-fdb958328e65 service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:08.068527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 981/1967] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:08.070418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e8356-ca93-4856-9655-fdb958328e65 service placement] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:08.072057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-941e8356-ca93-4856-9655-fdb958328e65 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:08.135281 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ebc5a-b8dc-4a13-8dae-b0b024c9ec48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:08.136873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ebc5a-b8dc-4a13-8dae-b0b024c9ec48 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:08.168417 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 987/1968] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:08.179273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e8356-ca93-4856-9655-fdb958328e65 service placement] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:08.188239 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b26c16-d6ad-43be-9519-175757079988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:08.189515 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b26c16-d6ad-43be-9519-175757079988 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.190081 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b26c16-d6ad-43be-9519-175757079988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.190377 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b26c16-d6ad-43be-9519-175757079988 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.191172 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b26c16-d6ad-43be-9519-175757079988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:08.193970 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b26c16-d6ad-43be-9519-175757079988 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:08.216095 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ebc5a-b8dc-4a13-8dae-b0b024c9ec48 service neutron] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:08.217793 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ce0ebc5a-b8dc-4a13-8dae-b0b024c9ec48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:08.240815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ebc5a-b8dc-4a13-8dae-b0b024c9ec48 service neutron] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:08.259620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0672a-4ccb-4b49-a65d-e5bc6c1fdd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:08.260898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0672a-4ccb-4b49-a65d-e5bc6c1fdd5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.261373 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0672a-4ccb-4b49-a65d-e5bc6c1fdd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.261900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0672a-4ccb-4b49-a65d-e5bc6c1fdd5e admin admin] PATH_INFO: `/v3/projects/4f55dfcc08704b20ae75695f9cd15b15` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.264966 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0672a-4ccb-4b49-a65d-e5bc6c1fdd5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f55dfcc08704b20ae75695f9cd15b15)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:08.268847 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 982/1969] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:08 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:08.269123 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0672a-4ccb-4b49-a65d-e5bc6c1fdd5e admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:08.274167 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b26c16-d6ad-43be-9519-175757079988 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:08.390485 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:08.391626 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-63b0672a-4ccb-4b49-a65d-e5bc6c1fdd5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f55dfcc08704b20ae75695f9cd15b15', 'request_id': 'req-63b0672a-4ccb-4b49-a65d-e5bc6c1fdd5e'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:08.407663 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-63b0672a-4ccb-4b49-a65d-e5bc6c1fdd5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f55dfcc08704b20ae75695f9cd15b15', 'request_id': 'req-63b0672a-4ccb-4b49-a65d-e5bc6c1fdd5e'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:08.407903 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b26c16-d6ad-43be-9519-175757079988 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:08.424192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-63b0672a-4ccb-4b49-a65d-e5bc6c1fdd5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f55dfcc08704b20ae75695f9cd15b15', 'request_id': 'req-63b0672a-4ccb-4b49-a65d-e5bc6c1fdd5e'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:08.449292 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-63b0672a-4ccb-4b49-a65d-e5bc6c1fdd5e admin admin] The token cache is being invalidate because project 4f55dfcc08704b20ae75695f9cd15b15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:08.449732 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-63b0672a-4ccb-4b49-a65d-e5bc6c1fdd5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:08.450487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-63b0672a-4ccb-4b49-a65d-e5bc6c1fdd5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:08.453391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 988/1970] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:08 2022] DELETE /identity/v3/projects/4f55dfcc08704b20ae75695f9cd15b15 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:08.458241 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb9854-fd4c-41c6-bfe1-273e90411c88 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.458863 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb9854-fd4c-41c6-bfe1-273e90411c88 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.460577 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb9854-fd4c-41c6-bfe1-273e90411c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.482971 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-5dbb9854-fd4c-41c6-bfe1-273e90411c88 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:08.484474 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-5dbb9854-fd4c-41c6-bfe1-273e90411c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:08.520513 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b9b11-3212-4ef8-ab55-a999b7c3d078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:08.522900 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b9b11-3212-4ef8-ab55-a999b7c3d078 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.523656 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b9b11-3212-4ef8-ab55-a999b7c3d078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.524091 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b9b11-3212-4ef8-ab55-a999b7c3d078 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.525554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b9b11-3212-4ef8-ab55-a999b7c3d078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:08.531702 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b9b11-3212-4ef8-ab55-a999b7c3d078 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:08.567644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 989/1971] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:34:08.568327 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 983/1972] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:08 2022] POST /identity/v3/users => generated 299 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:08.573329 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b9b11-3212-4ef8-ab55-a999b7c3d078 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:08.573596 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4091ae-870d-47a7-a77a-b52767a8c608 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.573885 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4091ae-870d-47a7-a77a-b52767a8c608 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.574122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4091ae-870d-47a7-a77a-b52767a8c608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.575961 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bb1b9b11-3212-4ef8-ab55-a999b7c3d078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:08.591829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b9b11-3212-4ef8-ab55-a999b7c3d078 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:08.593886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-ea4091ae-870d-47a7-a77a-b52767a8c608 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:08.595321 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ea4091ae-870d-47a7-a77a-b52767a8c608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:08.601045 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eda7c2-db59-4a61-8f8f-0b6a8854c274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:08.603937 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda7c2-db59-4a61-8f8f-0b6a8854c274 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.604384 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda7c2-db59-4a61-8f8f-0b6a8854c274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.605180 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda7c2-db59-4a61-8f8f-0b6a8854c274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.607072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eda7c2-db59-4a61-8f8f-0b6a8854c274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:08.610717 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eda7c2-db59-4a61-8f8f-0b6a8854c274 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:08.611133 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 990/1973] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:08.614749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4091ae-870d-47a7-a77a-b52767a8c608 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:08.628532 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4091ae-870d-47a7-a77a-b52767a8c608 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:08.630606 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 984/1974] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:08.635966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eda7c2-db59-4a61-8f8f-0b6a8854c274 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:08.638433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb981f3-8aa3-4ecb-9609-dd5d6b4c067b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:08.639317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb981f3-8aa3-4ecb-9609-dd5d6b4c067b admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.639745 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb981f3-8aa3-4ecb-9609-dd5d6b4c067b admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.640176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb981f3-8aa3-4ecb-9609-dd5d6b4c067b admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.641074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb981f3-8aa3-4ecb-9609-dd5d6b4c067b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:08.641550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb981f3-8aa3-4ecb-9609-dd5d6b4c067b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:08.643359 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb981f3-8aa3-4ecb-9609-dd5d6b4c067b admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:08.654994 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eda7c2-db59-4a61-8f8f-0b6a8854c274 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:08.657182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 991/1975] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:08.661563 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb981f3-8aa3-4ecb-9609-dd5d6b4c067b admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:08.663359 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d4719-aab9-44cc-a044-d995ded555b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:08.664462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d4719-aab9-44cc-a044-d995ded555b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.664968 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d4719-aab9-44cc-a044-d995ded555b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.665471 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d4719-aab9-44cc-a044-d995ded555b0 admin admin] PATH_INFO: `/v3/projects/5f78ec0d322c45fa85af72988d09668a/users/cfeadddaed294ae1b4e9f99a53a9679c/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.673722 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb981f3-8aa3-4ecb-9609-dd5d6b4c067b admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:08.681772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72c51b-5fca-46d0-b6ab-c845bc1568e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:08.684285 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d4719-aab9-44cc-a044-d995ded555b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f78ec0d322c45fa85af72988d09668a, user_id=cfeadddaed294ae1b4e9f99a53a9679c, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:08.688215 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d4719-aab9-44cc-a044-d995ded555b0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:08.689264 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72c51b-5fca-46d0-b6ab-c845bc1568e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.689689 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72c51b-5fca-46d0-b6ab-c845bc1568e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.690022 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72c51b-5fca-46d0-b6ab-c845bc1568e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.690943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72c51b-5fca-46d0-b6ab-c845bc1568e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:08.693725 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72c51b-5fca-46d0-b6ab-c845bc1568e5 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:08.709369 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 985/1976] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:08 2022] PUT /identity/v3/projects/5f78ec0d322c45fa85af72988d09668a/users/cfeadddaed294ae1b4e9f99a53a9679c/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:08.713671 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d4719-aab9-44cc-a044-d995ded555b0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:08.819340 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:08.842701 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d4719-aab9-44cc-a044-d995ded555b0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:08.853674 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 992/1977] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:08 2022] POST /identity/v3/projects => generated 365 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:34:08.856417 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72c51b-5fca-46d0-b6ab-c845bc1568e5 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:08.857099 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738136b-9106-4333-a194-567a6d1cb6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:08.857795 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738136b-9106-4333-a194-567a6d1cb6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:08.858083 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738136b-9106-4333-a194-567a6d1cb6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:08.858360 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738136b-9106-4333-a194-567a6d1cb6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:08.859551 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738136b-9106-4333-a194-567a6d1cb6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:08.861197 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738136b-9106-4333-a194-567a6d1cb6d5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:08.863433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-8a72c51b-5fca-46d0-b6ab-c845bc1568e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:08.892202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 986/1978] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:08.892202 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738136b-9106-4333-a194-567a6d1cb6d5 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:08.913787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738136b-9106-4333-a194-567a6d1cb6d5 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:09.011088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:09.028933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72c51b-5fca-46d0-b6ab-c845bc1568e5 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:09.036681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d115b-c4d4-4769-8b79-9bfca3de3bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:09.039846 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fde7d-83c4-4f77-a352-d978bc411f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:09.040842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fde7d-83c4-4f77-a352-d978bc411f71 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:09.041601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fde7d-83c4-4f77-a352-d978bc411f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:09.042095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fde7d-83c4-4f77-a352-d978bc411f71 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:09.043052 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fde7d-83c4-4f77-a352-d978bc411f71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:09.046296 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fde7d-83c4-4f77-a352-d978bc411f71 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:09.051479 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d115b-c4d4-4769-8b79-9bfca3de3bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:09.051800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d115b-c4d4-4769-8b79-9bfca3de3bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:09.052390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d115b-c4d4-4769-8b79-9bfca3de3bfc admin admin] PATH_INFO: `/v3/projects/982b384989a246f8a11dec3f9c0b7c3f` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:09.054088 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d115b-c4d4-4769-8b79-9bfca3de3bfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=982b384989a246f8a11dec3f9c0b7c3f)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:09.057080 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d115b-c4d4-4769-8b79-9bfca3de3bfc admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:09.082437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 987/1979] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:08 2022] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:09.083940 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fde7d-83c4-4f77-a352-d978bc411f71 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:09.128680 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fde7d-83c4-4f77-a352-d978bc411f71 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:09.157566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0c2d115b-c4d4-4769-8b79-9bfca3de3bfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '982b384989a246f8a11dec3f9c0b7c3f', 'request_id': 'req-0c2d115b-c4d4-4769-8b79-9bfca3de3bfc'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:09.166786 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0c2d115b-c4d4-4769-8b79-9bfca3de3bfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '982b384989a246f8a11dec3f9c0b7c3f', 'request_id': 'req-0c2d115b-c4d4-4769-8b79-9bfca3de3bfc'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:09.178733 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0c2d115b-c4d4-4769-8b79-9bfca3de3bfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '982b384989a246f8a11dec3f9c0b7c3f', 'request_id': 'req-0c2d115b-c4d4-4769-8b79-9bfca3de3bfc'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:09.213855 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0c2d115b-c4d4-4769-8b79-9bfca3de3bfc admin admin] The token cache is being invalidate because project 982b384989a246f8a11dec3f9c0b7c3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:09.214160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0c2d115b-c4d4-4769-8b79-9bfca3de3bfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:09.215107 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0c2d115b-c4d4-4769-8b79-9bfca3de3bfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:09.217082 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 993/1980] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:08 2022] DELETE /identity/v3/projects/982b384989a246f8a11dec3f9c0b7c3f => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:09.221034 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d115b-c4d4-4769-8b79-9bfca3de3bfc admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:09.223109 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-0c2d115b-c4d4-4769-8b79-9bfca3de3bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:09.239438 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b213fb-a360-49bf-b8f9-cde2bfbbcf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:09.240121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b213fb-a360-49bf-b8f9-cde2bfbbcf75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:09.240411 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b213fb-a360-49bf-b8f9-cde2bfbbcf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:09.240691 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b213fb-a360-49bf-b8f9-cde2bfbbcf75 admin admin] PATH_INFO: `/v3/projects/5f78ec0d322c45fa85af72988d09668a/users/cfeadddaed294ae1b4e9f99a53a9679c/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:09.243247 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b213fb-a360-49bf-b8f9-cde2bfbbcf75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f78ec0d322c45fa85af72988d09668a, user_id=cfeadddaed294ae1b4e9f99a53a9679c, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:09.246994 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b213fb-a360-49bf-b8f9-cde2bfbbcf75 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:09.259536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 988/1981] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:09 2022] PUT /identity/v3/projects/5f78ec0d322c45fa85af72988d09668a/users/cfeadddaed294ae1b4e9f99a53a9679c/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:09.260081 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b213fb-a360-49bf-b8f9-cde2bfbbcf75 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:09.269159 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-25b213fb-a360-49bf-b8f9-cde2bfbbcf75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:09.330099 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d115b-c4d4-4769-8b79-9bfca3de3bfc admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:09.347930 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b213fb-a360-49bf-b8f9-cde2bfbbcf75 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:09.355280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b37330-fdd8-4346-bedf-301b53b148e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:09.356308 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b37330-fdd8-4346-bedf-301b53b148e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:09.356663 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b37330-fdd8-4346-bedf-301b53b148e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:09.357037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b37330-fdd8-4346-bedf-301b53b148e1 admin admin] PATH_INFO: `/v3/users/cddc7ccb932941c09074b53fb26fc27a` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:09.358425 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b37330-fdd8-4346-bedf-301b53b148e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cddc7ccb932941c09074b53fb26fc27a)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:09.360599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b37330-fdd8-4346-bedf-301b53b148e1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:09.370799 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:09.427732 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d590eb-9719-4467-acea-7db9a2917747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:09.428417 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d590eb-9719-4467-acea-7db9a2917747 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:09.428706 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d590eb-9719-4467-acea-7db9a2917747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:09.429134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d590eb-9719-4467-acea-7db9a2917747 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:09.430197 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d590eb-9719-4467-acea-7db9a2917747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:09.432046 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-58b37330-fdd8-4346-bedf-301b53b148e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cddc7ccb932941c09074b53fb26fc27a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:09.432658 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d590eb-9719-4467-acea-7db9a2917747 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:09.445041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 994/1982] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:09.446719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccbbab-ef2c-4ee9-bc89-728d12e82789 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:09.447026 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccbbab-ef2c-4ee9-bc89-728d12e82789 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:09.447350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccbbab-ef2c-4ee9-bc89-728d12e82789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:09.449179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-58b37330-fdd8-4346-bedf-301b53b148e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cddc7ccb932941c09074b53fb26fc27a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:09.450938 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-58b37330-fdd8-4346-bedf-301b53b148e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cddc7ccb932941c09074b53fb26fc27a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:09.454160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-58b37330-fdd8-4346-bedf-301b53b148e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cddc7ccb932941c09074b53fb26fc27a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:09.469314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-58b37330-fdd8-4346-bedf-301b53b148e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cddc7ccb932941c09074b53fb26fc27a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:09.476301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:09.487878 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 989/1983] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:09 2022] DELETE /identity/v3/users/cddc7ccb932941c09074b53fb26fc27a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:09.489153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b37330-fdd8-4346-bedf-301b53b148e1 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:09.491483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-58b37330-fdd8-4346-bedf-301b53b148e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:09.497574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-daccbbab-ef2c-4ee9-bc89-728d12e82789 None None] MFA Rules not processed for user `cfeadddaed294ae1b4e9f99a53a9679c`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:09.499200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-daccbbab-ef2c-4ee9-bc89-728d12e82789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:09.629979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b37330-fdd8-4346-bedf-301b53b148e1 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:09.637681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 995/1984] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:09.646232 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfdc63-fea3-46a9-84f3-e921979d25c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:09.646961 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfdc63-fea3-46a9-84f3-e921979d25c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:09.647251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfdc63-fea3-46a9-84f3-e921979d25c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:09.647535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfdc63-fea3-46a9-84f3-e921979d25c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:09.648279 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadfdc63-fea3-46a9-84f3-e921979d25c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:09.650453 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadfdc63-fea3-46a9-84f3-e921979d25c7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:09.653022 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccbbab-ef2c-4ee9-bc89-728d12e82789 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:09.655369 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-daccbbab-ef2c-4ee9-bc89-728d12e82789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:09.673379 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 990/1985] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:09.677530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfdc63-fea3-46a9-84f3-e921979d25c7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:09.728742 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfdc63-fea3-46a9-84f3-e921979d25c7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:09.737210 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e283b02-f888-42f9-ad3a-ce754ccfc59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:09.739154 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e283b02-f888-42f9-ad3a-ce754ccfc59b admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:09.739451 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e283b02-f888-42f9-ad3a-ce754ccfc59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:09.740233 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e283b02-f888-42f9-ad3a-ce754ccfc59b admin admin] PATH_INFO: `/v3/projects/2bd4060c85b54034b6e4452ad54dad9e/users/888c545cd2e44d4886704663594dd3d7/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:09.769738 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e283b02-f888-42f9-ad3a-ce754ccfc59b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd4060c85b54034b6e4452ad54dad9e, user_id=888c545cd2e44d4886704663594dd3d7, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:09.785615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e283b02-f888-42f9-ad3a-ce754ccfc59b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:09.807438 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccbbab-ef2c-4ee9-bc89-728d12e82789 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:09.819826 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 991/1986] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:09 2022] PUT /identity/v3/projects/2bd4060c85b54034b6e4452ad54dad9e/users/888c545cd2e44d4886704663594dd3d7/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:09.821497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7892f-2487-4aef-bcd1-60203b103ffd None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:09.822321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7892f-2487-4aef-bcd1-60203b103ffd None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:09.822637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7892f-2487-4aef-bcd1-60203b103ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:09.870228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ddfb7-a106-451b-bfda-bc7dde3ffef1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:09.870912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ddfb7-a106-451b-bfda-bc7dde3ffef1 service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:09.871210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ddfb7-a106-451b-bfda-bc7dde3ffef1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:09.871486 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ddfb7-a106-451b-bfda-bc7dde3ffef1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:09.883895 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9db7892f-2487-4aef-bcd1-60203b103ffd None None] MFA Rules not processed for user `888c545cd2e44d4886704663594dd3d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:09.886270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9db7892f-2487-4aef-bcd1-60203b103ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:09.903003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:09.971281 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ddfb7-a106-451b-bfda-bc7dde3ffef1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:09.972497 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ddfb7-a106-451b-bfda-bc7dde3ffef1 service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:09.980475 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 992/1987] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:34:09.981222 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7892f-2487-4aef-bcd1-60203b103ffd None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:09.982607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9db7892f-2487-4aef-bcd1-60203b103ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:09.983719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 996/1988] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:09.984483 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ddfb7-a106-451b-bfda-bc7dde3ffef1 service cinder] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:09.985735 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-f71ddfb7-a106-451b-bfda-bc7dde3ffef1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:09.995384 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7892f-2487-4aef-bcd1-60203b103ffd None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:09.999507 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013b6a2-addd-4c09-b2fc-36033e8e5c86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:10.000159 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013b6a2-addd-4c09-b2fc-36033e8e5c86 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:10.000450 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013b6a2-addd-4c09-b2fc-36033e8e5c86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:10.000730 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013b6a2-addd-4c09-b2fc-36033e8e5c86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:10.002607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0013b6a2-addd-4c09-b2fc-36033e8e5c86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:10.069286 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ddfb7-a106-451b-bfda-bc7dde3ffef1 service cinder] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:10.071012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:10.075451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7dafc-5143-47f8-a8f9-abe74a67e9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:10.076319 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7dafc-5143-47f8-a8f9-abe74a67e9be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:10.076614 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7dafc-5143-47f8-a8f9-abe74a67e9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:10.076893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7dafc-5143-47f8-a8f9-abe74a67e9be admin admin] PATH_INFO: `/v3/projects/4231a5866e2b4dea860420f3db3d715d` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:10.078948 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7dafc-5143-47f8-a8f9-abe74a67e9be admin admin] RBAC: Authorizing `identity:delete_project(project_id=4231a5866e2b4dea860420f3db3d715d)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:10.080447 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7dafc-5143-47f8-a8f9-abe74a67e9be admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:10.089451 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013b6a2-addd-4c09-b2fc-36033e8e5c86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:10.091031 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013b6a2-addd-4c09-b2fc-36033e8e5c86 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:10.101829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 993/1989] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:10.102720 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013b6a2-addd-4c09-b2fc-36033e8e5c86 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:10.104147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0013b6a2-addd-4c09-b2fc-36033e8e5c86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:10.129206 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013b6a2-addd-4c09-b2fc-36033e8e5c86 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:10.144105 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-32e7dafc-5143-47f8-a8f9-abe74a67e9be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4231a5866e2b4dea860420f3db3d715d', 'request_id': 'req-32e7dafc-5143-47f8-a8f9-abe74a67e9be'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:10.151940 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-32e7dafc-5143-47f8-a8f9-abe74a67e9be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4231a5866e2b4dea860420f3db3d715d', 'request_id': 'req-32e7dafc-5143-47f8-a8f9-abe74a67e9be'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:10.160712 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-32e7dafc-5143-47f8-a8f9-abe74a67e9be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4231a5866e2b4dea860420f3db3d715d', 'request_id': 'req-32e7dafc-5143-47f8-a8f9-abe74a67e9be'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:10.175343 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-32e7dafc-5143-47f8-a8f9-abe74a67e9be admin admin] The token cache is being invalidate because project 4231a5866e2b4dea860420f3db3d715d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:10.175661 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-32e7dafc-5143-47f8-a8f9-abe74a67e9be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:10.176581 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-32e7dafc-5143-47f8-a8f9-abe74a67e9be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:10.178758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 997/1990] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:09 2022] DELETE /identity/v3/projects/4231a5866e2b4dea860420f3db3d715d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:10.179789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7dafc-5143-47f8-a8f9-abe74a67e9be admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:10.185523 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-32e7dafc-5143-47f8-a8f9-abe74a67e9be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:10.215610 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90963cc2-5b20-4a84-8c82-e933035c44bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:10.217133 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90963cc2-5b20-4a84-8c82-e933035c44bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:10.217864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90963cc2-5b20-4a84-8c82-e933035c44bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:10.218652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90963cc2-5b20-4a84-8c82-e933035c44bf admin admin] PATH_INFO: `/v3/users/38921d99474542d19d661e582fdc154e` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:10.220399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90963cc2-5b20-4a84-8c82-e933035c44bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=38921d99474542d19d661e582fdc154e)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:10.222713 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90963cc2-5b20-4a84-8c82-e933035c44bf admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:10.250891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:10.268390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7dafc-5143-47f8-a8f9-abe74a67e9be admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:10.276175 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b1875-bf10-4665-a709-7fb48080b47a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:10.277013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b1875-bf10-4665-a709-7fb48080b47a service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:10.277150 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b1875-bf10-4665-a709-7fb48080b47a service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:10.277766 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b1875-bf10-4665-a709-7fb48080b47a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:10.280179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-fd1b1875-bf10-4665-a709-7fb48080b47a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:10.345436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-90963cc2-5b20-4a84-8c82-e933035c44bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38921d99474542d19d661e582fdc154e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:10.361910 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-90963cc2-5b20-4a84-8c82-e933035c44bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38921d99474542d19d661e582fdc154e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:10.362757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-90963cc2-5b20-4a84-8c82-e933035c44bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38921d99474542d19d661e582fdc154e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:10.363541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-90963cc2-5b20-4a84-8c82-e933035c44bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38921d99474542d19d661e582fdc154e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:10.376684 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b1875-bf10-4665-a709-7fb48080b47a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:10.378750 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b1875-bf10-4665-a709-7fb48080b47a service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:10.380820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-90963cc2-5b20-4a84-8c82-e933035c44bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38921d99474542d19d661e582fdc154e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:10.390339 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 998/1991] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:10.391891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e933402-b1a1-42ca-b3c1-a1701605fce8 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:10.392370 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e933402-b1a1-42ca-b3c1-a1701605fce8 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:10.392832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e933402-b1a1-42ca-b3c1-a1701605fce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:10.396771 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 994/1992] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:10 2022] DELETE /identity/v3/users/38921d99474542d19d661e582fdc154e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:10.401933 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9e3be-43bd-4344-bac6-06201e0202c5 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:10.402236 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9e3be-43bd-4344-bac6-06201e0202c5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:10.402543 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9e3be-43bd-4344-bac6-06201e0202c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:10.415113 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-6e933402-b1a1-42ca-b3c1-a1701605fce8 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:10.417234 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-6e933402-b1a1-42ca-b3c1-a1701605fce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:10.422413 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-bdd9e3be-43bd-4344-bac6-06201e0202c5 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:10.423656 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bdd9e3be-43bd-4344-bac6-06201e0202c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:10.516665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 995/1993] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:34:10.517315 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 999/1994] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:10.530258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97867b6-063f-4447-b819-f9e4d5540f14 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:10.532102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97867b6-063f-4447-b819-f9e4d5540f14 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:10.532430 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97867b6-063f-4447-b819-f9e4d5540f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:10.538339 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9e3be-43bd-4344-bac6-06201e0202c5 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:10.541546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bdd9e3be-43bd-4344-bac6-06201e0202c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:10.569385 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-b97867b6-063f-4447-b819-f9e4d5540f14 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:10.570872 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-b97867b6-063f-4447-b819-f9e4d5540f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:10.571745 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:10.592844 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1000/1995] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:10.593404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97867b6-063f-4447-b819-f9e4d5540f14 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:10.595097 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-b97867b6-063f-4447-b819-f9e4d5540f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:10.609575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97867b6-063f-4447-b819-f9e4d5540f14 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:10.615726 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fa04e-fd07-41e8-84c4-4b65cc297896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:10.617014 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fa04e-fd07-41e8-84c4-4b65cc297896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:10.617301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fa04e-fd07-41e8-84c4-4b65cc297896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:10.617998 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fa04e-fd07-41e8-84c4-4b65cc297896 admin admin] PATH_INFO: `/v3/users/28b4d3863cfa4387b22598efee859dae` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:10.620124 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0fa04e-fd07-41e8-84c4-4b65cc297896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28b4d3863cfa4387b22598efee859dae)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:10.622560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0fa04e-fd07-41e8-84c4-4b65cc297896 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:10.666383 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9e3be-43bd-4344-bac6-06201e0202c5 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:10.671578 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d1f72-cd21-48dd-b9db-b5b83289c0ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:10.672294 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d1f72-cd21-48dd-b9db-b5b83289c0ab service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:10.672585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d1f72-cd21-48dd-b9db-b5b83289c0ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:10.672872 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d1f72-cd21-48dd-b9db-b5b83289c0ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:10.685755 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d1f72-cd21-48dd-b9db-b5b83289c0ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:10.687452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d1f72-cd21-48dd-b9db-b5b83289c0ab service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:10.691278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-7e0fa04e-fd07-41e8-84c4-4b65cc297896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28b4d3863cfa4387b22598efee859dae'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:10.699140 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 996/1996] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:10.700064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d1f72-cd21-48dd-b9db-b5b83289c0ab service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:10.701745 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-7e0fa04e-fd07-41e8-84c4-4b65cc297896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28b4d3863cfa4387b22598efee859dae'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:10.712511 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d1f72-cd21-48dd-b9db-b5b83289c0ab service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:10.719432 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-7e0fa04e-fd07-41e8-84c4-4b65cc297896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28b4d3863cfa4387b22598efee859dae'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:10.719906 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671c1eb-8e93-442f-ac07-d34d462fed7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:10.720657 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671c1eb-8e93-442f-ac07-d34d462fed7f admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:10.721109 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671c1eb-8e93-442f-ac07-d34d462fed7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:10.721459 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671c1eb-8e93-442f-ac07-d34d462fed7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:10.722196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671c1eb-8e93-442f-ac07-d34d462fed7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:10.722559 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671c1eb-8e93-442f-ac07-d34d462fed7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:10.724500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671c1eb-8e93-442f-ac07-d34d462fed7f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:10.729343 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-7e0fa04e-fd07-41e8-84c4-4b65cc297896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28b4d3863cfa4387b22598efee859dae'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:10.730217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-7e0fa04e-fd07-41e8-84c4-4b65cc297896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28b4d3863cfa4387b22598efee859dae'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:10.740179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1001/1997] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:10 2022] DELETE /identity/v3/users/28b4d3863cfa4387b22598efee859dae => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:10.740460 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 997/1998] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:10.744758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2e6a5-572d-4494-a315-7c31ba6e9278 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:10.744758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2e6a5-572d-4494-a315-7c31ba6e9278 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:10.744758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2e6a5-572d-4494-a315-7c31ba6e9278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:10.745724 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671c1eb-8e93-442f-ac07-d34d462fed7f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:10.748678 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a671c1eb-8e93-442f-ac07-d34d462fed7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:10.753046 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:10.770035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-97a2e6a5-572d-4494-a315-7c31ba6e9278 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:10.771369 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-97a2e6a5-572d-4494-a315-7c31ba6e9278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:10.772666 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671c1eb-8e93-442f-ac07-d34d462fed7f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:10.860367 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd11293-2c2d-48b6-ad89-6f7862ba334a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:10.861237 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd11293-2c2d-48b6-ad89-6f7862ba334a admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:10.861499 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd11293-2c2d-48b6-ad89-6f7862ba334a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:10.861779 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd11293-2c2d-48b6-ad89-6f7862ba334a admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:10.862475 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd11293-2c2d-48b6-ad89-6f7862ba334a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:10.864548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd11293-2c2d-48b6-ad89-6f7862ba334a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:10.875364 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1002/1999] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:34:10.882464 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2e6a5-572d-4494-a315-7c31ba6e9278 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:10.884723 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-97a2e6a5-572d-4494-a315-7c31ba6e9278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:10.905505 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 998/2000] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:10 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:10.910149 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd11293-2c2d-48b6-ad89-6f7862ba334a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:10.973399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2e6a5-572d-4494-a315-7c31ba6e9278 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.000704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd11293-2c2d-48b6-ad89-6f7862ba334a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.005615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702150f-b740-4d14-b020-af016fcc9b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.006301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702150f-b740-4d14-b020-af016fcc9b17 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.006670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702150f-b740-4d14-b020-af016fcc9b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.007096 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702150f-b740-4d14-b020-af016fcc9b17 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.007801 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702150f-b740-4d14-b020-af016fcc9b17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.009953 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702150f-b740-4d14-b020-af016fcc9b17 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.031064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 999/2001] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:10 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:34:11.035719 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702150f-b740-4d14-b020-af016fcc9b17 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:11.040322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08262e58-5b0d-4c03-9b14-4cc8d800b6da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.041764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08262e58-5b0d-4c03-9b14-4cc8d800b6da service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.042229 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08262e58-5b0d-4c03-9b14-4cc8d800b6da service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.042725 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08262e58-5b0d-4c03-9b14-4cc8d800b6da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.046281 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702150f-b740-4d14-b020-af016fcc9b17 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.051545 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71545cff-07e1-47dd-9efa-4c3fdfecaaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.052270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71545cff-07e1-47dd-9efa-4c3fdfecaaa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.052494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71545cff-07e1-47dd-9efa-4c3fdfecaaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.052775 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71545cff-07e1-47dd-9efa-4c3fdfecaaa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.053509 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71545cff-07e1-47dd-9efa-4c3fdfecaaa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.053928 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08262e58-5b0d-4c03-9b14-4cc8d800b6da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.055165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71545cff-07e1-47dd-9efa-4c3fdfecaaa4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.056495 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08262e58-5b0d-4c03-9b14-4cc8d800b6da service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.065928 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1000/2002] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:11.069650 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1003/2003] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:11.070094 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71545cff-07e1-47dd-9efa-4c3fdfecaaa4 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:11.075462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:11.081625 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71545cff-07e1-47dd-9efa-4c3fdfecaaa4 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.087759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089705d-c05c-4055-aeac-e8af44f65b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.088588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089705d-c05c-4055-aeac-e8af44f65b7c admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.088873 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089705d-c05c-4055-aeac-e8af44f65b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.089153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089705d-c05c-4055-aeac-e8af44f65b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.089864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089705d-c05c-4055-aeac-e8af44f65b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.091530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089705d-c05c-4055-aeac-e8af44f65b7c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.102541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1001/2004] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:34:11.107158 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08262e58-5b0d-4c03-9b14-4cc8d800b6da service neutron] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:11.123769 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08262e58-5b0d-4c03-9b14-4cc8d800b6da service neutron] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.129172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefb474-2e6c-4286-b479-763a4c94a615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.129985 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089705d-c05c-4055-aeac-e8af44f65b7c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:11.130096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefb474-2e6c-4286-b479-763a4c94a615 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.130345 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefb474-2e6c-4286-b479-763a4c94a615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.130675 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefb474-2e6c-4286-b479-763a4c94a615 admin admin] PATH_INFO: `/v3/projects/6a89aaa47fbf4f4793dd8513527f1acc/users/8d839a7a0ceb41fbbb2adf79daf01474/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.131793 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b089705d-c05c-4055-aeac-e8af44f65b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:11.147209 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089705d-c05c-4055-aeac-e8af44f65b7c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.148310 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefb474-2e6c-4286-b479-763a4c94a615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a89aaa47fbf4f4793dd8513527f1acc, user_id=8d839a7a0ceb41fbbb2adf79daf01474, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.151631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefb474-2e6c-4286-b479-763a4c94a615 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.153143 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935edfaa-8284-49ff-954c-db08545e768f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.154043 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935edfaa-8284-49ff-954c-db08545e768f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.154423 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935edfaa-8284-49ff-954c-db08545e768f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.155679 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935edfaa-8284-49ff-954c-db08545e768f admin admin] PATH_INFO: `/v3/projects/0518825f1c5646f489151675b0ff151c` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.156615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935edfaa-8284-49ff-954c-db08545e768f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0518825f1c5646f489151675b0ff151c)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.162732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935edfaa-8284-49ff-954c-db08545e768f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.173357 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1004/2005] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:11 2022] PUT /identity/v3/projects/6a89aaa47fbf4f4793dd8513527f1acc/users/8d839a7a0ceb41fbbb2adf79daf01474/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:11.186618 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089f485-fe1d-4186-a0ed-1e37212aaf4e None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.186618 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089f485-fe1d-4186-a0ed-1e37212aaf4e None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.186618 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089f485-fe1d-4186-a0ed-1e37212aaf4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.217937 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-8089f485-fe1d-4186-a0ed-1e37212aaf4e None None] MFA Rules not processed for user `8d839a7a0ceb41fbbb2adf79daf01474`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:11.219590 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-8089f485-fe1d-4186-a0ed-1e37212aaf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:11.229914 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-935edfaa-8284-49ff-954c-db08545e768f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0518825f1c5646f489151675b0ff151c', 'request_id': 'req-935edfaa-8284-49ff-954c-db08545e768f'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:11.238213 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-935edfaa-8284-49ff-954c-db08545e768f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0518825f1c5646f489151675b0ff151c', 'request_id': 'req-935edfaa-8284-49ff-954c-db08545e768f'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:11.244648 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-935edfaa-8284-49ff-954c-db08545e768f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0518825f1c5646f489151675b0ff151c', 'request_id': 'req-935edfaa-8284-49ff-954c-db08545e768f'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:11.259846 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:11.270728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-935edfaa-8284-49ff-954c-db08545e768f admin admin] The token cache is being invalidate because project 0518825f1c5646f489151675b0ff151c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:11.271743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-935edfaa-8284-49ff-954c-db08545e768f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:11.272487 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-935edfaa-8284-49ff-954c-db08545e768f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:11.274693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1002/2006] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:11 2022] DELETE /identity/v3/projects/0518825f1c5646f489151675b0ff151c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:11.278671 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935edfaa-8284-49ff-954c-db08545e768f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:11.281822 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-935edfaa-8284-49ff-954c-db08545e768f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:11.304130 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1005/2007] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:34:11.308501 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089f485-fe1d-4186-a0ed-1e37212aaf4e None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:11.310134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-8089f485-fe1d-4186-a0ed-1e37212aaf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:11.351474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935edfaa-8284-49ff-954c-db08545e768f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.357914 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed85c3-f9e0-4f28-b4ca-3d052337f2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.358859 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed85c3-f9e0-4f28-b4ca-3d052337f2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.359185 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed85c3-f9e0-4f28-b4ca-3d052337f2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.359399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed85c3-f9e0-4f28-b4ca-3d052337f2ee admin admin] PATH_INFO: `/v3/users/cfeadddaed294ae1b4e9f99a53a9679c` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.360802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed85c3-f9e0-4f28-b4ca-3d052337f2ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfeadddaed294ae1b4e9f99a53a9679c)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.362824 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed85c3-f9e0-4f28-b4ca-3d052337f2ee admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.397056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089f485-fe1d-4186-a0ed-1e37212aaf4e None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.404414 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb275468-6856-4320-a132-551708ad9508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.405273 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb275468-6856-4320-a132-551708ad9508 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.405668 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb275468-6856-4320-a132-551708ad9508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.406077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb275468-6856-4320-a132-551708ad9508 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.407002 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb275468-6856-4320-a132-551708ad9508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.409753 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb275468-6856-4320-a132-551708ad9508 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.427234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9eed85c3-f9e0-4f28-b4ca-3d052337f2ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfeadddaed294ae1b4e9f99a53a9679c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:11.441532 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1006/2008] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:11 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:34:11.442634 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb275468-6856-4320-a132-551708ad9508 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:11.444961 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-cb275468-6856-4320-a132-551708ad9508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:11.445228 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9eed85c3-f9e0-4f28-b4ca-3d052337f2ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfeadddaed294ae1b4e9f99a53a9679c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:11.447336 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9eed85c3-f9e0-4f28-b4ca-3d052337f2ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfeadddaed294ae1b4e9f99a53a9679c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:11.448344 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9eed85c3-f9e0-4f28-b4ca-3d052337f2ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfeadddaed294ae1b4e9f99a53a9679c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:11.463583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9eed85c3-f9e0-4f28-b4ca-3d052337f2ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfeadddaed294ae1b4e9f99a53a9679c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:11.468453 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:11.479535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1003/2009] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:11 2022] DELETE /identity/v3/users/cfeadddaed294ae1b4e9f99a53a9679c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:11.480492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed85c3-f9e0-4f28-b4ca-3d052337f2ee admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:11.481969 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9eed85c3-f9e0-4f28-b4ca-3d052337f2ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:11.529146 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb275468-6856-4320-a132-551708ad9508 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.554417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed85c3-f9e0-4f28-b4ca-3d052337f2ee admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.560365 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ef6e3-aa82-429e-a1e2-c07a4c62b6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.561026 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ef6e3-aa82-429e-a1e2-c07a4c62b6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.561329 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ef6e3-aa82-429e-a1e2-c07a4c62b6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.561866 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ef6e3-aa82-429e-a1e2-c07a4c62b6c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.562826 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ef6e3-aa82-429e-a1e2-c07a4c62b6c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.565093 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ef6e3-aa82-429e-a1e2-c07a4c62b6c9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.591329 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1004/2010] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:11 2022] POST /identity/v3/users => generated 300 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:11.595091 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ef6e3-aa82-429e-a1e2-c07a4c62b6c9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:11.610925 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ef6e3-aa82-429e-a1e2-c07a4c62b6c9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.615012 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51fa4f-0e57-4bce-8232-c7f4539c3e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.615892 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51fa4f-0e57-4bce-8232-c7f4539c3e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.616002 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41de6c4-6136-4574-a413-f6df8c2305f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.616604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51fa4f-0e57-4bce-8232-c7f4539c3e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.616717 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41de6c4-6136-4574-a413-f6df8c2305f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.616952 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41de6c4-6136-4574-a413-f6df8c2305f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.617233 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41de6c4-6136-4574-a413-f6df8c2305f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.617419 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51fa4f-0e57-4bce-8232-c7f4539c3e0b admin admin] PATH_INFO: `/v3/projects/6aa1166c6a10423b88839b8b4ace0c6a` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.617967 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41de6c4-6136-4574-a413-f6df8c2305f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.619020 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51fa4f-0e57-4bce-8232-c7f4539c3e0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa1166c6a10423b88839b8b4ace0c6a)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.619684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41de6c4-6136-4574-a413-f6df8c2305f9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.621518 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51fa4f-0e57-4bce-8232-c7f4539c3e0b admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.624877 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:11.630967 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1005/2011] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:34:11.634722 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41de6c4-6136-4574-a413-f6df8c2305f9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:11.645510 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41de6c4-6136-4574-a413-f6df8c2305f9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.652666 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a12fd-72a5-4dda-9edc-5a01b8ef9cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.654305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a12fd-72a5-4dda-9edc-5a01b8ef9cec admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.655026 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a12fd-72a5-4dda-9edc-5a01b8ef9cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.655026 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a12fd-72a5-4dda-9edc-5a01b8ef9cec admin admin] PATH_INFO: `/v3/projects/736ffa8620f2474097520bd36b60c577/users/73764f1778ff417f942c957099acf57c/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.688976 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a12fd-72a5-4dda-9edc-5a01b8ef9cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=736ffa8620f2474097520bd36b60c577, user_id=73764f1778ff417f942c957099acf57c, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.698554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a12fd-72a5-4dda-9edc-5a01b8ef9cec admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.710663 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-cf51fa4f-0e57-4bce-8232-c7f4539c3e0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa1166c6a10423b88839b8b4ace0c6a', 'request_id': 'req-cf51fa4f-0e57-4bce-8232-c7f4539c3e0b'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:11.720272 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1006/2012] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:11 2022] PUT /identity/v3/projects/736ffa8620f2474097520bd36b60c577/users/73764f1778ff417f942c957099acf57c/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:11.721281 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-cf51fa4f-0e57-4bce-8232-c7f4539c3e0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa1166c6a10423b88839b8b4ace0c6a', 'request_id': 'req-cf51fa4f-0e57-4bce-8232-c7f4539c3e0b'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:11.722129 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a12fd-72a5-4dda-9edc-5a01b8ef9cec admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:11.738346 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-cf51fa4f-0e57-4bce-8232-c7f4539c3e0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa1166c6a10423b88839b8b4ace0c6a', 'request_id': 'req-cf51fa4f-0e57-4bce-8232-c7f4539c3e0b'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:11.761075 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-cf51fa4f-0e57-4bce-8232-c7f4539c3e0b admin admin] The token cache is being invalidate because project 6aa1166c6a10423b88839b8b4ace0c6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:11.761904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-cf51fa4f-0e57-4bce-8232-c7f4539c3e0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:11.762815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-cf51fa4f-0e57-4bce-8232-c7f4539c3e0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:11.764918 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1007/2013] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:11 2022] DELETE /identity/v3/projects/6aa1166c6a10423b88839b8b4ace0c6a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:11.769098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51fa4f-0e57-4bce-8232-c7f4539c3e0b admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:11.771253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-cf51fa4f-0e57-4bce-8232-c7f4539c3e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:11.824195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a12fd-72a5-4dda-9edc-5a01b8ef9cec admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.830132 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fe570-bc19-4e31-a9c0-0e418fa329ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.831809 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fe570-bc19-4e31-a9c0-0e418fa329ba admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.831809 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fe570-bc19-4e31-a9c0-0e418fa329ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.831809 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fe570-bc19-4e31-a9c0-0e418fa329ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.832262 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fe570-bc19-4e31-a9c0-0e418fa329ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.833956 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fe570-bc19-4e31-a9c0-0e418fa329ba admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.846230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1007/2014] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:11.850665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fe570-bc19-4e31-a9c0-0e418fa329ba admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:11.852594 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8d5fe570-bc19-4e31-a9c0-0e418fa329ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:11.867269 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51fa4f-0e57-4bce-8232-c7f4539c3e0b admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.873932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53d5ce-bc3b-4ea4-ac97-d4ce0eba10d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.874163 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fe570-bc19-4e31-a9c0-0e418fa329ba admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:11.874991 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53d5ce-bc3b-4ea4-ac97-d4ce0eba10d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.875347 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53d5ce-bc3b-4ea4-ac97-d4ce0eba10d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.875699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53d5ce-bc3b-4ea4-ac97-d4ce0eba10d6 admin admin] PATH_INFO: `/v3/users/2e6584b9db314fbf9d32ce12efa00ad5` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.877562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53d5ce-bc3b-4ea4-ac97-d4ce0eba10d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e6584b9db314fbf9d32ce12efa00ad5)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.879672 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53d5ce-bc3b-4ea4-ac97-d4ce0eba10d6 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.882792 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a6e2f-3b03-4037-9cc9-5998b9a7af29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:11.883796 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a6e2f-3b03-4037-9cc9-5998b9a7af29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:11.884117 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a6e2f-3b03-4037-9cc9-5998b9a7af29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:11.884397 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a6e2f-3b03-4037-9cc9-5998b9a7af29 admin admin] PATH_INFO: `/v3/projects/736ffa8620f2474097520bd36b60c577/users/73764f1778ff417f942c957099acf57c/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:11.886645 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a6e2f-3b03-4037-9cc9-5998b9a7af29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=736ffa8620f2474097520bd36b60c577, user_id=73764f1778ff417f942c957099acf57c, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:11.889575 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a6e2f-3b03-4037-9cc9-5998b9a7af29 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:11.905756 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1008/2015] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:11 2022] PUT /identity/v3/projects/736ffa8620f2474097520bd36b60c577/users/73764f1778ff417f942c957099acf57c/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:11.916339 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a6e2f-3b03-4037-9cc9-5998b9a7af29 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:11.918632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c31a6e2f-3b03-4037-9cc9-5998b9a7af29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:11.954030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-6c53d5ce-bc3b-4ea4-ac97-d4ce0eba10d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e6584b9db314fbf9d32ce12efa00ad5'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:11.965227 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-6c53d5ce-bc3b-4ea4-ac97-d4ce0eba10d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e6584b9db314fbf9d32ce12efa00ad5'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:11.982229 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-6c53d5ce-bc3b-4ea4-ac97-d4ce0eba10d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e6584b9db314fbf9d32ce12efa00ad5'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:11.991531 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:12.002695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-6c53d5ce-bc3b-4ea4-ac97-d4ce0eba10d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e6584b9db314fbf9d32ce12efa00ad5'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:12.005444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-6c53d5ce-bc3b-4ea4-ac97-d4ce0eba10d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e6584b9db314fbf9d32ce12efa00ad5'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:12.017871 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1008/2016] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:11 2022] DELETE /identity/v3/users/2e6584b9db314fbf9d32ce12efa00ad5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:12.019208 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da785fb5-9c0d-4913-a43b-6056dc10f371 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.019503 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da785fb5-9c0d-4913-a43b-6056dc10f371 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.019783 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da785fb5-9c0d-4913-a43b-6056dc10f371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.036353 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a6e2f-3b03-4037-9cc9-5998b9a7af29 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:12.042353 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:12.056076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-da785fb5-9c0d-4913-a43b-6056dc10f371 None None] MFA Rules not processed for user `73764f1778ff417f942c957099acf57c`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:12.059674 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-da785fb5-9c0d-4913-a43b-6056dc10f371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:12.120069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a4967b-416f-4e37-93a9-2061fecb7afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:12.121055 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4967b-416f-4e37-93a9-2061fecb7afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.121542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4967b-416f-4e37-93a9-2061fecb7afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.121992 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4967b-416f-4e37-93a9-2061fecb7afc admin admin] PATH_INFO: `/v3/projects/5f78ec0d322c45fa85af72988d09668a` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.123492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4967b-416f-4e37-93a9-2061fecb7afc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f78ec0d322c45fa85af72988d09668a)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:12.125500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4967b-416f-4e37-93a9-2061fecb7afc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:12.174555 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1009/2017] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:12.188727 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da785fb5-9c0d-4913-a43b-6056dc10f371 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:12.191135 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-46a4967b-416f-4e37-93a9-2061fecb7afc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f78ec0d322c45fa85af72988d09668a', 'request_id': 'req-46a4967b-416f-4e37-93a9-2061fecb7afc'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:12.193936 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-da785fb5-9c0d-4913-a43b-6056dc10f371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:12.205934 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-46a4967b-416f-4e37-93a9-2061fecb7afc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f78ec0d322c45fa85af72988d09668a', 'request_id': 'req-46a4967b-416f-4e37-93a9-2061fecb7afc'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:12.217735 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-46a4967b-416f-4e37-93a9-2061fecb7afc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f78ec0d322c45fa85af72988d09668a', 'request_id': 'req-46a4967b-416f-4e37-93a9-2061fecb7afc'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:12.257759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-46a4967b-416f-4e37-93a9-2061fecb7afc admin admin] The token cache is being invalidate because project 5f78ec0d322c45fa85af72988d09668a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:12.258057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-46a4967b-416f-4e37-93a9-2061fecb7afc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:12.260833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-46a4967b-416f-4e37-93a9-2061fecb7afc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:12.265309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1009/2018] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:11 2022] DELETE /identity/v3/projects/5f78ec0d322c45fa85af72988d09668a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:12.271948 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0baf14-d6cc-4747-b414-e5fb27d8c0c6 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.272250 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0baf14-d6cc-4747-b414-e5fb27d8c0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.272536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0baf14-d6cc-4747-b414-e5fb27d8c0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.297651 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da785fb5-9c0d-4913-a43b-6056dc10f371 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:12.310926 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-8f0baf14-d6cc-4747-b414-e5fb27d8c0c6 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:12.313035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8f0baf14-d6cc-4747-b414-e5fb27d8c0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:12.384612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5643c-b6be-4b57-a449-2fa69391b241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:12.385284 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5643c-b6be-4b57-a449-2fa69391b241 service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.386019 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5643c-b6be-4b57-a449-2fa69391b241 service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.386309 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5643c-b6be-4b57-a449-2fa69391b241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.388211 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-78a5643c-b6be-4b57-a449-2fa69391b241 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:12.449827 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1010/2019] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:12.450835 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0baf14-d6cc-4747-b414-e5fb27d8c0c6 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:12.454385 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8f0baf14-d6cc-4747-b414-e5fb27d8c0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:12.476644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0baf14-d6cc-4747-b414-e5fb27d8c0c6 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:12.482363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5643c-b6be-4b57-a449-2fa69391b241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:12.483644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07c70e-2600-4781-879a-8a4506bb5b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:12.484149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5643c-b6be-4b57-a449-2fa69391b241 service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:12.484827 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07c70e-2600-4781-879a-8a4506bb5b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.485166 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07c70e-2600-4781-879a-8a4506bb5b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.485492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07c70e-2600-4781-879a-8a4506bb5b53 admin admin] PATH_INFO: `/v3/projects/baa6ddc212d940ed98131c01d17003ae` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.486815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07c70e-2600-4781-879a-8a4506bb5b53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baa6ddc212d940ed98131c01d17003ae)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:12.488945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07c70e-2600-4781-879a-8a4506bb5b53 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:12.491686 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:12.496029 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1010/2020] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:12.497973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208291a4-276d-49bb-8991-66ce2b95a005 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.498916 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208291a4-276d-49bb-8991-66ce2b95a005 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.499052 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208291a4-276d-49bb-8991-66ce2b95a005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.505444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:12.518837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-208291a4-276d-49bb-8991-66ce2b95a005 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:12.520193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-208291a4-276d-49bb-8991-66ce2b95a005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:12.529183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1011/2021] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:12.535528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208291a4-276d-49bb-8991-66ce2b95a005 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:12.547665 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208291a4-276d-49bb-8991-66ce2b95a005 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:12.552132 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0f07c70e-2600-4781-879a-8a4506bb5b53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baa6ddc212d940ed98131c01d17003ae', 'request_id': 'req-0f07c70e-2600-4781-879a-8a4506bb5b53'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:12.559017 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0f07c70e-2600-4781-879a-8a4506bb5b53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baa6ddc212d940ed98131c01d17003ae', 'request_id': 'req-0f07c70e-2600-4781-879a-8a4506bb5b53'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:12.568588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0f07c70e-2600-4781-879a-8a4506bb5b53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baa6ddc212d940ed98131c01d17003ae', 'request_id': 'req-0f07c70e-2600-4781-879a-8a4506bb5b53'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:12.582528 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0f07c70e-2600-4781-879a-8a4506bb5b53 admin admin] The token cache is being invalidate because project baa6ddc212d940ed98131c01d17003ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:12.582910 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0f07c70e-2600-4781-879a-8a4506bb5b53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:12.583624 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0f07c70e-2600-4781-879a-8a4506bb5b53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:12.585431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1011/2022] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:12 2022] DELETE /identity/v3/projects/baa6ddc212d940ed98131c01d17003ae => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:12.588000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07c70e-2600-4781-879a-8a4506bb5b53 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:12.590344 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0f07c70e-2600-4781-879a-8a4506bb5b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:12.613777 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318ae87-dab9-4b8e-97a6-f16f8e7df7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:12.614534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318ae87-dab9-4b8e-97a6-f16f8e7df7fb admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.614754 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318ae87-dab9-4b8e-97a6-f16f8e7df7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.615008 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318ae87-dab9-4b8e-97a6-f16f8e7df7fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.615810 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318ae87-dab9-4b8e-97a6-f16f8e7df7fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:12.616123 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318ae87-dab9-4b8e-97a6-f16f8e7df7fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:12.617730 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318ae87-dab9-4b8e-97a6-f16f8e7df7fb admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:12.630980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1012/2023] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:12.633176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118d24a-42d4-4f31-9055-d7b7750d494e None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.633514 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118d24a-42d4-4f31-9055-d7b7750d494e None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.634154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118d24a-42d4-4f31-9055-d7b7750d494e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.653833 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-5118d24a-42d4-4f31-9055-d7b7750d494e None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:12.655084 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-5118d24a-42d4-4f31-9055-d7b7750d494e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:12.663210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1013/2024] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:12.663940 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118d24a-42d4-4f31-9055-d7b7750d494e None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:12.664531 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07c70e-2600-4781-879a-8a4506bb5b53 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:12.665260 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-5118d24a-42d4-4f31-9055-d7b7750d494e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:12.670179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee64f53-644b-4461-9958-172c0736de0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:12.671099 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee64f53-644b-4461-9958-172c0736de0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.671389 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee64f53-644b-4461-9958-172c0736de0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.671672 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee64f53-644b-4461-9958-172c0736de0c admin admin] PATH_INFO: `/v3/users/8d839a7a0ceb41fbbb2adf79daf01474` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.672929 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee64f53-644b-4461-9958-172c0736de0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d839a7a0ceb41fbbb2adf79daf01474)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:12.674933 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee64f53-644b-4461-9958-172c0736de0c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:12.677583 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118d24a-42d4-4f31-9055-d7b7750d494e None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:12.683160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d861d53-464b-45a5-8bfa-fd1e0b0185b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:12.683821 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d861d53-464b-45a5-8bfa-fd1e0b0185b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.684270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d861d53-464b-45a5-8bfa-fd1e0b0185b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.686316 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d861d53-464b-45a5-8bfa-fd1e0b0185b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.686316 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d861d53-464b-45a5-8bfa-fd1e0b0185b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:12.687227 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d861d53-464b-45a5-8bfa-fd1e0b0185b1 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:12.720006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1014/2025] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:12 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:12.720006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb66f94-e48a-44d1-a409-d01ab9d03212 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.720006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb66f94-e48a-44d1-a409-d01ab9d03212 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.720006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb66f94-e48a-44d1-a409-d01ab9d03212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.732487 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dee64f53-644b-4461-9958-172c0736de0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d839a7a0ceb41fbbb2adf79daf01474'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:12.740126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-ceb66f94-e48a-44d1-a409-d01ab9d03212 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:12.741587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ceb66f94-e48a-44d1-a409-d01ab9d03212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:12.743448 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dee64f53-644b-4461-9958-172c0736de0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d839a7a0ceb41fbbb2adf79daf01474'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:12.744198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dee64f53-644b-4461-9958-172c0736de0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d839a7a0ceb41fbbb2adf79daf01474'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:12.746336 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dee64f53-644b-4461-9958-172c0736de0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d839a7a0ceb41fbbb2adf79daf01474'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:12.767303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dee64f53-644b-4461-9958-172c0736de0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d839a7a0ceb41fbbb2adf79daf01474'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:12.782300 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1012/2026] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:12 2022] DELETE /identity/v3/users/8d839a7a0ceb41fbbb2adf79daf01474 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:12.784019 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee64f53-644b-4461-9958-172c0736de0c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:12.786380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-dee64f53-644b-4461-9958-172c0736de0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:12.803531 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:12.818992 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1015/2027] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:12.820221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80ee91-b32c-4d83-b315-99336393782a None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.820779 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80ee91-b32c-4d83-b315-99336393782a None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.821061 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80ee91-b32c-4d83-b315-99336393782a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.840173 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-2a80ee91-b32c-4d83-b315-99336393782a None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:12.841520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-2a80ee91-b32c-4d83-b315-99336393782a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:12.861357 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee64f53-644b-4461-9958-172c0736de0c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:12.866271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b88dc-f6aa-4ee2-b91d-ebd4d7edd792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:12.866906 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b88dc-f6aa-4ee2-b91d-ebd4d7edd792 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.867201 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b88dc-f6aa-4ee2-b91d-ebd4d7edd792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.867481 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b88dc-f6aa-4ee2-b91d-ebd4d7edd792 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.868171 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b88dc-f6aa-4ee2-b91d-ebd4d7edd792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:12.870134 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b88dc-f6aa-4ee2-b91d-ebd4d7edd792 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:12.894254 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1013/2028] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:12 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:12.895584 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b88dc-f6aa-4ee2-b91d-ebd4d7edd792 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:12.903131 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1016/2029] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:12.903983 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80ee91-b32c-4d83-b315-99336393782a None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:12.908652 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:12.912735 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b88dc-f6aa-4ee2-b91d-ebd4d7edd792 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:12.913954 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80ee91-b32c-4d83-b315-99336393782a None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:12.917625 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cde887-06f5-4c0d-883d-cc5535f7204b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:12.918291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde887-06f5-4c0d-883d-cc5535f7204b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.918616 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde887-06f5-4c0d-883d-cc5535f7204b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.918900 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde887-06f5-4c0d-883d-cc5535f7204b admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.919635 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cde887-06f5-4c0d-883d-cc5535f7204b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:12.919951 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cde887-06f5-4c0d-883d-cc5535f7204b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:12.920059 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7c037-1a40-43f5-b4f2-e7a31e5321c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:12.920655 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7c037-1a40-43f5-b4f2-e7a31e5321c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.921330 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7c037-1a40-43f5-b4f2-e7a31e5321c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.921575 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cde887-06f5-4c0d-883d-cc5535f7204b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:12.921681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7c037-1a40-43f5-b4f2-e7a31e5321c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.922331 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7c037-1a40-43f5-b4f2-e7a31e5321c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:12.923967 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7c037-1a40-43f5-b4f2-e7a31e5321c0 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:12.936652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1014/2030] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:12.936836 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1017/2031] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:12.936930 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cde887-06f5-4c0d-883d-cc5535f7204b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:12.937624 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7c037-1a40-43f5-b4f2-e7a31e5321c0 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:12.938174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-93cde887-06f5-4c0d-883d-cc5535f7204b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:12.948243 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7c037-1a40-43f5-b4f2-e7a31e5321c0 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:12.953472 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5db71-d7f0-426b-97af-dd82f22fb03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:12.954117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5db71-d7f0-426b-97af-dd82f22fb03e admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.954405 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5db71-d7f0-426b-97af-dd82f22fb03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.954789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5db71-d7f0-426b-97af-dd82f22fb03e admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.955511 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5db71-d7f0-426b-97af-dd82f22fb03e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:12.957099 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5db71-d7f0-426b-97af-dd82f22fb03e admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:12.968367 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1018/2032] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:12.968963 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5db71-d7f0-426b-97af-dd82f22fb03e admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:12.978418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5db71-d7f0-426b-97af-dd82f22fb03e admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:12.983493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebdf80-bcb5-4e1e-ac39-a067d31a28cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:12.984151 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebdf80-bcb5-4e1e-ac39-a067d31a28cd admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:12.984442 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebdf80-bcb5-4e1e-ac39-a067d31a28cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:12.984722 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebdf80-bcb5-4e1e-ac39-a067d31a28cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:12.985399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebdf80-bcb5-4e1e-ac39-a067d31a28cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:12.987448 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebdf80-bcb5-4e1e-ac39-a067d31a28cd admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:12.997449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cde887-06f5-4c0d-883d-cc5535f7204b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:13.001033 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3e090-8822-4088-92e9-e6da8deaefc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:13.001671 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3e090-8822-4088-92e9-e6da8deaefc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.001957 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3e090-8822-4088-92e9-e6da8deaefc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.002237 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3e090-8822-4088-92e9-e6da8deaefc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.012161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3e090-8822-4088-92e9-e6da8deaefc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:13.013629 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3e090-8822-4088-92e9-e6da8deaefc3 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:13.018156 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1019/2033] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:12 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:13.018156 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebdf80-bcb5-4e1e-ac39-a067d31a28cd admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:13.023551 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1015/2034] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:13.024326 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3e090-8822-4088-92e9-e6da8deaefc3 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:13.033663 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3e090-8822-4088-92e9-e6da8deaefc3 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:13.104651 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebdf80-bcb5-4e1e-ac39-a067d31a28cd admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:13.113718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cbdc7-ed5e-429f-a79e-7a809f680b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:13.114912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cbdc7-ed5e-429f-a79e-7a809f680b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.115489 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cbdc7-ed5e-429f-a79e-7a809f680b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.115780 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cbdc7-ed5e-429f-a79e-7a809f680b04 admin admin] PATH_INFO: `/v3/projects/34553bb11b584daba511812722e24dd9/users/88a5c4281d9249fcbb0457b6bed5b0d5/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.140449 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cbdc7-ed5e-429f-a79e-7a809f680b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34553bb11b584daba511812722e24dd9, user_id=88a5c4281d9249fcbb0457b6bed5b0d5, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:13.143931 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cbdc7-ed5e-429f-a79e-7a809f680b04 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:13.151703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af9ff9-c7e5-49c3-b83c-3ab7bc39ca57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:13.152563 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af9ff9-c7e5-49c3-b83c-3ab7bc39ca57 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.153431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af9ff9-c7e5-49c3-b83c-3ab7bc39ca57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.154049 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af9ff9-c7e5-49c3-b83c-3ab7bc39ca57 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.155198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af9ff9-c7e5-49c3-b83c-3ab7bc39ca57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:13.157968 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af9ff9-c7e5-49c3-b83c-3ab7bc39ca57 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:13.163229 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1020/2035] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:13 2022] PUT /identity/v3/projects/34553bb11b584daba511812722e24dd9/users/88a5c4281d9249fcbb0457b6bed5b0d5/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:13.174465 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0790e-7340-4d9f-81c2-634254485a4d None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.175063 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0790e-7340-4d9f-81c2-634254485a4d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.176300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0790e-7340-4d9f-81c2-634254485a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.194641 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1016/2036] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:13 2022] POST /identity/v3/users => generated 283 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:13.203788 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af9ff9-c7e5-49c3-b83c-3ab7bc39ca57 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:13.206601 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-f4b0790e-7340-4d9f-81c2-634254485a4d None None] MFA Rules not processed for user `88a5c4281d9249fcbb0457b6bed5b0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:13.207771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-f4b0790e-7340-4d9f-81c2-634254485a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:13.212818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af9ff9-c7e5-49c3-b83c-3ab7bc39ca57 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:13.242142 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:13.294281 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1021/2037] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:13.295782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0790e-7340-4d9f-81c2-634254485a4d None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:13.300499 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767d99c-338b-48c7-887e-7eeded585f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:13.301183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767d99c-338b-48c7-887e-7eeded585f2c admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.301474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767d99c-338b-48c7-887e-7eeded585f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.301753 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767d99c-338b-48c7-887e-7eeded585f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.302521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767d99c-338b-48c7-887e-7eeded585f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:13.304255 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767d99c-338b-48c7-887e-7eeded585f2c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:13.310787 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0790e-7340-4d9f-81c2-634254485a4d None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:13.318582 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7e4e3-20be-44cf-ac47-ae0b0322b547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:13.319617 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7e4e3-20be-44cf-ac47-ae0b0322b547 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.319972 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7e4e3-20be-44cf-ac47-ae0b0322b547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.320325 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7e4e3-20be-44cf-ac47-ae0b0322b547 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.321099 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7e4e3-20be-44cf-ac47-ae0b0322b547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:13.323917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7e4e3-20be-44cf-ac47-ae0b0322b547 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:13.330944 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1017/2038] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:13.336973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767d99c-338b-48c7-887e-7eeded585f2c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:13.348621 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767d99c-338b-48c7-887e-7eeded585f2c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:13.352809 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1022/2039] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:13 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:13.354115 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce24da-e180-4356-8905-d018f2f780e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:13.354912 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce24da-e180-4356-8905-d018f2f780e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.355213 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce24da-e180-4356-8905-d018f2f780e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.355541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce24da-e180-4356-8905-d018f2f780e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.356551 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce24da-e180-4356-8905-d018f2f780e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:13.357460 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7e4e3-20be-44cf-ac47-ae0b0322b547 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:13.358109 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce24da-e180-4356-8905-d018f2f780e1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:13.373887 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1018/2040] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:34:13.374790 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce24da-e180-4356-8905-d018f2f780e1 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:13.376253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:13.379283 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ebce24da-e180-4356-8905-d018f2f780e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:13.395304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce24da-e180-4356-8905-d018f2f780e1 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:13.449087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7e4e3-20be-44cf-ac47-ae0b0322b547 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:13.455744 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc2dd0-40ea-463d-a606-113cc10c87ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:13.456395 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc2dd0-40ea-463d-a606-113cc10c87ea admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.456685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc2dd0-40ea-463d-a606-113cc10c87ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.456962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc2dd0-40ea-463d-a606-113cc10c87ea admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.457685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc2dd0-40ea-463d-a606-113cc10c87ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:13.459784 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc2dd0-40ea-463d-a606-113cc10c87ea admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:13.463698 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768c1ad-9372-40d5-a8ff-44e74bf46925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:13.463698 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768c1ad-9372-40d5-a8ff-44e74bf46925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.463949 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768c1ad-9372-40d5-a8ff-44e74bf46925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.464205 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768c1ad-9372-40d5-a8ff-44e74bf46925 admin admin] PATH_INFO: `/v3/projects/6a89aaa47fbf4f4793dd8513527f1acc` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.465411 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768c1ad-9372-40d5-a8ff-44e74bf46925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a89aaa47fbf4f4793dd8513527f1acc)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:13.467397 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768c1ad-9372-40d5-a8ff-44e74bf46925 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:13.485715 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1023/2041] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:13 2022] POST /identity/v3/users => generated 297 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:34:13.486694 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc2dd0-40ea-463d-a606-113cc10c87ea admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:13.500582 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc2dd0-40ea-463d-a606-113cc10c87ea admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:13.510428 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b7ad0-8012-45c3-bb21-da4070afb62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:13.511355 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b7ad0-8012-45c3-bb21-da4070afb62d admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.511642 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b7ad0-8012-45c3-bb21-da4070afb62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.512054 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b7ad0-8012-45c3-bb21-da4070afb62d admin admin] PATH_INFO: `/v3/projects/5b4ea229a8b048739dfb3b56f661d6da/users/d7ba23bbe0a44b9a8e8b7723d4527131/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.523780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2768c1ad-9372-40d5-a8ff-44e74bf46925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a89aaa47fbf4f4793dd8513527f1acc', 'request_id': 'req-2768c1ad-9372-40d5-a8ff-44e74bf46925'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:13.528594 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b7ad0-8012-45c3-bb21-da4070afb62d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b4ea229a8b048739dfb3b56f661d6da, user_id=d7ba23bbe0a44b9a8e8b7723d4527131, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:13.530084 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2768c1ad-9372-40d5-a8ff-44e74bf46925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a89aaa47fbf4f4793dd8513527f1acc', 'request_id': 'req-2768c1ad-9372-40d5-a8ff-44e74bf46925'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:13.531289 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b7ad0-8012-45c3-bb21-da4070afb62d admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:13.536099 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2768c1ad-9372-40d5-a8ff-44e74bf46925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a89aaa47fbf4f4793dd8513527f1acc', 'request_id': 'req-2768c1ad-9372-40d5-a8ff-44e74bf46925'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:13.551194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2768c1ad-9372-40d5-a8ff-44e74bf46925 admin admin] The token cache is being invalidate because project 6a89aaa47fbf4f4793dd8513527f1acc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:13.551587 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2768c1ad-9372-40d5-a8ff-44e74bf46925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:13.555481 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2768c1ad-9372-40d5-a8ff-44e74bf46925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:13.558195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1019/2043] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:13 2022] DELETE /identity/v3/projects/6a89aaa47fbf4f4793dd8513527f1acc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:13.559358 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768c1ad-9372-40d5-a8ff-44e74bf46925 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:13.560294 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1024/2043] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:13 2022] PUT /identity/v3/projects/5b4ea229a8b048739dfb3b56f661d6da/users/d7ba23bbe0a44b9a8e8b7723d4527131/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:13.561341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2768c1ad-9372-40d5-a8ff-44e74bf46925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:13.566769 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310791b-e962-4626-9373-9b5cd5c83027 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.566769 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310791b-e962-4626-9373-9b5cd5c83027 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.566769 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310791b-e962-4626-9373-9b5cd5c83027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.600740 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-c310791b-e962-4626-9373-9b5cd5c83027 None None] MFA Rules not processed for user `d7ba23bbe0a44b9a8e8b7723d4527131`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:13.602648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-c310791b-e962-4626-9373-9b5cd5c83027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:13.617967 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:13.651626 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768c1ad-9372-40d5-a8ff-44e74bf46925 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:13.678756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1025/2044] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:13.679569 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310791b-e962-4626-9373-9b5cd5c83027 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:13.681032 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-c310791b-e962-4626-9373-9b5cd5c83027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:13.718125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c7afb-0e32-4b28-8b82-6ff5d8609345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:13.718841 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c7afb-0e32-4b28-8b82-6ff5d8609345 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.719130 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c7afb-0e32-4b28-8b82-6ff5d8609345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.719406 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c7afb-0e32-4b28-8b82-6ff5d8609345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.720147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c7afb-0e32-4b28-8b82-6ff5d8609345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:13.721773 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c7afb-0e32-4b28-8b82-6ff5d8609345 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:13.734115 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1020/2045] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:13.735212 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c7afb-0e32-4b28-8b82-6ff5d8609345 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:13.738046 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-169c7afb-0e32-4b28-8b82-6ff5d8609345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:13.751284 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c7afb-0e32-4b28-8b82-6ff5d8609345 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:13.756925 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8e41a-6cb2-4fb5-b9fb-ecaa38ff8b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:13.757288 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8e41a-6cb2-4fb5-b9fb-ecaa38ff8b23 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.757477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8e41a-6cb2-4fb5-b9fb-ecaa38ff8b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.758101 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8e41a-6cb2-4fb5-b9fb-ecaa38ff8b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.758375 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8e41a-6cb2-4fb5-b9fb-ecaa38ff8b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:13.761089 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8e41a-6cb2-4fb5-b9fb-ecaa38ff8b23 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:13.767065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310791b-e962-4626-9373-9b5cd5c83027 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:13.773882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee98b5-dc9f-4d26-9a87-9ff1955d9285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:13.775386 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee98b5-dc9f-4d26-9a87-9ff1955d9285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.775831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee98b5-dc9f-4d26-9a87-9ff1955d9285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.776112 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee98b5-dc9f-4d26-9a87-9ff1955d9285 admin admin] PATH_INFO: `/v3/users/73764f1778ff417f942c957099acf57c` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.777497 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee98b5-dc9f-4d26-9a87-9ff1955d9285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73764f1778ff417f942c957099acf57c)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:13.779941 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee98b5-dc9f-4d26-9a87-9ff1955d9285 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:13.785552 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:13.793361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1021/2046] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:13 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:13.794282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8e41a-6cb2-4fb5-b9fb-ecaa38ff8b23 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:13.845084 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-4dee98b5-dc9f-4d26-9a87-9ff1955d9285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73764f1778ff417f942c957099acf57c'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:13.855949 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-4dee98b5-dc9f-4d26-9a87-9ff1955d9285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73764f1778ff417f942c957099acf57c'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:13.878936 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-4dee98b5-dc9f-4d26-9a87-9ff1955d9285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73764f1778ff417f942c957099acf57c'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:13.889844 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-4dee98b5-dc9f-4d26-9a87-9ff1955d9285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73764f1778ff417f942c957099acf57c'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:13.892591 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-4dee98b5-dc9f-4d26-9a87-9ff1955d9285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73764f1778ff417f942c957099acf57c'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:13.901731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8e41a-6cb2-4fb5-b9fb-ecaa38ff8b23 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:13.905736 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1026/2047] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:13 2022] DELETE /identity/v3/users/73764f1778ff417f942c957099acf57c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:13.906322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee98b5-dc9f-4d26-9a87-9ff1955d9285 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:13.908113 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-4dee98b5-dc9f-4d26-9a87-9ff1955d9285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:13.985919 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35418f51-c1fa-49ca-9486-c5c75a78ff3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:13.986955 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35418f51-c1fa-49ca-9486-c5c75a78ff3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:13.987381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35418f51-c1fa-49ca-9486-c5c75a78ff3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:13.987741 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35418f51-c1fa-49ca-9486-c5c75a78ff3b admin admin] PATH_INFO: `/v3/projects/a139707b3845454b9556060dd18cad85/users/3b6b756f45844c90b104fc94fe653a91/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:13.990206 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee98b5-dc9f-4d26-9a87-9ff1955d9285 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:13.997352 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:13.999186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2db37-e446-4489-bc8c-fe5d6e5cc262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:14.000286 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2db37-e446-4489-bc8c-fe5d6e5cc262 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.000574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2db37-e446-4489-bc8c-fe5d6e5cc262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.000853 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2db37-e446-4489-bc8c-fe5d6e5cc262 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.001613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2db37-e446-4489-bc8c-fe5d6e5cc262 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:14.004527 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2db37-e446-4489-bc8c-fe5d6e5cc262 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:14.008789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35418f51-c1fa-49ca-9486-c5c75a78ff3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a139707b3845454b9556060dd18cad85, user_id=3b6b756f45844c90b104fc94fe653a91, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:14.011917 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35418f51-c1fa-49ca-9486-c5c75a78ff3b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:14.026154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1027/2048] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:13 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:14.028634 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1022/2049] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:13 2022] PUT /identity/v3/projects/a139707b3845454b9556060dd18cad85/users/3b6b756f45844c90b104fc94fe653a91/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:14.030200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2db37-e446-4489-bc8c-fe5d6e5cc262 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:14.036344 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35418f51-c1fa-49ca-9486-c5c75a78ff3b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:14.039737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-35418f51-c1fa-49ca-9486-c5c75a78ff3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:14.043321 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2db37-e446-4489-bc8c-fe5d6e5cc262 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:14.129323 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334f00b-9518-43dd-a005-4b4c6005e066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:14.130556 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334f00b-9518-43dd-a005-4b4c6005e066 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.131012 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334f00b-9518-43dd-a005-4b4c6005e066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.131575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334f00b-9518-43dd-a005-4b4c6005e066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.132448 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334f00b-9518-43dd-a005-4b4c6005e066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:14.134691 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334f00b-9518-43dd-a005-4b4c6005e066 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:14.135788 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35418f51-c1fa-49ca-9486-c5c75a78ff3b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:14.141025 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc455c-74ac-4f60-8b48-57b1c4bf3ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:14.141871 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc455c-74ac-4f60-8b48-57b1c4bf3ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.142312 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc455c-74ac-4f60-8b48-57b1c4bf3ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.142646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc455c-74ac-4f60-8b48-57b1c4bf3ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.143927 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc455c-74ac-4f60-8b48-57b1c4bf3ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:14.145905 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc455c-74ac-4f60-8b48-57b1c4bf3ac1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:14.152080 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1028/2050] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:14.153293 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334f00b-9518-43dd-a005-4b4c6005e066 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:14.157621 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1023/2051] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:34:14.167201 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334f00b-9518-43dd-a005-4b4c6005e066 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:14.170961 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc455c-74ac-4f60-8b48-57b1c4bf3ac1 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:14.172475 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390adddc-b522-4219-a17a-a522bcd94576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:14.173385 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390adddc-b522-4219-a17a-a522bcd94576 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.173909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390adddc-b522-4219-a17a-a522bcd94576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.174163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390adddc-b522-4219-a17a-a522bcd94576 admin admin] PATH_INFO: `/v3/projects/d4eb3848f3974fc9981d95fadf3bbccd/users/6136674a6913432bbae2f8a31fb9f444/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.178265 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:14.183505 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc455c-74ac-4f60-8b48-57b1c4bf3ac1 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:14.198142 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd1cf6-0c9f-4d0d-8b1f-dc57d18f815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:14.199096 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd1cf6-0c9f-4d0d-8b1f-dc57d18f815c admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.199387 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd1cf6-0c9f-4d0d-8b1f-dc57d18f815c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.199668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd1cf6-0c9f-4d0d-8b1f-dc57d18f815c admin admin] PATH_INFO: `/v3/projects/a139707b3845454b9556060dd18cad85/users/3b6b756f45844c90b104fc94fe653a91/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.200227 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390adddc-b522-4219-a17a-a522bcd94576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4eb3848f3974fc9981d95fadf3bbccd, user_id=6136674a6913432bbae2f8a31fb9f444, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:14.202347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd1cf6-0c9f-4d0d-8b1f-dc57d18f815c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a139707b3845454b9556060dd18cad85, user_id=3b6b756f45844c90b104fc94fe653a91, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:14.206229 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd1cf6-0c9f-4d0d-8b1f-dc57d18f815c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:14.210453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390adddc-b522-4219-a17a-a522bcd94576 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:14.218462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1024/2052] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:14 2022] PUT /identity/v3/projects/a139707b3845454b9556060dd18cad85/users/3b6b756f45844c90b104fc94fe653a91/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:14.231109 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e441b-70db-41aa-99f0-0286b2e6bb70 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.231477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e441b-70db-41aa-99f0-0286b2e6bb70 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.231795 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e441b-70db-41aa-99f0-0286b2e6bb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.241005 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1029/2053] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:14 2022] PUT /identity/v3/projects/d4eb3848f3974fc9981d95fadf3bbccd/users/6136674a6913432bbae2f8a31fb9f444/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:14.244758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390adddc-b522-4219-a17a-a522bcd94576 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:14.270830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1e3e441b-70db-41aa-99f0-0286b2e6bb70 None None] MFA Rules not processed for user `3b6b756f45844c90b104fc94fe653a91`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:14.272323 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1e3e441b-70db-41aa-99f0-0286b2e6bb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:14.330818 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390adddc-b522-4219-a17a-a522bcd94576 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:14.342657 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b8d00-7b82-4ad1-937f-fbf60b7ac9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:14.343419 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b8d00-7b82-4ad1-937f-fbf60b7ac9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.343840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b8d00-7b82-4ad1-937f-fbf60b7ac9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.344242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b8d00-7b82-4ad1-937f-fbf60b7ac9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.344904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b8d00-7b82-4ad1-937f-fbf60b7ac9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:14.346998 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b8d00-7b82-4ad1-937f-fbf60b7ac9a1 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:14.358532 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1030/2054] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:14.364848 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b8d00-7b82-4ad1-937f-fbf60b7ac9a1 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:14.376008 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b8d00-7b82-4ad1-937f-fbf60b7ac9a1 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:14.381719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e18b17-0468-4a5e-9f67-30fd9c0eb976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:14.382738 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e18b17-0468-4a5e-9f67-30fd9c0eb976 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.383102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e18b17-0468-4a5e-9f67-30fd9c0eb976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.383490 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e18b17-0468-4a5e-9f67-30fd9c0eb976 admin admin] PATH_INFO: `/v3/projects/d4eb3848f3974fc9981d95fadf3bbccd/users/6136674a6913432bbae2f8a31fb9f444/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.386210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e18b17-0468-4a5e-9f67-30fd9c0eb976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4eb3848f3974fc9981d95fadf3bbccd, user_id=6136674a6913432bbae2f8a31fb9f444, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:14.390629 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1025/2055] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:34:14.391052 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e18b17-0468-4a5e-9f67-30fd9c0eb976 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:14.391134 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e441b-70db-41aa-99f0-0286b2e6bb70 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:14.392729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1e3e441b-70db-41aa-99f0-0286b2e6bb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:14.409304 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1031/2056] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:14 2022] PUT /identity/v3/projects/d4eb3848f3974fc9981d95fadf3bbccd/users/6136674a6913432bbae2f8a31fb9f444/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:14.410133 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e18b17-0468-4a5e-9f67-30fd9c0eb976 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:14.412622 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e5e18b17-0468-4a5e-9f67-30fd9c0eb976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:14.417586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e441b-70db-41aa-99f0-0286b2e6bb70 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:14.476074 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:14.477334 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e18b17-0468-4a5e-9f67-30fd9c0eb976 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:14.481671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f47e2-caf7-43ae-84fc-bfd1f688865e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:14.482521 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f47e2-caf7-43ae-84fc-bfd1f688865e service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.482836 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f47e2-caf7-43ae-84fc-bfd1f688865e service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.483127 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f47e2-caf7-43ae-84fc-bfd1f688865e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.484879 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27102af-f22e-46a2-885c-e03dcd83288e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:14.485743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27102af-f22e-46a2-885c-e03dcd83288e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.486064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27102af-f22e-46a2-885c-e03dcd83288e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.486347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27102af-f22e-46a2-885c-e03dcd83288e admin admin] PATH_INFO: `/v3/projects/736ffa8620f2474097520bd36b60c577` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.487718 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27102af-f22e-46a2-885c-e03dcd83288e admin admin] RBAC: Authorizing `identity:delete_project(project_id=736ffa8620f2474097520bd36b60c577)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:14.489694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27102af-f22e-46a2-885c-e03dcd83288e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:14.538045 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d27102af-f22e-46a2-885c-e03dcd83288e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '736ffa8620f2474097520bd36b60c577', 'request_id': 'req-d27102af-f22e-46a2-885c-e03dcd83288e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:14.549572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d27102af-f22e-46a2-885c-e03dcd83288e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '736ffa8620f2474097520bd36b60c577', 'request_id': 'req-d27102af-f22e-46a2-885c-e03dcd83288e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:14.550744 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f47e2-caf7-43ae-84fc-bfd1f688865e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:14.552230 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f47e2-caf7-43ae-84fc-bfd1f688865e service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:14.559379 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d27102af-f22e-46a2-885c-e03dcd83288e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '736ffa8620f2474097520bd36b60c577', 'request_id': 'req-d27102af-f22e-46a2-885c-e03dcd83288e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:14.565248 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1032/2057] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:14.566600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c317b08-1231-4cf2-83d9-66f9e4ea964e None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.566880 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c317b08-1231-4cf2-83d9-66f9e4ea964e None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.567599 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c317b08-1231-4cf2-83d9-66f9e4ea964e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.576047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d27102af-f22e-46a2-885c-e03dcd83288e admin admin] The token cache is being invalidate because project 736ffa8620f2474097520bd36b60c577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:14.576400 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d27102af-f22e-46a2-885c-e03dcd83288e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:14.577159 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d27102af-f22e-46a2-885c-e03dcd83288e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:14.581112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1026/2058] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:14 2022] DELETE /identity/v3/projects/736ffa8620f2474097520bd36b60c577 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:14.584669 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f3003-c626-4b26-87d9-72508dadc84e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.584969 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f3003-c626-4b26-87d9-72508dadc84e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.585791 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f3003-c626-4b26-87d9-72508dadc84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.599606 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-9c317b08-1231-4cf2-83d9-66f9e4ea964e None None] MFA Rules not processed for user `6136674a6913432bbae2f8a31fb9f444`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:14.600837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-9c317b08-1231-4cf2-83d9-66f9e4ea964e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:14.606565 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:14.610422 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b72f3003-c626-4b26-87d9-72508dadc84e None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:14.612086 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b72f3003-c626-4b26-87d9-72508dadc84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:14.683859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1033/2059] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:14.695745 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c317b08-1231-4cf2-83d9-66f9e4ea964e None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:14.697348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1027/2060] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:34:14.697768 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-9c317b08-1231-4cf2-83d9-66f9e4ea964e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:14.706101 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f998f1-358b-41b2-8748-fd833214732c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.706406 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f998f1-358b-41b2-8748-fd833214732c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.706697 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f998f1-358b-41b2-8748-fd833214732c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.732571 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d3f998f1-358b-41b2-8748-fd833214732c None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:14.734031 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d3f998f1-358b-41b2-8748-fd833214732c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:14.744592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1028/2061] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:14.747805 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f998f1-358b-41b2-8748-fd833214732c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:14.756986 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f998f1-358b-41b2-8748-fd833214732c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:14.762551 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb8285-c243-4371-b705-1eca44a6afbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:14.763244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb8285-c243-4371-b705-1eca44a6afbd admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.763597 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb8285-c243-4371-b705-1eca44a6afbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.763948 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb8285-c243-4371-b705-1eca44a6afbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.764071 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c317b08-1231-4cf2-83d9-66f9e4ea964e None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:14.764766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb8285-c243-4371-b705-1eca44a6afbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:14.765147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb8285-c243-4371-b705-1eca44a6afbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:14.766884 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb8285-c243-4371-b705-1eca44a6afbd admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:14.772175 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9a429-e6c8-4844-981f-5cbf12fd3267 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:14.773243 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9a429-e6c8-4844-981f-5cbf12fd3267 service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.773968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9a429-e6c8-4844-981f-5cbf12fd3267 service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.774097 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9a429-e6c8-4844-981f-5cbf12fd3267 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.783480 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1029/2062] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:34:14.784407 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb8285-c243-4371-b705-1eca44a6afbd admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:14.785774 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f9a429-e6c8-4844-981f-5cbf12fd3267 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:14.787239 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f9a429-e6c8-4844-981f-5cbf12fd3267 service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:14.795407 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb8285-c243-4371-b705-1eca44a6afbd admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:14.798517 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1034/2063] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:34:14.800707 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5bb0c-32ee-474c-b935-8fb97ad872dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:14.801422 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5bb0c-32ee-474c-b935-8fb97ad872dc admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.801768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5bb0c-32ee-474c-b935-8fb97ad872dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.802112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5bb0c-32ee-474c-b935-8fb97ad872dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.803259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5bb0c-32ee-474c-b935-8fb97ad872dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:14.805238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5bb0c-32ee-474c-b935-8fb97ad872dc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:14.840187 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1030/2064] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:14 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:34:14.844459 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9a429-e6c8-4844-981f-5cbf12fd3267 service cinder] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:14.856944 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9a429-e6c8-4844-981f-5cbf12fd3267 service cinder] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:14.894395 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5bb0c-32ee-474c-b935-8fb97ad872dc admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:14.925862 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a0d04-cc57-4ba7-b69c-de64972658df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:14.926803 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a0d04-cc57-4ba7-b69c-de64972658df admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.927096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a0d04-cc57-4ba7-b69c-de64972658df admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.927380 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a0d04-cc57-4ba7-b69c-de64972658df admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.928090 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a0d04-cc57-4ba7-b69c-de64972658df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:14.930684 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a0d04-cc57-4ba7-b69c-de64972658df admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:14.956335 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:14.963680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1035/2065] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:14 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:14.967812 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a0d04-cc57-4ba7-b69c-de64972658df admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:14.970214 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5bb0c-32ee-474c-b935-8fb97ad872dc admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:14.978565 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a0d04-cc57-4ba7-b69c-de64972658df admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:14.983814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ef95c-5e1a-478e-9f95-ca6c0553d3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:14.984614 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ef95c-5e1a-478e-9f95-ca6c0553d3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.984906 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ef95c-5e1a-478e-9f95-ca6c0553d3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.985176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ef95c-5e1a-478e-9f95-ca6c0553d3e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.985693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028face-1cd7-4ad0-b43b-9c3a667b8128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:14.985909 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ef95c-5e1a-478e-9f95-ca6c0553d3e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:14.986817 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028face-1cd7-4ad0-b43b-9c3a667b8128 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:14.987540 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ef95c-5e1a-478e-9f95-ca6c0553d3e5 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:14.988321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028face-1cd7-4ad0-b43b-9c3a667b8128 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:14.988657 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028face-1cd7-4ad0-b43b-9c3a667b8128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:14.991499 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2028face-1cd7-4ad0-b43b-9c3a667b8128 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:14.998227 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1036/2066] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:34:15.002112 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ef95c-5e1a-478e-9f95-ca6c0553d3e5 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:15.012461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ef95c-5e1a-478e-9f95-ca6c0553d3e5 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:15.017168 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2cb953-6cd5-40be-987c-163775498988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:15.017816 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cb953-6cd5-40be-987c-163775498988 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:15.018104 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cb953-6cd5-40be-987c-163775498988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:15.023552 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cb953-6cd5-40be-987c-163775498988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:15.024483 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2cb953-6cd5-40be-987c-163775498988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:15.026149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2cb953-6cd5-40be-987c-163775498988 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:15.036409 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1037/2067] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:34:15.037224 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2cb953-6cd5-40be-987c-163775498988 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:15.038953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-3f2cb953-6cd5-40be-987c-163775498988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:15.053614 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:15.068883 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2028face-1cd7-4ad0-b43b-9c3a667b8128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:15.070951 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2028face-1cd7-4ad0-b43b-9c3a667b8128 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:15.084420 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1031/2068] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:15.085245 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028face-1cd7-4ad0-b43b-9c3a667b8128 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:15.098184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028face-1cd7-4ad0-b43b-9c3a667b8128 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:15.105023 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f1185-b52e-4b88-9cae-0fc754af4570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:15.106291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f1185-b52e-4b88-9cae-0fc754af4570 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:15.107050 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f1185-b52e-4b88-9cae-0fc754af4570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:15.107756 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f1185-b52e-4b88-9cae-0fc754af4570 admin admin] PATH_INFO: `/v3/projects/778929568b4741e49a7665b02f2e85db/users/70fd7589ebfa4efea91fa148132769b9/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:15.114582 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2cb953-6cd5-40be-987c-163775498988 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:15.119868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968236e-fdc4-42b9-be9c-861ab5f95c53 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6b756f45844c90b104fc94fe653a91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a139707b3845454b9556060dd18cad85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:15.120536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968236e-fdc4-42b9-be9c-861ab5f95c53 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:15.120830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968236e-fdc4-42b9-be9c-861ab5f95c53 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:15.121117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968236e-fdc4-42b9-be9c-861ab5f95c53 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:15.121863 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968236e-fdc4-42b9-be9c-861ab5f95c53 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:15.122178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968236e-fdc4-42b9-be9c-861ab5f95c53 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:15.123836 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968236e-fdc4-42b9-be9c-861ab5f95c53 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:15.140050 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1038/2069] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:15.141048 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968236e-fdc4-42b9-be9c-861ab5f95c53 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:15.142004 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f1185-b52e-4b88-9cae-0fc754af4570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=778929568b4741e49a7665b02f2e85db, user_id=70fd7589ebfa4efea91fa148132769b9, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:15.144742 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f1185-b52e-4b88-9cae-0fc754af4570 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:15.155215 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968236e-fdc4-42b9-be9c-861ab5f95c53 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:15.162475 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1032/2070] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:15 2022] PUT /identity/v3/projects/778929568b4741e49a7665b02f2e85db/users/70fd7589ebfa4efea91fa148132769b9/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:15.175821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bf8f2-3a87-41e8-9947-a7c414419288 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:15.176370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bf8f2-3a87-41e8-9947-a7c414419288 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:15.176659 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bf8f2-3a87-41e8-9947-a7c414419288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:15.210858 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f45bf8f2-3a87-41e8-9947-a7c414419288 None None] MFA Rules not processed for user `70fd7589ebfa4efea91fa148132769b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:15.212640 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f45bf8f2-3a87-41e8-9947-a7c414419288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:15.240153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadeff5b-d962-4f70-9d16-d1fff259f040 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6b756f45844c90b104fc94fe653a91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a139707b3845454b9556060dd18cad85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:15.241398 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadeff5b-d962-4f70-9d16-d1fff259f040 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:15.241731 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadeff5b-d962-4f70-9d16-d1fff259f040 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:15.242021 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadeff5b-d962-4f70-9d16-d1fff259f040 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:15.243481 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadeff5b-d962-4f70-9d16-d1fff259f040 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:15.245846 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadeff5b-d962-4f70-9d16-d1fff259f040 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:15.283675 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1039/2071] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:15 2022] POST /identity/v3/projects => generated 354 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:15.289354 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadeff5b-d962-4f70-9d16-d1fff259f040 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:15.308910 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1033/2072] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:15.313546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bf8f2-3a87-41e8-9947-a7c414419288 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:15.394875 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bf8f2-3a87-41e8-9947-a7c414419288 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:15.405114 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:15.408814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadeff5b-d962-4f70-9d16-d1fff259f040 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:15.437301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc0df6-3a90-42c2-ae6e-49be34947190 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6b756f45844c90b104fc94fe653a91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a139707b3845454b9556060dd18cad85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:15.437301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc0df6-3a90-42c2-ae6e-49be34947190 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:15.437301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc0df6-3a90-42c2-ae6e-49be34947190 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:15.437620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc0df6-3a90-42c2-ae6e-49be34947190 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:15.437620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc0df6-3a90-42c2-ae6e-49be34947190 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:15.437620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc0df6-3a90-42c2-ae6e-49be34947190 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:15.441999 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc0df6-3a90-42c2-ae6e-49be34947190 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:15.467826 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55f1f0-b1cb-49e5-8cb1-dbbb7e819f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:15.468513 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55f1f0-b1cb-49e5-8cb1-dbbb7e819f82 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:15.469007 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55f1f0-b1cb-49e5-8cb1-dbbb7e819f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:15.471409 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1040/2073] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:15.478494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55f1f0-b1cb-49e5-8cb1-dbbb7e819f82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:15.492687 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55f1f0-b1cb-49e5-8cb1-dbbb7e819f82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:15.492687 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55f1f0-b1cb-49e5-8cb1-dbbb7e819f82 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:15.504145 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc0df6-3a90-42c2-ae6e-49be34947190 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:15.506204 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-fbbc0df6-3a90-42c2-ae6e-49be34947190 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:15.526392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc0df6-3a90-42c2-ae6e-49be34947190 tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:15.538183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a74be-4838-4c5b-aca2-34699c4a5831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:15.539345 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a74be-4838-4c5b-aca2-34699c4a5831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:15.539648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a74be-4838-4c5b-aca2-34699c4a5831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:15.540246 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a74be-4838-4c5b-aca2-34699c4a5831 admin admin] PATH_INFO: `/v3/users/58fd7ffc15534581b20f6f6b48241934` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:15.542080 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a74be-4838-4c5b-aca2-34699c4a5831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58fd7ffc15534581b20f6f6b48241934)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:15.543224 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1034/2074] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:15 2022] POST /identity/v3/projects => generated 381 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:15.544389 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a74be-4838-4c5b-aca2-34699c4a5831 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:15.545399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55f1f0-b1cb-49e5-8cb1-dbbb7e819f82 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:15.572149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:15.621317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9f0a74be-4838-4c5b-aca2-34699c4a5831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58fd7ffc15534581b20f6f6b48241934'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:15.639159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9f0a74be-4838-4c5b-aca2-34699c4a5831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58fd7ffc15534581b20f6f6b48241934'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:15.643408 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55f1f0-b1cb-49e5-8cb1-dbbb7e819f82 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:15.650454 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93bb6c-c3fa-4802-a779-270114ed6c5c tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6b756f45844c90b104fc94fe653a91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a139707b3845454b9556060dd18cad85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:15.651464 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93bb6c-c3fa-4802-a779-270114ed6c5c tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:15.651801 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93bb6c-c3fa-4802-a779-270114ed6c5c tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:15.652020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93bb6c-c3fa-4802-a779-270114ed6c5c tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] PATH_INFO: `/v3/projects/ffdaa01660e14b5882c449c86c67ec2f` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:15.653338 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d93bb6c-c3fa-4802-a779-270114ed6c5c tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ffdaa01660e14b5882c449c86c67ec2f)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:15.655545 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d93bb6c-c3fa-4802-a779-270114ed6c5c tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:15.667845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9f0a74be-4838-4c5b-aca2-34699c4a5831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58fd7ffc15534581b20f6f6b48241934'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:15.676829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9f0a74be-4838-4c5b-aca2-34699c4a5831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58fd7ffc15534581b20f6f6b48241934'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:15.677641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9f0a74be-4838-4c5b-aca2-34699c4a5831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58fd7ffc15534581b20f6f6b48241934'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:15.685668 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1041/2075] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:15 2022] DELETE /identity/v3/users/58fd7ffc15534581b20f6f6b48241934 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:15.686526 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a74be-4838-4c5b-aca2-34699c4a5831 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:15.687939 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-9f0a74be-4838-4c5b-aca2-34699c4a5831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:15.707580 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9d93bb6c-c3fa-4802-a779-270114ed6c5c tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffdaa01660e14b5882c449c86c67ec2f', 'request_id': 'req-9d93bb6c-c3fa-4802-a779-270114ed6c5c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:15.715688 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9d93bb6c-c3fa-4802-a779-270114ed6c5c tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffdaa01660e14b5882c449c86c67ec2f', 'request_id': 'req-9d93bb6c-c3fa-4802-a779-270114ed6c5c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:15.723344 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9d93bb6c-c3fa-4802-a779-270114ed6c5c tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffdaa01660e14b5882c449c86c67ec2f', 'request_id': 'req-9d93bb6c-c3fa-4802-a779-270114ed6c5c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:15.742088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9d93bb6c-c3fa-4802-a779-270114ed6c5c tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] The token cache is being invalidate because project ffdaa01660e14b5882c449c86c67ec2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:15.742460 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9d93bb6c-c3fa-4802-a779-270114ed6c5c tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:15.743199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9d93bb6c-c3fa-4802-a779-270114ed6c5c tempest-VolumeQuotaClassesTest-1446941341 tempest-VolumeQuotaClassesTest-1446941341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:15.748234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1035/2076] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:15 2022] DELETE /identity/v3/projects/ffdaa01660e14b5882c449c86c67ec2f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:15.748234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ad91f-2a5b-4d2e-98af-08b8c2775f2b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:15.748234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ad91f-2a5b-4d2e-98af-08b8c2775f2b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:15.748234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ad91f-2a5b-4d2e-98af-08b8c2775f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:15.775141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3f6ad91f-2a5b-4d2e-98af-08b8c2775f2b None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:15.776625 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3f6ad91f-2a5b-4d2e-98af-08b8c2775f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:15.794138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a74be-4838-4c5b-aca2-34699c4a5831 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:15.799617 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:15.863373 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1036/2077] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:15.873706 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ad91f-2a5b-4d2e-98af-08b8c2775f2b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:15.877003 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3f6ad91f-2a5b-4d2e-98af-08b8c2775f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:15.891290 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8fe28-5b58-4056-925c-9354e80548f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:15.891985 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8fe28-5b58-4056-925c-9354e80548f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:15.892277 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8fe28-5b58-4056-925c-9354e80548f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:15.892563 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8fe28-5b58-4056-925c-9354e80548f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:15.893267 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8fe28-5b58-4056-925c-9354e80548f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:15.895252 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8fe28-5b58-4056-925c-9354e80548f1 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:15.929010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1042/2078] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:15 2022] POST /identity/v3/users => generated 297 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:15.930113 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8fe28-5b58-4056-925c-9354e80548f1 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:15.932352 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-acb8fe28-5b58-4056-925c-9354e80548f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:15.944962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8fe28-5b58-4056-925c-9354e80548f1 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:15.949796 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ad91f-2a5b-4d2e-98af-08b8c2775f2b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:15.951179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598e433-78ce-49f0-ab55-8cdf24bf44a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:15.951866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598e433-78ce-49f0-ab55-8cdf24bf44a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:15.952146 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598e433-78ce-49f0-ab55-8cdf24bf44a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:15.952427 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598e433-78ce-49f0-ab55-8cdf24bf44a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:15.953222 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598e433-78ce-49f0-ab55-8cdf24bf44a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:15.954287 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919e370-340c-46ad-a719-a079e1d03b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:15.954888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598e433-78ce-49f0-ab55-8cdf24bf44a5 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:15.955177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919e370-340c-46ad-a719-a079e1d03b55 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:15.955538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919e370-340c-46ad-a719-a079e1d03b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:15.955891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919e370-340c-46ad-a719-a079e1d03b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:15.966595 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919e370-340c-46ad-a719-a079e1d03b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:15.966935 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1043/2079] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:15.968371 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919e370-340c-46ad-a719-a079e1d03b55 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:15.972753 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598e433-78ce-49f0-ab55-8cdf24bf44a5 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:15.983941 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1037/2080] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:15.984459 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598e433-78ce-49f0-ab55-8cdf24bf44a5 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:15.989796 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7fb60-8909-4049-ae00-13a83ac3df99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:15.990615 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7fb60-8909-4049-ae00-13a83ac3df99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:15.990976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7fb60-8909-4049-ae00-13a83ac3df99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:15.991330 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7fb60-8909-4049-ae00-13a83ac3df99 admin admin] PATH_INFO: `/v3/projects/8f72b676c45d4a95b164187714cbf255/users/c7dd5f85fb1a49daa299475e6dc7ab24/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:16.011737 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7fb60-8909-4049-ae00-13a83ac3df99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f72b676c45d4a95b164187714cbf255, user_id=c7dd5f85fb1a49daa299475e6dc7ab24, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:16.015482 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7fb60-8909-4049-ae00-13a83ac3df99 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:16.028387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:16.036089 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1044/2081] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:15 2022] PUT /identity/v3/projects/8f72b676c45d4a95b164187714cbf255/users/c7dd5f85fb1a49daa299475e6dc7ab24/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:16.040938 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919e370-340c-46ad-a719-a079e1d03b55 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:16.053245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7fb60-8909-4049-ae00-13a83ac3df99 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:16.058860 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-a4a7fb60-8909-4049-ae00-13a83ac3df99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:16.059933 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919e370-340c-46ad-a719-a079e1d03b55 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:16.151685 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0343541-23d4-42a3-9631-698b85a928f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:16.151953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7fb60-8909-4049-ae00-13a83ac3df99 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:16.152603 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0343541-23d4-42a3-9631-698b85a928f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:16.153062 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0343541-23d4-42a3-9631-698b85a928f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:16.153336 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0343541-23d4-42a3-9631-698b85a928f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:16.154144 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0343541-23d4-42a3-9631-698b85a928f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:16.156428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0343541-23d4-42a3-9631-698b85a928f4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:16.157828 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e3e18-8fc0-4320-99ab-a0a40308ae77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:16.158906 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e3e18-8fc0-4320-99ab-a0a40308ae77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:16.159204 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e3e18-8fc0-4320-99ab-a0a40308ae77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:16.159488 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e3e18-8fc0-4320-99ab-a0a40308ae77 admin admin] PATH_INFO: `/v3/users/88a5c4281d9249fcbb0457b6bed5b0d5` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:16.160736 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e3e18-8fc0-4320-99ab-a0a40308ae77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88a5c4281d9249fcbb0457b6bed5b0d5)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:16.163647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e3e18-8fc0-4320-99ab-a0a40308ae77 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:16.182873 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1038/2082] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:16.194296 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0343541-23d4-42a3-9631-698b85a928f4 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:16.211671 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0343541-23d4-42a3-9631-698b85a928f4 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:16.220130 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fe67a-42b8-4614-8729-f5cf06740ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:16.223463 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fe67a-42b8-4614-8729-f5cf06740ede admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:16.223463 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fe67a-42b8-4614-8729-f5cf06740ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:16.223859 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fe67a-42b8-4614-8729-f5cf06740ede admin admin] PATH_INFO: `/v3/projects/8f72b676c45d4a95b164187714cbf255/users/c7dd5f85fb1a49daa299475e6dc7ab24/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:16.227038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fe67a-42b8-4614-8729-f5cf06740ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f72b676c45d4a95b164187714cbf255, user_id=c7dd5f85fb1a49daa299475e6dc7ab24, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:16.230264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fe67a-42b8-4614-8729-f5cf06740ede admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:16.241002 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d41e3e18-8fc0-4320-99ab-a0a40308ae77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88a5c4281d9249fcbb0457b6bed5b0d5'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:16.251234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1039/2083] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:16 2022] PUT /identity/v3/projects/8f72b676c45d4a95b164187714cbf255/users/c7dd5f85fb1a49daa299475e6dc7ab24/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:16.252896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d41e3e18-8fc0-4320-99ab-a0a40308ae77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88a5c4281d9249fcbb0457b6bed5b0d5'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:16.266433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74954cd-f331-423e-b48e-f1e883f902e5 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:16.266838 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74954cd-f331-423e-b48e-f1e883f902e5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:16.267544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74954cd-f331-423e-b48e-f1e883f902e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:16.268330 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d41e3e18-8fc0-4320-99ab-a0a40308ae77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88a5c4281d9249fcbb0457b6bed5b0d5'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:16.277087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d41e3e18-8fc0-4320-99ab-a0a40308ae77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88a5c4281d9249fcbb0457b6bed5b0d5'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:16.277878 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d41e3e18-8fc0-4320-99ab-a0a40308ae77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88a5c4281d9249fcbb0457b6bed5b0d5'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:16.285031 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1045/2084] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:16 2022] DELETE /identity/v3/users/88a5c4281d9249fcbb0457b6bed5b0d5 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:16.290191 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b359b-3ffb-4521-90f9-ead456062b4e None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:16.290495 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b359b-3ffb-4521-90f9-ead456062b4e None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:16.290806 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b359b-3ffb-4521-90f9-ead456062b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:16.297319 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d74954cd-f331-423e-b48e-f1e883f902e5 None None] MFA Rules not processed for user `c7dd5f85fb1a49daa299475e6dc7ab24`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:16.298586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d74954cd-f331-423e-b48e-f1e883f902e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:16.311670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-c83b359b-3ffb-4521-90f9-ead456062b4e None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:16.312876 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-c83b359b-3ffb-4521-90f9-ead456062b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:16.352568 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:16.386000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1040/2085] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:34:16.387088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74954cd-f331-423e-b48e-f1e883f902e5 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:16.388813 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d74954cd-f331-423e-b48e-f1e883f902e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:16.408208 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1046/2086] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:16.409194 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b359b-3ffb-4521-90f9-ead456062b4e None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:16.410635 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-c83b359b-3ffb-4521-90f9-ead456062b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:16.439790 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:16.495783 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74954cd-f331-423e-b48e-f1e883f902e5 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:16.496473 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b359b-3ffb-4521-90f9-ead456062b4e None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:16.501641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfade5f-fa5b-4bb2-af65-e663933d1735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:16.502335 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfade5f-fa5b-4bb2-af65-e663933d1735 service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:16.502536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfade5f-fa5b-4bb2-af65-e663933d1735 service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:16.502846 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfade5f-fa5b-4bb2-af65-e663933d1735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:16.512512 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e6a6b-92e2-4fac-be4f-702878764aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:16.513397 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e6a6b-92e2-4fac-be4f-702878764aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:16.513685 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e6a6b-92e2-4fac-be4f-702878764aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:16.513968 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e6a6b-92e2-4fac-be4f-702878764aab admin admin] PATH_INFO: `/v3/projects/8abe6fe55875470b9c1986e77f5f92c8` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:16.514404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfade5f-fa5b-4bb2-af65-e663933d1735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:16.515290 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e6a6b-92e2-4fac-be4f-702878764aab admin admin] RBAC: Authorizing `identity:delete_project(project_id=8abe6fe55875470b9c1986e77f5f92c8)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:16.516258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfade5f-fa5b-4bb2-af65-e663933d1735 service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:16.517388 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e6a6b-92e2-4fac-be4f-702878764aab admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:16.528394 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1047/2087] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:16.538614 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfade5f-fa5b-4bb2-af65-e663933d1735 service cinder] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:16.546490 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-dbfade5f-fa5b-4bb2-af65-e663933d1735 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:16.585673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-165e6a6b-92e2-4fac-be4f-702878764aab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8abe6fe55875470b9c1986e77f5f92c8', 'request_id': 'req-165e6a6b-92e2-4fac-be4f-702878764aab'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:16.612919 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-165e6a6b-92e2-4fac-be4f-702878764aab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8abe6fe55875470b9c1986e77f5f92c8', 'request_id': 'req-165e6a6b-92e2-4fac-be4f-702878764aab'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:16.639759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-165e6a6b-92e2-4fac-be4f-702878764aab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8abe6fe55875470b9c1986e77f5f92c8', 'request_id': 'req-165e6a6b-92e2-4fac-be4f-702878764aab'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:16.656054 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-165e6a6b-92e2-4fac-be4f-702878764aab admin admin] The token cache is being invalidate because project 8abe6fe55875470b9c1986e77f5f92c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:16.656351 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-165e6a6b-92e2-4fac-be4f-702878764aab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:16.657033 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-165e6a6b-92e2-4fac-be4f-702878764aab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:16.658945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1041/2088] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:16 2022] DELETE /identity/v3/projects/8abe6fe55875470b9c1986e77f5f92c8 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:16.663195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e6a6b-92e2-4fac-be4f-702878764aab admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:16.666370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-165e6a6b-92e2-4fac-be4f-702878764aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:16.680880 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfade5f-fa5b-4bb2-af65-e663933d1735 service cinder] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:16.754442 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91174b8-498d-472a-b031-21188e69247f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:16.755168 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91174b8-498d-472a-b031-21188e69247f service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:16.755455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91174b8-498d-472a-b031-21188e69247f service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:16.755736 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91174b8-498d-472a-b031-21188e69247f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:16.757657 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-d91174b8-498d-472a-b031-21188e69247f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:16.763728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e6a6b-92e2-4fac-be4f-702878764aab admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:16.772642 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91174b8-498d-472a-b031-21188e69247f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:16.773038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaef6f2-84dd-4e00-8334-6b086af96c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:16.773978 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaef6f2-84dd-4e00-8334-6b086af96c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:16.774337 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaef6f2-84dd-4e00-8334-6b086af96c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:16.774574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91174b8-498d-472a-b031-21188e69247f service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:16.774782 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaef6f2-84dd-4e00-8334-6b086af96c0b admin admin] PATH_INFO: `/v3/users/aecdaf28d7584678b92bd61c3313c633` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:16.776008 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaef6f2-84dd-4e00-8334-6b086af96c0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aecdaf28d7584678b92bd61c3313c633)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:16.779391 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaef6f2-84dd-4e00-8334-6b086af96c0b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:16.786490 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1048/2089] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:16.796233 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:16.853813 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3eaef6f2-84dd-4e00-8334-6b086af96c0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aecdaf28d7584678b92bd61c3313c633'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:16.863334 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3eaef6f2-84dd-4e00-8334-6b086af96c0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aecdaf28d7584678b92bd61c3313c633'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:16.864207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3eaef6f2-84dd-4e00-8334-6b086af96c0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aecdaf28d7584678b92bd61c3313c633'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:16.865125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3eaef6f2-84dd-4e00-8334-6b086af96c0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aecdaf28d7584678b92bd61c3313c633'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:16.880278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3eaef6f2-84dd-4e00-8334-6b086af96c0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aecdaf28d7584678b92bd61c3313c633'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:16.925581 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1042/2090] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:16 2022] DELETE /identity/v3/users/aecdaf28d7584678b92bd61c3313c633 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:17.065719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91174b8-498d-472a-b031-21188e69247f service neutron] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:17.067266 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-d91174b8-498d-472a-b031-21188e69247f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:17.079477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91174b8-498d-472a-b031-21188e69247f service neutron] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:17.140084 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e60a2b-0094-445d-9a50-8f81c1fd4dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:17.140812 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e60a2b-0094-445d-9a50-8f81c1fd4dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:17.141106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e60a2b-0094-445d-9a50-8f81c1fd4dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:17.141388 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e60a2b-0094-445d-9a50-8f81c1fd4dd3 admin admin] PATH_INFO: `/v3/users/70fd7589ebfa4efea91fa148132769b9` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:17.142697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e60a2b-0094-445d-9a50-8f81c1fd4dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70fd7589ebfa4efea91fa148132769b9)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:17.144635 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e60a2b-0094-445d-9a50-8f81c1fd4dd3 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:17.172750 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:17.205675 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-f6e60a2b-0094-445d-9a50-8f81c1fd4dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70fd7589ebfa4efea91fa148132769b9'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:17.219334 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-f6e60a2b-0094-445d-9a50-8f81c1fd4dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70fd7589ebfa4efea91fa148132769b9'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:17.236509 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-f6e60a2b-0094-445d-9a50-8f81c1fd4dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70fd7589ebfa4efea91fa148132769b9'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:17.237241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaef6f2-84dd-4e00-8334-6b086af96c0b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:17.239893 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3eaef6f2-84dd-4e00-8334-6b086af96c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:17.247434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-f6e60a2b-0094-445d-9a50-8f81c1fd4dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70fd7589ebfa4efea91fa148132769b9'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:17.248289 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-f6e60a2b-0094-445d-9a50-8f81c1fd4dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70fd7589ebfa4efea91fa148132769b9'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:17.259319 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaef6f2-84dd-4e00-8334-6b086af96c0b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:17.265279 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1049/2091] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:17 2022] DELETE /identity/v3/users/70fd7589ebfa4efea91fa148132769b9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:17.266914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5131d-7c62-400b-8891-0595004b8777 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:17.267171 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5131d-7c62-400b-8891-0595004b8777 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:17.267460 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5131d-7c62-400b-8891-0595004b8777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:17.269321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182653c-2c30-4b99-be8d-808d31eafacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:17.280691 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182653c-2c30-4b99-be8d-808d31eafacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:17.280989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182653c-2c30-4b99-be8d-808d31eafacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:17.281270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182653c-2c30-4b99-be8d-808d31eafacb admin admin] PATH_INFO: `/v3/projects/34553bb11b584daba511812722e24dd9` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:17.283470 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182653c-2c30-4b99-be8d-808d31eafacb admin admin] RBAC: Authorizing `identity:delete_project(project_id=34553bb11b584daba511812722e24dd9)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:17.285609 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182653c-2c30-4b99-be8d-808d31eafacb admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:17.292745 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-68d5131d-7c62-400b-8891-0595004b8777 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:17.294191 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-68d5131d-7c62-400b-8891-0595004b8777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:17.371559 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7182653c-2c30-4b99-be8d-808d31eafacb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34553bb11b584daba511812722e24dd9', 'request_id': 'req-7182653c-2c30-4b99-be8d-808d31eafacb'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:17.381520 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7182653c-2c30-4b99-be8d-808d31eafacb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34553bb11b584daba511812722e24dd9', 'request_id': 'req-7182653c-2c30-4b99-be8d-808d31eafacb'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:17.385861 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1050/2092] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:17.386922 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5131d-7c62-400b-8891-0595004b8777 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:17.388516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-68d5131d-7c62-400b-8891-0595004b8777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:17.403712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7182653c-2c30-4b99-be8d-808d31eafacb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34553bb11b584daba511812722e24dd9', 'request_id': 'req-7182653c-2c30-4b99-be8d-808d31eafacb'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:17.415516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5131d-7c62-400b-8891-0595004b8777 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:17.418328 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7182653c-2c30-4b99-be8d-808d31eafacb admin admin] The token cache is being invalidate because project 34553bb11b584daba511812722e24dd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:17.418652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7182653c-2c30-4b99-be8d-808d31eafacb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:17.419279 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7182653c-2c30-4b99-be8d-808d31eafacb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:17.420904 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1043/2093] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:17 2022] DELETE /identity/v3/projects/34553bb11b584daba511812722e24dd9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:17.421776 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182653c-2c30-4b99-be8d-808d31eafacb admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:17.423811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7182653c-2c30-4b99-be8d-808d31eafacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:17.476842 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f06139-df08-4fb3-95d0-e29c53024111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:17.477661 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f06139-df08-4fb3-95d0-e29c53024111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:17.477943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f06139-df08-4fb3-95d0-e29c53024111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:17.478380 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f06139-df08-4fb3-95d0-e29c53024111 admin admin] PATH_INFO: `/v3/projects/dac86c7953604ed780b1978608224833` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:17.479722 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f06139-df08-4fb3-95d0-e29c53024111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dac86c7953604ed780b1978608224833)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:17.481844 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f06139-df08-4fb3-95d0-e29c53024111 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:17.485320 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182653c-2c30-4b99-be8d-808d31eafacb admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:17.489061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae726c7-cce6-4275-95c7-b4624b5d762c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:17.489884 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae726c7-cce6-4275-95c7-b4624b5d762c service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:17.490172 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae726c7-cce6-4275-95c7-b4624b5d762c service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:17.490452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae726c7-cce6-4275-95c7-b4624b5d762c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:17.492406 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9ae726c7-cce6-4275-95c7-b4624b5d762c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:17.504395 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae726c7-cce6-4275-95c7-b4624b5d762c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:17.506707 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae726c7-cce6-4275-95c7-b4624b5d762c service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:17.517556 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1044/2094] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:17.518376 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae726c7-cce6-4275-95c7-b4624b5d762c service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:17.519813 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9ae726c7-cce6-4275-95c7-b4624b5d762c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:17.533565 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae726c7-cce6-4275-95c7-b4624b5d762c service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:17.535700 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:17.542614 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-40f06139-df08-4fb3-95d0-e29c53024111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dac86c7953604ed780b1978608224833', 'request_id': 'req-40f06139-df08-4fb3-95d0-e29c53024111'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:17.547404 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:17.552853 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-40f06139-df08-4fb3-95d0-e29c53024111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dac86c7953604ed780b1978608224833', 'request_id': 'req-40f06139-df08-4fb3-95d0-e29c53024111'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:17.564245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-40f06139-df08-4fb3-95d0-e29c53024111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dac86c7953604ed780b1978608224833', 'request_id': 'req-40f06139-df08-4fb3-95d0-e29c53024111'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:17.582239 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-40f06139-df08-4fb3-95d0-e29c53024111 admin admin] The token cache is being invalidate because project dac86c7953604ed780b1978608224833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:17.582618 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-40f06139-df08-4fb3-95d0-e29c53024111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:17.583306 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-40f06139-df08-4fb3-95d0-e29c53024111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:17.584933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1051/2095] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:17 2022] DELETE /identity/v3/projects/dac86c7953604ed780b1978608224833 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:17.591950 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40959c6f-9346-4f97-a9b7-b90574d080d3 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:17.592400 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40959c6f-9346-4f97-a9b7-b90574d080d3 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:17.592888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40959c6f-9346-4f97-a9b7-b90574d080d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:17.613281 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-40959c6f-9346-4f97-a9b7-b90574d080d3 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:17.614530 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-40959c6f-9346-4f97-a9b7-b90574d080d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:17.631256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fc404-ed01-4177-bb36-eaa7fa8825b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:17.632685 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fc404-ed01-4177-bb36-eaa7fa8825b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:17.633205 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fc404-ed01-4177-bb36-eaa7fa8825b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:17.634280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fc404-ed01-4177-bb36-eaa7fa8825b7 admin admin] PATH_INFO: `/v3/users/3b6b756f45844c90b104fc94fe653a91` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:17.636857 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fc404-ed01-4177-bb36-eaa7fa8825b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b6b756f45844c90b104fc94fe653a91)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:17.641078 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fc404-ed01-4177-bb36-eaa7fa8825b7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:17.682738 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1052/2096] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:17.690049 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34e2ff-841e-481b-a1a8-7607047cdc5d None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:17.690414 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34e2ff-841e-481b-a1a8-7607047cdc5d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:17.690729 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34e2ff-841e-481b-a1a8-7607047cdc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:17.711564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-9e34e2ff-841e-481b-a1a8-7607047cdc5d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:17.713895 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-9e34e2ff-841e-481b-a1a8-7607047cdc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:17.725585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bc3fc404-ed01-4177-bb36-eaa7fa8825b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b6b756f45844c90b104fc94fe653a91'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:17.737820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bc3fc404-ed01-4177-bb36-eaa7fa8825b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b6b756f45844c90b104fc94fe653a91'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:17.740496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bc3fc404-ed01-4177-bb36-eaa7fa8825b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b6b756f45844c90b104fc94fe653a91'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:17.742340 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bc3fc404-ed01-4177-bb36-eaa7fa8825b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b6b756f45844c90b104fc94fe653a91'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:17.747452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1053/2097] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:34:17.751832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34e2ff-841e-481b-a1a8-7607047cdc5d None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:17.763579 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34e2ff-841e-481b-a1a8-7607047cdc5d None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:17.770279 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59521557-8c74-4203-8f08-45baf33d02d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:17.770999 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59521557-8c74-4203-8f08-45baf33d02d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:17.771417 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59521557-8c74-4203-8f08-45baf33d02d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:17.771693 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59521557-8c74-4203-8f08-45baf33d02d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:17.773403 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59521557-8c74-4203-8f08-45baf33d02d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:17.773744 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59521557-8c74-4203-8f08-45baf33d02d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:17.775907 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59521557-8c74-4203-8f08-45baf33d02d2 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:17.789985 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bc3fc404-ed01-4177-bb36-eaa7fa8825b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b6b756f45844c90b104fc94fe653a91'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:17.796452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1054/2098] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:17.797664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59521557-8c74-4203-8f08-45baf33d02d2 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:17.802409 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-59521557-8c74-4203-8f08-45baf33d02d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:17.808821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1045/2099] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:17 2022] DELETE /identity/v3/users/3b6b756f45844c90b104fc94fe653a91 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:17.818897 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59521557-8c74-4203-8f08-45baf33d02d2 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:17.902857 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6ef6f-c0cb-4d2e-aac1-91e6befc1bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:17.903558 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6ef6f-c0cb-4d2e-aac1-91e6befc1bfc admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:17.903843 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6ef6f-c0cb-4d2e-aac1-91e6befc1bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:17.904118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6ef6f-c0cb-4d2e-aac1-91e6befc1bfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:17.904816 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6ef6f-c0cb-4d2e-aac1-91e6befc1bfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:17.906802 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6ef6f-c0cb-4d2e-aac1-91e6befc1bfc admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:17.910273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fc404-ed01-4177-bb36-eaa7fa8825b7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:17.912465 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bc3fc404-ed01-4177-bb36-eaa7fa8825b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:17.932944 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fc404-ed01-4177-bb36-eaa7fa8825b7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:17.939456 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52873324-1253-4fd5-bae3-4254d6e58f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:17.940422 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52873324-1253-4fd5-bae3-4254d6e58f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:17.940707 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52873324-1253-4fd5-bae3-4254d6e58f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:17.940982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52873324-1253-4fd5-bae3-4254d6e58f4b admin admin] PATH_INFO: `/v3/projects/778929568b4741e49a7665b02f2e85db` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:17.942192 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52873324-1253-4fd5-bae3-4254d6e58f4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=778929568b4741e49a7665b02f2e85db)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:17.947052 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1055/2100] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:17 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:17.947439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52873324-1253-4fd5-bae3-4254d6e58f4b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:17.952597 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6ef6f-c0cb-4d2e-aac1-91e6befc1bfc admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:18.003588 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:18.020996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-52873324-1253-4fd5-bae3-4254d6e58f4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '778929568b4741e49a7665b02f2e85db', 'request_id': 'req-52873324-1253-4fd5-bae3-4254d6e58f4b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:18.029858 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-52873324-1253-4fd5-bae3-4254d6e58f4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '778929568b4741e49a7665b02f2e85db', 'request_id': 'req-52873324-1253-4fd5-bae3-4254d6e58f4b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:18.043054 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-52873324-1253-4fd5-bae3-4254d6e58f4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '778929568b4741e49a7665b02f2e85db', 'request_id': 'req-52873324-1253-4fd5-bae3-4254d6e58f4b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:18.049716 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6ef6f-c0cb-4d2e-aac1-91e6befc1bfc admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:18.067539 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-52873324-1253-4fd5-bae3-4254d6e58f4b admin admin] The token cache is being invalidate because project 778929568b4741e49a7665b02f2e85db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:18.068382 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-52873324-1253-4fd5-bae3-4254d6e58f4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:18.068883 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-52873324-1253-4fd5-bae3-4254d6e58f4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:18.070998 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1046/2101] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:17 2022] DELETE /identity/v3/projects/778929568b4741e49a7665b02f2e85db => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:18.075838 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52873324-1253-4fd5-bae3-4254d6e58f4b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:18.077526 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-52873324-1253-4fd5-bae3-4254d6e58f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:18.102146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:18.136032 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78294175-8ade-4e6b-b274-8c205c33cd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:18.136984 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78294175-8ade-4e6b-b274-8c205c33cd5f admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:18.138709 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78294175-8ade-4e6b-b274-8c205c33cd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:18.138908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78294175-8ade-4e6b-b274-8c205c33cd5f admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:18.139674 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78294175-8ade-4e6b-b274-8c205c33cd5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:18.141664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78294175-8ade-4e6b-b274-8c205c33cd5f admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:18.169042 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1056/2102] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:17 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:18.169042 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78294175-8ade-4e6b-b274-8c205c33cd5f admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:18.169728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-78294175-8ade-4e6b-b274-8c205c33cd5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:18.182079 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78294175-8ade-4e6b-b274-8c205c33cd5f admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:18.194718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b09b0c-533b-4816-8b89-35e28ebbbc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:18.195533 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b09b0c-533b-4816-8b89-35e28ebbbc19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:18.195920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b09b0c-533b-4816-8b89-35e28ebbbc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:18.196894 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b09b0c-533b-4816-8b89-35e28ebbbc19 admin admin] PATH_INFO: `/v3/projects/a139707b3845454b9556060dd18cad85` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:18.198210 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52873324-1253-4fd5-bae3-4254d6e58f4b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:18.199899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b09b0c-533b-4816-8b89-35e28ebbbc19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a139707b3845454b9556060dd18cad85)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:18.202470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b09b0c-533b-4816-8b89-35e28ebbbc19 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:18.207486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7455446-d179-41d3-ac0e-540c847ba2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:18.208473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7455446-d179-41d3-ac0e-540c847ba2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:18.208969 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7455446-d179-41d3-ac0e-540c847ba2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:18.209311 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7455446-d179-41d3-ac0e-540c847ba2c6 admin admin] PATH_INFO: `/v3/users/c7dd5f85fb1a49daa299475e6dc7ab24` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:18.210850 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7455446-d179-41d3-ac0e-540c847ba2c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7dd5f85fb1a49daa299475e6dc7ab24)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:18.213644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7455446-d179-41d3-ac0e-540c847ba2c6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:18.254518 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-47b09b0c-533b-4816-8b89-35e28ebbbc19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a139707b3845454b9556060dd18cad85', 'request_id': 'req-47b09b0c-533b-4816-8b89-35e28ebbbc19'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:18.262235 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-47b09b0c-533b-4816-8b89-35e28ebbbc19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a139707b3845454b9556060dd18cad85', 'request_id': 'req-47b09b0c-533b-4816-8b89-35e28ebbbc19'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:18.270418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-47b09b0c-533b-4816-8b89-35e28ebbbc19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a139707b3845454b9556060dd18cad85', 'request_id': 'req-47b09b0c-533b-4816-8b89-35e28ebbbc19'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:18.278332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f7455446-d179-41d3-ac0e-540c847ba2c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7dd5f85fb1a49daa299475e6dc7ab24'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:18.281995 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-47b09b0c-533b-4816-8b89-35e28ebbbc19 admin admin] The token cache is being invalidate because project a139707b3845454b9556060dd18cad85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:18.282346 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-47b09b0c-533b-4816-8b89-35e28ebbbc19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:18.283028 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-47b09b0c-533b-4816-8b89-35e28ebbbc19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:18.284874 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1057/2103] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:18 2022] DELETE /identity/v3/projects/a139707b3845454b9556060dd18cad85 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:18.285561 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b09b0c-533b-4816-8b89-35e28ebbbc19 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:18.287263 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-47b09b0c-533b-4816-8b89-35e28ebbbc19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:18.289521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f7455446-d179-41d3-ac0e-540c847ba2c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7dd5f85fb1a49daa299475e6dc7ab24'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:18.291438 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f7455446-d179-41d3-ac0e-540c847ba2c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7dd5f85fb1a49daa299475e6dc7ab24'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:18.291579 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f7455446-d179-41d3-ac0e-540c847ba2c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7dd5f85fb1a49daa299475e6dc7ab24'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:18.305874 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f7455446-d179-41d3-ac0e-540c847ba2c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7dd5f85fb1a49daa299475e6dc7ab24'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:18.324942 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1047/2104] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:18 2022] DELETE /identity/v3/users/c7dd5f85fb1a49daa299475e6dc7ab24 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:18.327262 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9b74d-598c-4c34-bec9-f358c79cae2b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:18.327667 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9b74d-598c-4c34-bec9-f358c79cae2b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:18.327959 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9b74d-598c-4c34-bec9-f358c79cae2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:18.349556 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7fb9b74d-598c-4c34-bec9-f358c79cae2b None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:18.351351 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7fb9b74d-598c-4c34-bec9-f358c79cae2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:18.372258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:18.381988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b09b0c-533b-4816-8b89-35e28ebbbc19 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:18.431199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1048/2105] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:18.436502 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359c860-a231-4f02-870b-84432ad954ea None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:18.436910 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359c860-a231-4f02-870b-84432ad954ea None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:18.437190 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359c860-a231-4f02-870b-84432ad954ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:18.472798 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-e359c860-a231-4f02-870b-84432ad954ea None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:18.474033 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e359c860-a231-4f02-870b-84432ad954ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:18.498314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1049/2106] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:18.502119 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aca0ef-dafb-4c28-b470-3ec75a22f169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:18.502312 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359c860-a231-4f02-870b-84432ad954ea None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:18.503827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aca0ef-dafb-4c28-b470-3ec75a22f169 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:18.504154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aca0ef-dafb-4c28-b470-3ec75a22f169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:18.505645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aca0ef-dafb-4c28-b470-3ec75a22f169 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:18.506414 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aca0ef-dafb-4c28-b470-3ec75a22f169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:18.510319 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aca0ef-dafb-4c28-b470-3ec75a22f169 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:18.514613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359c860-a231-4f02-870b-84432ad954ea None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:18.521414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44186567-85a6-44c9-9c50-a1a704744f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:18.522112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44186567-85a6-44c9-9c50-a1a704744f90 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:18.522430 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44186567-85a6-44c9-9c50-a1a704744f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:18.522988 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44186567-85a6-44c9-9c50-a1a704744f90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:18.525799 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44186567-85a6-44c9-9c50-a1a704744f90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:18.526176 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44186567-85a6-44c9-9c50-a1a704744f90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:18.528050 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44186567-85a6-44c9-9c50-a1a704744f90 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:18.534608 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1058/2107] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:18.537028 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aca0ef-dafb-4c28-b470-3ec75a22f169 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:18.548093 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1050/2108] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:18.552675 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-66aca0ef-dafb-4c28-b470-3ec75a22f169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:18.553136 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44186567-85a6-44c9-9c50-a1a704744f90 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:18.579230 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aca0ef-dafb-4c28-b470-3ec75a22f169 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:18.581976 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44186567-85a6-44c9-9c50-a1a704744f90 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:18.597571 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428c04f-8a53-4874-ba43-dabc6b898bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:18.599826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428c04f-8a53-4874-ba43-dabc6b898bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:18.600575 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdb7ac-2e63-44f1-a7b7-e8f82c121ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:18.600708 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428c04f-8a53-4874-ba43-dabc6b898bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:18.601094 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428c04f-8a53-4874-ba43-dabc6b898bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:18.601303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdb7ac-2e63-44f1-a7b7-e8f82c121ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:18.601647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdb7ac-2e63-44f1-a7b7-e8f82c121ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:18.601979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdb7ac-2e63-44f1-a7b7-e8f82c121ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:18.602533 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428c04f-8a53-4874-ba43-dabc6b898bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:18.603938 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bdb7ac-2e63-44f1-a7b7-e8f82c121ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:18.606087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428c04f-8a53-4874-ba43-dabc6b898bb0 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:18.608393 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bdb7ac-2e63-44f1-a7b7-e8f82c121ad2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:18.629029 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1059/2109] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:18.630321 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428c04f-8a53-4874-ba43-dabc6b898bb0 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:18.645199 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428c04f-8a53-4874-ba43-dabc6b898bb0 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:18.645461 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:18.653833 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8335f-4f98-4f08-977c-bf12b8282497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:18.654902 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8335f-4f98-4f08-977c-bf12b8282497 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:18.655192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8335f-4f98-4f08-977c-bf12b8282497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:18.655527 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8335f-4f98-4f08-977c-bf12b8282497 admin admin] PATH_INFO: `/v3/projects/2fcb3c82c27e476ea14628195b486b67/users/1b63ed9ad32b4a4bb85c1f791c2fb356/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:18.674371 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1051/2110] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:18 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:18.681455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8335f-4f98-4f08-977c-bf12b8282497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fcb3c82c27e476ea14628195b486b67, user_id=1b63ed9ad32b4a4bb85c1f791c2fb356, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:18.682838 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdb7ac-2e63-44f1-a7b7-e8f82c121ad2 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:18.685833 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8335f-4f98-4f08-977c-bf12b8282497 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:18.710691 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1060/2111] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:18 2022] PUT /identity/v3/projects/2fcb3c82c27e476ea14628195b486b67/users/1b63ed9ad32b4a4bb85c1f791c2fb356/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:18.723325 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d66b08-ca97-444d-910f-310a0866fa43 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:18.723681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d66b08-ca97-444d-910f-310a0866fa43 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:18.724014 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d66b08-ca97-444d-910f-310a0866fa43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:18.757860 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-e3d66b08-ca97-444d-910f-310a0866fa43 None None] MFA Rules not processed for user `1b63ed9ad32b4a4bb85c1f791c2fb356`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:18.761685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e3d66b08-ca97-444d-910f-310a0866fa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:18.813330 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdb7ac-2e63-44f1-a7b7-e8f82c121ad2 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:18.842687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1061/2112] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:18.842687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d66b08-ca97-444d-910f-310a0866fa43 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:18.843002 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e3d66b08-ca97-444d-910f-310a0866fa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:18.883109 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3f8b1-95e0-475c-ac82-f2f1cdebfb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:18.884563 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3f8b1-95e0-475c-ac82-f2f1cdebfb7c admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:18.885573 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3f8b1-95e0-475c-ac82-f2f1cdebfb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:18.885573 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3f8b1-95e0-475c-ac82-f2f1cdebfb7c admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:18.885795 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3f8b1-95e0-475c-ac82-f2f1cdebfb7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:18.887815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3f8b1-95e0-475c-ac82-f2f1cdebfb7c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:18.915941 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1052/2113] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:18 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:34:18.915941 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3f8b1-95e0-475c-ac82-f2f1cdebfb7c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:18.928220 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3f8b1-95e0-475c-ac82-f2f1cdebfb7c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:18.931406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:18.934917 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f56aa6-e6a1-498d-aecb-e887ec966247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:18.935651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f56aa6-e6a1-498d-aecb-e887ec966247 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:18.935950 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f56aa6-e6a1-498d-aecb-e887ec966247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:18.936222 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f56aa6-e6a1-498d-aecb-e887ec966247 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:18.936977 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f56aa6-e6a1-498d-aecb-e887ec966247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:18.939123 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f56aa6-e6a1-498d-aecb-e887ec966247 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:18.940368 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d66b08-ca97-444d-910f-310a0866fa43 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:18.948368 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe629d8-e85b-44be-8995-bc949699d3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:18.949229 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe629d8-e85b-44be-8995-bc949699d3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:18.949515 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe629d8-e85b-44be-8995-bc949699d3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:18.949791 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe629d8-e85b-44be-8995-bc949699d3a7 admin admin] PATH_INFO: `/v3/projects/8f72b676c45d4a95b164187714cbf255` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:18.951025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe629d8-e85b-44be-8995-bc949699d3a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f72b676c45d4a95b164187714cbf255)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:18.953007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe629d8-e85b-44be-8995-bc949699d3a7 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:18.971566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1053/2114] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:18 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:18.972574 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f56aa6-e6a1-498d-aecb-e887ec966247 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.034600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ffe629d8-e85b-44be-8995-bc949699d3a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f72b676c45d4a95b164187714cbf255', 'request_id': 'req-ffe629d8-e85b-44be-8995-bc949699d3a7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:19.043538 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ffe629d8-e85b-44be-8995-bc949699d3a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f72b676c45d4a95b164187714cbf255', 'request_id': 'req-ffe629d8-e85b-44be-8995-bc949699d3a7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:19.053918 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ffe629d8-e85b-44be-8995-bc949699d3a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f72b676c45d4a95b164187714cbf255', 'request_id': 'req-ffe629d8-e85b-44be-8995-bc949699d3a7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:19.066203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ffe629d8-e85b-44be-8995-bc949699d3a7 admin admin] The token cache is being invalidate because project 8f72b676c45d4a95b164187714cbf255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:19.066574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ffe629d8-e85b-44be-8995-bc949699d3a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:19.067261 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ffe629d8-e85b-44be-8995-bc949699d3a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:19.069454 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1062/2115] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:18 2022] DELETE /identity/v3/projects/8f72b676c45d4a95b164187714cbf255 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:19.073156 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f56aa6-e6a1-498d-aecb-e887ec966247 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.076503 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe629d8-e85b-44be-8995-bc949699d3a7 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.081000 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ffe629d8-e85b-44be-8995-bc949699d3a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:19.087959 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:19.157947 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921a131-c9a8-49c2-8425-cb81d32ea17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.158697 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921a131-c9a8-49c2-8425-cb81d32ea17d admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.159027 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921a131-c9a8-49c2-8425-cb81d32ea17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.159288 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921a131-c9a8-49c2-8425-cb81d32ea17d admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.160040 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921a131-c9a8-49c2-8425-cb81d32ea17d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.161689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921a131-c9a8-49c2-8425-cb81d32ea17d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.174558 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1054/2116] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:19.174965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0570f-ad50-43b9-8628-d3433a16a90b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.175264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0570f-ad50-43b9-8628-d3433a16a90b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.175613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0570f-ad50-43b9-8628-d3433a16a90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.191162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe629d8-e85b-44be-8995-bc949699d3a7 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.196636 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528dfdf-952a-4d19-9bff-8dbb234da5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.197292 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528dfdf-952a-4d19-9bff-8dbb234da5e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.197580 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528dfdf-952a-4d19-9bff-8dbb234da5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.197858 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528dfdf-952a-4d19-9bff-8dbb234da5e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.198734 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528dfdf-952a-4d19-9bff-8dbb234da5e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.199340 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ebc0570f-ad50-43b9-8628-d3433a16a90b None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:19.200676 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528dfdf-952a-4d19-9bff-8dbb234da5e9 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.200773 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ebc0570f-ad50-43b9-8628-d3433a16a90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:19.209300 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1055/2117] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:19.212887 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0570f-ad50-43b9-8628-d3433a16a90b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.216342 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ebc0570f-ad50-43b9-8628-d3433a16a90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:19.225268 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1063/2118] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:19 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:19.226725 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581350ee-aaad-4658-9724-7da8806793d5 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.227020 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581350ee-aaad-4658-9724-7da8806793d5 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.227424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581350ee-aaad-4658-9724-7da8806793d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.230059 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0570f-ad50-43b9-8628-d3433a16a90b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.235426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463ad13-b45f-446e-bf9f-05da885c6321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.236123 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463ad13-b45f-446e-bf9f-05da885c6321 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.236411 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463ad13-b45f-446e-bf9f-05da885c6321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.237535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463ad13-b45f-446e-bf9f-05da885c6321 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.238313 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463ad13-b45f-446e-bf9f-05da885c6321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.243195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463ad13-b45f-446e-bf9f-05da885c6321 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.247371 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-581350ee-aaad-4658-9724-7da8806793d5 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:19.248523 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-581350ee-aaad-4658-9724-7da8806793d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:19.254231 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1056/2119] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:19.254964 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463ad13-b45f-446e-bf9f-05da885c6321 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.261956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1064/2120] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:19.263039 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581350ee-aaad-4658-9724-7da8806793d5 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.267831 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463ad13-b45f-446e-bf9f-05da885c6321 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.273720 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65942c6-db97-4d12-86c5-d6f517965ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.273903 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581350ee-aaad-4658-9724-7da8806793d5 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.275313 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65942c6-db97-4d12-86c5-d6f517965ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.275781 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65942c6-db97-4d12-86c5-d6f517965ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.276234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65942c6-db97-4d12-86c5-d6f517965ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.277023 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65942c6-db97-4d12-86c5-d6f517965ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.279062 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65942c6-db97-4d12-86c5-d6f517965ee0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.281005 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c58e3e-a6d4-4597-92de-3c23baedb2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.282550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c58e3e-a6d4-4597-92de-3c23baedb2fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.282674 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c58e3e-a6d4-4597-92de-3c23baedb2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.283056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c58e3e-a6d4-4597-92de-3c23baedb2fb admin admin] PATH_INFO: `/v3/projects/47837e6fac3c455ea30e571931ce7496/users/7c2be925f5dd40faa2fc99d1f289eceb/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.295341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1057/2121] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:19.297231 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65942c6-db97-4d12-86c5-d6f517965ee0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.307226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c58e3e-a6d4-4597-92de-3c23baedb2fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=47837e6fac3c455ea30e571931ce7496, user_id=7c2be925f5dd40faa2fc99d1f289eceb, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.309393 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65942c6-db97-4d12-86c5-d6f517965ee0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.310019 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c58e3e-a6d4-4597-92de-3c23baedb2fb admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.314554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae1905-ecbf-4b86-8970-0c452116d019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.315421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae1905-ecbf-4b86-8970-0c452116d019 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.315712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae1905-ecbf-4b86-8970-0c452116d019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.316145 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae1905-ecbf-4b86-8970-0c452116d019 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.317383 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae1905-ecbf-4b86-8970-0c452116d019 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:19.318149 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae1905-ecbf-4b86-8970-0c452116d019 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.320809 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae1905-ecbf-4b86-8970-0c452116d019 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.324870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1065/2122] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:19 2022] PUT /identity/v3/projects/47837e6fac3c455ea30e571931ce7496/users/7c2be925f5dd40faa2fc99d1f289eceb/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:19.332072 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c58e3e-a6d4-4597-92de-3c23baedb2fb admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.337296 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1058/2123] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:19.338821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72d44a-9fa2-44f1-ad7e-998591271350 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.339110 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72d44a-9fa2-44f1-ad7e-998591271350 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.339381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72d44a-9fa2-44f1-ad7e-998591271350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.369738 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-cf72d44a-9fa2-44f1-ad7e-998591271350 None None] MFA Rules not processed for user `7c2be925f5dd40faa2fc99d1f289eceb`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:19.371213 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cf72d44a-9fa2-44f1-ad7e-998591271350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:19.387365 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:19.405323 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c58e3e-a6d4-4597-92de-3c23baedb2fb admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.410030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5a026-b0f3-4d46-9522-0e3227b83cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.410728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5a026-b0f3-4d46-9522-0e3227b83cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.411016 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5a026-b0f3-4d46-9522-0e3227b83cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.411293 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5a026-b0f3-4d46-9522-0e3227b83cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.412275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5a026-b0f3-4d46-9522-0e3227b83cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.413813 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5a026-b0f3-4d46-9522-0e3227b83cb5 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.424484 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1066/2124] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:19.425279 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5a026-b0f3-4d46-9522-0e3227b83cb5 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.435056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5a026-b0f3-4d46-9522-0e3227b83cb5 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.439844 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373224c-481c-48ff-8797-cfe3e47b62ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.440634 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373224c-481c-48ff-8797-cfe3e47b62ca admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.440894 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373224c-481c-48ff-8797-cfe3e47b62ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.441267 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373224c-481c-48ff-8797-cfe3e47b62ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.442007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373224c-481c-48ff-8797-cfe3e47b62ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.443439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1059/2125] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:19.444102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72d44a-9fa2-44f1-ad7e-998591271350 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.444221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373224c-481c-48ff-8797-cfe3e47b62ca admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.459106 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72d44a-9fa2-44f1-ad7e-998591271350 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.464621 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974ab40-c307-4bc7-adba-517167b54239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.465786 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974ab40-c307-4bc7-adba-517167b54239 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.466306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974ab40-c307-4bc7-adba-517167b54239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.466631 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974ab40-c307-4bc7-adba-517167b54239 admin admin] PATH_INFO: `/v3/projects/67e265510e774e4faa7460d42fcf90e4/users/d445f2ca06f54853beb1bb518ffb41ab/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.478675 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1067/2126] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:19 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:19.478675 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373224c-481c-48ff-8797-cfe3e47b62ca admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.483475 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974ab40-c307-4bc7-adba-517167b54239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67e265510e774e4faa7460d42fcf90e4, user_id=d445f2ca06f54853beb1bb518ffb41ab, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.486168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974ab40-c307-4bc7-adba-517167b54239 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.500379 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1060/2127] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:19 2022] PUT /identity/v3/projects/67e265510e774e4faa7460d42fcf90e4/users/d445f2ca06f54853beb1bb518ffb41ab/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:19.509804 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974ab40-c307-4bc7-adba-517167b54239 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.542172 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373224c-481c-48ff-8797-cfe3e47b62ca admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.549484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:19.575487 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974ab40-c307-4bc7-adba-517167b54239 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.580672 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc471d81-9419-40fe-9567-6e61988889e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.581384 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc471d81-9419-40fe-9567-6e61988889e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.581672 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc471d81-9419-40fe-9567-6e61988889e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.581952 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc471d81-9419-40fe-9567-6e61988889e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.582692 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc471d81-9419-40fe-9567-6e61988889e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.584691 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc471d81-9419-40fe-9567-6e61988889e1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.601081 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99999f-24af-4100-822a-0700c40d0744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.601763 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99999f-24af-4100-822a-0700c40d0744 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.602047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99999f-24af-4100-822a-0700c40d0744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.602877 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99999f-24af-4100-822a-0700c40d0744 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.603563 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99999f-24af-4100-822a-0700c40d0744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.605464 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99999f-24af-4100-822a-0700c40d0744 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.606186 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1061/2128] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:19 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:19.607515 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b76a5-c700-459f-a50c-c157cfa44a49 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.607810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b76a5-c700-459f-a50c-c157cfa44a49 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.608088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b76a5-c700-459f-a50c-c157cfa44a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.634429 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-616b76a5-c700-459f-a50c-c157cfa44a49 None None] MFA Rules not processed for user `d445f2ca06f54853beb1bb518ffb41ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:19.635686 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-616b76a5-c700-459f-a50c-c157cfa44a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:19.643204 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1068/2129] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:19 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:19.644245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99999f-24af-4100-822a-0700c40d0744 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.699770 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:19.713890 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99999f-24af-4100-822a-0700c40d0744 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.713993 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1062/2130] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:19.714467 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b76a5-c700-459f-a50c-c157cfa44a49 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.720369 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3dc0f-b945-408e-971f-3dc25b31df2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.721038 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3dc0f-b945-408e-971f-3dc25b31df2e admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.721327 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3dc0f-b945-408e-971f-3dc25b31df2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.721604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3dc0f-b945-408e-971f-3dc25b31df2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.722399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3dc0f-b945-408e-971f-3dc25b31df2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.723953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3dc0f-b945-408e-971f-3dc25b31df2e admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.724788 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b76a5-c700-459f-a50c-c157cfa44a49 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.729607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec160dbc-0612-47b7-90ff-f05578d3da73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.730259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec160dbc-0612-47b7-90ff-f05578d3da73 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.730581 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec160dbc-0612-47b7-90ff-f05578d3da73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.730868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec160dbc-0612-47b7-90ff-f05578d3da73 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.731563 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec160dbc-0612-47b7-90ff-f05578d3da73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.733504 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec160dbc-0612-47b7-90ff-f05578d3da73 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.734637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1069/2131] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:19.735442 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3dc0f-b945-408e-971f-3dc25b31df2e admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.737368 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-fee3dc0f-b945-408e-971f-3dc25b31df2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:19.750716 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3dc0f-b945-408e-971f-3dc25b31df2e admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.757778 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1063/2132] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:19 2022] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:19.757938 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868c36a-87b4-42e4-8064-ca30ca7efbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.758071 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec160dbc-0612-47b7-90ff-f05578d3da73 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.758163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868c36a-87b4-42e4-8064-ca30ca7efbe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.758163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868c36a-87b4-42e4-8064-ca30ca7efbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.758163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868c36a-87b4-42e4-8064-ca30ca7efbe4 admin admin] PATH_INFO: `/v3/users/888c545cd2e44d4886704663594dd3d7` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.758163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868c36a-87b4-42e4-8064-ca30ca7efbe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=888c545cd2e44d4886704663594dd3d7)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.760446 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868c36a-87b4-42e4-8064-ca30ca7efbe4 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.770475 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec160dbc-0612-47b7-90ff-f05578d3da73 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.775912 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17107ed-3da5-4e5a-846f-c1ae95b9936f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.776635 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17107ed-3da5-4e5a-846f-c1ae95b9936f admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.776924 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17107ed-3da5-4e5a-846f-c1ae95b9936f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.777235 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17107ed-3da5-4e5a-846f-c1ae95b9936f admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.777927 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17107ed-3da5-4e5a-846f-c1ae95b9936f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.779915 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17107ed-3da5-4e5a-846f-c1ae95b9936f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.806997 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1064/2133] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:19 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:19.807905 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17107ed-3da5-4e5a-846f-c1ae95b9936f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.812365 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d868c36a-87b4-42e4-8064-ca30ca7efbe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '888c545cd2e44d4886704663594dd3d7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:19.819402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d868c36a-87b4-42e4-8064-ca30ca7efbe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '888c545cd2e44d4886704663594dd3d7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:19.832024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d868c36a-87b4-42e4-8064-ca30ca7efbe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '888c545cd2e44d4886704663594dd3d7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:19.839501 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d868c36a-87b4-42e4-8064-ca30ca7efbe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '888c545cd2e44d4886704663594dd3d7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:19.840298 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d868c36a-87b4-42e4-8064-ca30ca7efbe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '888c545cd2e44d4886704663594dd3d7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:19.846651 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1070/2134] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:19 2022] DELETE /identity/v3/users/888c545cd2e44d4886704663594dd3d7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:19.847571 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868c36a-87b4-42e4-8064-ca30ca7efbe4 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.849003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-d868c36a-87b4-42e4-8064-ca30ca7efbe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:19.877193 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17107ed-3da5-4e5a-846f-c1ae95b9936f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.901448 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:19.917782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868c36a-87b4-42e4-8064-ca30ca7efbe4 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.922987 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57a0dd-9f0a-41fd-b164-5718fb54696b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.923658 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57a0dd-9f0a-41fd-b164-5718fb54696b admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.923945 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57a0dd-9f0a-41fd-b164-5718fb54696b admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.924221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57a0dd-9f0a-41fd-b164-5718fb54696b admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.924943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57a0dd-9f0a-41fd-b164-5718fb54696b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.926571 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57a0dd-9f0a-41fd-b164-5718fb54696b admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.940028 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1071/2135] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:19.940028 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57a0dd-9f0a-41fd-b164-5718fb54696b admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.940028 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-6a57a0dd-9f0a-41fd-b164-5718fb54696b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:19.943437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d29881-9810-4051-9cb7-79b6952a5db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.943756 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d29881-9810-4051-9cb7-79b6952a5db4 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.944045 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d29881-9810-4051-9cb7-79b6952a5db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.944324 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d29881-9810-4051-9cb7-79b6952a5db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.945060 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d29881-9810-4051-9cb7-79b6952a5db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.947400 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d29881-9810-4051-9cb7-79b6952a5db4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.955174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57a0dd-9f0a-41fd-b164-5718fb54696b admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:19.957774 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1065/2136] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:19.958905 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3295c0d-4013-4757-8b5b-127d99c1399a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.959200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3295c0d-4013-4757-8b5b-127d99c1399a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.959479 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3295c0d-4013-4757-8b5b-127d99c1399a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.960229 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d2bba-43a2-46e6-8fd7-06d4b8f7edab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:19.960966 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d2bba-43a2-46e6-8fd7-06d4b8f7edab admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:19.961317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d2bba-43a2-46e6-8fd7-06d4b8f7edab admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:19.961776 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d2bba-43a2-46e6-8fd7-06d4b8f7edab admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:19.962464 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d2bba-43a2-46e6-8fd7-06d4b8f7edab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:19.964406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d2bba-43a2-46e6-8fd7-06d4b8f7edab admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:19.978140 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-e3295c0d-4013-4757-8b5b-127d99c1399a None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:19.979370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e3295c0d-4013-4757-8b5b-127d99c1399a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:19.984469 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1072/2137] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:19 2022] POST /identity/v3/users => generated 295 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:19.985277 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d2bba-43a2-46e6-8fd7-06d4b8f7edab admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.987816 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1066/2138] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:19.988590 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3295c0d-4013-4757-8b5b-127d99c1399a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:19.990023 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e3295c0d-4013-4757-8b5b-127d99c1399a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:19.995460 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d2bba-43a2-46e6-8fd7-06d4b8f7edab admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:20.000087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c3397-c794-4692-8491-762179b8754b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:20.000797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c3397-c794-4692-8491-762179b8754b admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.001027 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c3397-c794-4692-8491-762179b8754b admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.001304 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c3397-c794-4692-8491-762179b8754b admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.002056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c3397-c794-4692-8491-762179b8754b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:20.003542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3295c0d-4013-4757-8b5b-127d99c1399a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:20.003715 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c3397-c794-4692-8491-762179b8754b admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:20.008237 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9395ec-11da-47cc-84a4-b5ccf68dcaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:20.009170 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9395ec-11da-47cc-84a4-b5ccf68dcaa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.009453 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9395ec-11da-47cc-84a4-b5ccf68dcaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.009727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9395ec-11da-47cc-84a4-b5ccf68dcaa9 admin admin] PATH_INFO: `/v3/projects/5faf0bff0de84fd091d23f31946bcd1e/users/db0e3ed5d82044b8aeebec82b814f57b/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.013954 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1073/2139] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:20.014708 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c3397-c794-4692-8491-762179b8754b admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:20.024041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c3397-c794-4692-8491-762179b8754b admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:20.026101 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9395ec-11da-47cc-84a4-b5ccf68dcaa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5faf0bff0de84fd091d23f31946bcd1e, user_id=db0e3ed5d82044b8aeebec82b814f57b, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:20.028791 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9395ec-11da-47cc-84a4-b5ccf68dcaa9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:20.029112 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0da688-d5aa-4808-9155-f1a463466201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:20.029741 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0da688-d5aa-4808-9155-f1a463466201 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.030027 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0da688-d5aa-4808-9155-f1a463466201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.030305 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0da688-d5aa-4808-9155-f1a463466201 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.031044 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0da688-d5aa-4808-9155-f1a463466201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:20.032607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0da688-d5aa-4808-9155-f1a463466201 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:20.042330 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1067/2140] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:19 2022] PUT /identity/v3/projects/5faf0bff0de84fd091d23f31946bcd1e/users/db0e3ed5d82044b8aeebec82b814f57b/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:20.043270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9395ec-11da-47cc-84a4-b5ccf68dcaa9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:20.047023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1074/2141] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:20.047023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0da688-d5aa-4808-9155-f1a463466201 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:20.048187 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bf9395ec-11da-47cc-84a4-b5ccf68dcaa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:20.054448 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0da688-d5aa-4808-9155-f1a463466201 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:20.066273 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:20.107520 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9395ec-11da-47cc-84a4-b5ccf68dcaa9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:20.111184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02b750-6a49-40fc-989f-1947574cf052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:20.112387 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02b750-6a49-40fc-989f-1947574cf052 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.112671 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02b750-6a49-40fc-989f-1947574cf052 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.112981 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02b750-6a49-40fc-989f-1947574cf052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.118972 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b337a-2350-4082-a23f-ed8efe655c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:20.119859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b337a-2350-4082-a23f-ed8efe655c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.120145 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b337a-2350-4082-a23f-ed8efe655c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.120425 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b337a-2350-4082-a23f-ed8efe655c9d admin admin] PATH_INFO: `/v3/projects/e303f67f83be4cf39a0ea7b30aa7e959/users/1fb0946a635242e59d575559bff332a8/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.126573 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02b750-6a49-40fc-989f-1947574cf052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:20.128111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02b750-6a49-40fc-989f-1947574cf052 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:20.136668 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b337a-2350-4082-a23f-ed8efe655c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e303f67f83be4cf39a0ea7b30aa7e959, user_id=1fb0946a635242e59d575559bff332a8, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:20.137937 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1068/2142] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:20.138734 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02b750-6a49-40fc-989f-1947574cf052 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:20.139673 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b337a-2350-4082-a23f-ed8efe655c9d admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:20.150463 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02b750-6a49-40fc-989f-1947574cf052 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:20.155266 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1075/2143] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:20 2022] PUT /identity/v3/projects/e303f67f83be4cf39a0ea7b30aa7e959/users/1fb0946a635242e59d575559bff332a8/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:20.165876 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fc073-702f-4b48-898e-1cf5da295a57 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.166175 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fc073-702f-4b48-898e-1cf5da295a57 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.166455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fc073-702f-4b48-898e-1cf5da295a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.205588 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-847fc073-702f-4b48-898e-1cf5da295a57 None None] MFA Rules not processed for user `db0e3ed5d82044b8aeebec82b814f57b`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:20.206840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-847fc073-702f-4b48-898e-1cf5da295a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:20.239333 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b1063-71e1-4fab-9fe0-300a5dbd4968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:20.241026 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b1063-71e1-4fab-9fe0-300a5dbd4968 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.241552 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b1063-71e1-4fab-9fe0-300a5dbd4968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.241892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b1063-71e1-4fab-9fe0-300a5dbd4968 admin admin] PATH_INFO: `/v3/projects/9ccf0577782b4ea98a9fe4f98f051d69/users/70f40070d1b847ccbd3cdd3283183bd3/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.265155 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b1063-71e1-4fab-9fe0-300a5dbd4968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ccf0577782b4ea98a9fe4f98f051d69, user_id=70f40070d1b847ccbd3cdd3283183bd3, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:20.267755 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b1063-71e1-4fab-9fe0-300a5dbd4968 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:20.282047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1076/2144] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:20.283469 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a10fa6-2f4e-42eb-b582-e5da4a18c14c None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.283780 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a10fa6-2f4e-42eb-b582-e5da4a18c14c None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.284044 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a10fa6-2f4e-42eb-b582-e5da4a18c14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.294538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1069/2145] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:20 2022] PUT /identity/v3/projects/9ccf0577782b4ea98a9fe4f98f051d69/users/70f40070d1b847ccbd3cdd3283183bd3/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:20.297290 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b1063-71e1-4fab-9fe0-300a5dbd4968 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:20.299236 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5c5b1063-71e1-4fab-9fe0-300a5dbd4968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:20.317970 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-e4a10fa6-2f4e-42eb-b582-e5da4a18c14c None None] MFA Rules not processed for user `1fb0946a635242e59d575559bff332a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:20.318334 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e4a10fa6-2f4e-42eb-b582-e5da4a18c14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:20.323540 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:20.391545 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b1063-71e1-4fab-9fe0-300a5dbd4968 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:20.398384 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070aded-1a70-4254-96be-fdeed24ac282 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:20.400998 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070aded-1a70-4254-96be-fdeed24ac282 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.401186 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070aded-1a70-4254-96be-fdeed24ac282 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.401466 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070aded-1a70-4254-96be-fdeed24ac282 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.435741 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1077/2146] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:20.439436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a10fa6-2f4e-42eb-b582-e5da4a18c14c None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:20.463789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:20.502576 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070aded-1a70-4254-96be-fdeed24ac282 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:20.504067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070aded-1a70-4254-96be-fdeed24ac282 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:20.526772 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1070/2147] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:20.530659 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070aded-1a70-4254-96be-fdeed24ac282 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:20.530771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a10fa6-2f4e-42eb-b582-e5da4a18c14c None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:20.536324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98a094-17ae-43f7-9be2-030f6fd08fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:20.536324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98a094-17ae-43f7-9be2-030f6fd08fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.536324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98a094-17ae-43f7-9be2-030f6fd08fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.536915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98a094-17ae-43f7-9be2-030f6fd08fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.538211 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98a094-17ae-43f7-9be2-030f6fd08fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:20.539736 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98a094-17ae-43f7-9be2-030f6fd08fb6 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:20.541338 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070aded-1a70-4254-96be-fdeed24ac282 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:20.546423 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8caa7-c35d-477c-aa6e-1978ab510f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:20.547335 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8caa7-c35d-477c-aa6e-1978ab510f83 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.547792 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8caa7-c35d-477c-aa6e-1978ab510f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.548041 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8caa7-c35d-477c-aa6e-1978ab510f83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.548844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8caa7-c35d-477c-aa6e-1978ab510f83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:20.550883 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8caa7-c35d-477c-aa6e-1978ab510f83 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:20.551534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1078/2148] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:20.552558 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98a094-17ae-43f7-9be2-030f6fd08fb6 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:20.554462 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-2b98a094-17ae-43f7-9be2-030f6fd08fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:20.569048 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98a094-17ae-43f7-9be2-030f6fd08fb6 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:20.575074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9c68b-2011-4c0f-9436-ee2fc6f761ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:20.576237 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9c68b-2011-4c0f-9436-ee2fc6f761ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.576473 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9c68b-2011-4c0f-9436-ee2fc6f761ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.576874 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9c68b-2011-4c0f-9436-ee2fc6f761ca admin admin] PATH_INFO: `/v3/users/d7ba23bbe0a44b9a8e8b7723d4527131` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.578340 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9c68b-2011-4c0f-9436-ee2fc6f761ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7ba23bbe0a44b9a8e8b7723d4527131)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:20.580371 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1071/2149] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:20 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:20.581162 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8caa7-c35d-477c-aa6e-1978ab510f83 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:20.585991 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9c68b-2011-4c0f-9436-ee2fc6f761ca admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:20.642970 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-82a9c68b-2011-4c0f-9436-ee2fc6f761ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7ba23bbe0a44b9a8e8b7723d4527131'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:20.651158 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-82a9c68b-2011-4c0f-9436-ee2fc6f761ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7ba23bbe0a44b9a8e8b7723d4527131'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:20.657032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8caa7-c35d-477c-aa6e-1978ab510f83 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:20.661856 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7fdf1-79cc-4a6a-9073-ff71a67df873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:20.662835 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7fdf1-79cc-4a6a-9073-ff71a67df873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.663124 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7fdf1-79cc-4a6a-9073-ff71a67df873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.663402 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7fdf1-79cc-4a6a-9073-ff71a67df873 admin admin] PATH_INFO: `/v3/users/db0e3ed5d82044b8aeebec82b814f57b` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.664174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-82a9c68b-2011-4c0f-9436-ee2fc6f761ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7ba23bbe0a44b9a8e8b7723d4527131'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:20.664615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7fdf1-79cc-4a6a-9073-ff71a67df873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db0e3ed5d82044b8aeebec82b814f57b)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:20.666638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7fdf1-79cc-4a6a-9073-ff71a67df873 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:20.673291 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-82a9c68b-2011-4c0f-9436-ee2fc6f761ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7ba23bbe0a44b9a8e8b7723d4527131'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:20.674429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-82a9c68b-2011-4c0f-9436-ee2fc6f761ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7ba23bbe0a44b9a8e8b7723d4527131'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:20.686204 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1079/2150] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:20 2022] DELETE /identity/v3/users/d7ba23bbe0a44b9a8e8b7723d4527131 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:20.686204 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9c68b-2011-4c0f-9436-ee2fc6f761ca admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:20.686443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-82a9c68b-2011-4c0f-9436-ee2fc6f761ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:20.751528 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bea7fdf1-79cc-4a6a-9073-ff71a67df873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db0e3ed5d82044b8aeebec82b814f57b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:20.753330 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:20.762424 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bea7fdf1-79cc-4a6a-9073-ff71a67df873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db0e3ed5d82044b8aeebec82b814f57b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:20.763340 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bea7fdf1-79cc-4a6a-9073-ff71a67df873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db0e3ed5d82044b8aeebec82b814f57b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:20.763624 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9c68b-2011-4c0f-9436-ee2fc6f761ca admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:20.763937 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bea7fdf1-79cc-4a6a-9073-ff71a67df873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db0e3ed5d82044b8aeebec82b814f57b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:20.769246 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2045ec2-54ab-4399-af0b-9e6c40f81445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:20.770090 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2045ec2-54ab-4399-af0b-9e6c40f81445 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.770374 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2045ec2-54ab-4399-af0b-9e6c40f81445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.770675 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2045ec2-54ab-4399-af0b-9e6c40f81445 admin admin] PATH_INFO: `/v3/projects/9ccf0577782b4ea98a9fe4f98f051d69/users/70f40070d1b847ccbd3cdd3283183bd3/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.772697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2045ec2-54ab-4399-af0b-9e6c40f81445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ccf0577782b4ea98a9fe4f98f051d69, user_id=70f40070d1b847ccbd3cdd3283183bd3, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:20.776048 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2045ec2-54ab-4399-af0b-9e6c40f81445 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:20.778487 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bea7fdf1-79cc-4a6a-9073-ff71a67df873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db0e3ed5d82044b8aeebec82b814f57b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:20.786963 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1080/2151] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:20 2022] PUT /identity/v3/projects/9ccf0577782b4ea98a9fe4f98f051d69/users/70f40070d1b847ccbd3cdd3283183bd3/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:20.787975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2045ec2-54ab-4399-af0b-9e6c40f81445 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:20.789592 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e2045ec2-54ab-4399-af0b-9e6c40f81445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:20.798686 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1072/2152] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:20 2022] DELETE /identity/v3/users/db0e3ed5d82044b8aeebec82b814f57b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:20.799489 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7fdf1-79cc-4a6a-9073-ff71a67df873 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:20.800879 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bea7fdf1-79cc-4a6a-9073-ff71a67df873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:20.814108 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:20.860737 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2045ec2-54ab-4399-af0b-9e6c40f81445 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:20.865017 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7fdf1-79cc-4a6a-9073-ff71a67df873 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:20.865785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20b4dd-c852-4c37-a576-5d31be64b9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:20.866814 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20b4dd-c852-4c37-a576-5d31be64b9e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.867104 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20b4dd-c852-4c37-a576-5d31be64b9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.867386 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20b4dd-c852-4c37-a576-5d31be64b9e3 admin admin] PATH_INFO: `/v3/projects/2bd4060c85b54034b6e4452ad54dad9e` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.868632 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20b4dd-c852-4c37-a576-5d31be64b9e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bd4060c85b54034b6e4452ad54dad9e)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:20.869680 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f4e4b-b7e9-44b5-be2a-a2b3e3b22f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:20.870344 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f4e4b-b7e9-44b5-be2a-a2b3e3b22f0f admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.870624 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20b4dd-c852-4c37-a576-5d31be64b9e3 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:20.870741 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f4e4b-b7e9-44b5-be2a-a2b3e3b22f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.870933 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f4e4b-b7e9-44b5-be2a-a2b3e3b22f0f admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.871649 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f4e4b-b7e9-44b5-be2a-a2b3e3b22f0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:20.873575 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f4e4b-b7e9-44b5-be2a-a2b3e3b22f0f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:20.893163 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1073/2153] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:20 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:20.894453 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb185962-0fd0-44d1-a220-827b0558c5e6 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.894776 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb185962-0fd0-44d1-a220-827b0558c5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.895058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb185962-0fd0-44d1-a220-827b0558c5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.913064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-bb185962-0fd0-44d1-a220-827b0558c5e6 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:20.914268 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bb185962-0fd0-44d1-a220-827b0558c5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:20.921096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-af20b4dd-c852-4c37-a576-5d31be64b9e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bd4060c85b54034b6e4452ad54dad9e', 'request_id': 'req-af20b4dd-c852-4c37-a576-5d31be64b9e3'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:20.927321 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-af20b4dd-c852-4c37-a576-5d31be64b9e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bd4060c85b54034b6e4452ad54dad9e', 'request_id': 'req-af20b4dd-c852-4c37-a576-5d31be64b9e3'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:20.934916 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-af20b4dd-c852-4c37-a576-5d31be64b9e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bd4060c85b54034b6e4452ad54dad9e', 'request_id': 'req-af20b4dd-c852-4c37-a576-5d31be64b9e3'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:20.945683 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-af20b4dd-c852-4c37-a576-5d31be64b9e3 admin admin] The token cache is being invalidate because project 2bd4060c85b54034b6e4452ad54dad9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:20.946520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-af20b4dd-c852-4c37-a576-5d31be64b9e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:20.947259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-af20b4dd-c852-4c37-a576-5d31be64b9e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:20.948807 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1081/2154] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:20 2022] DELETE /identity/v3/projects/2bd4060c85b54034b6e4452ad54dad9e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:20.950031 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8beee-b3a3-4794-83cf-af3c5fbda8e8 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.950326 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8beee-b3a3-4794-83cf-af3c5fbda8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.950636 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8beee-b3a3-4794-83cf-af3c5fbda8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.973057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1074/2155] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:20.974615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f9151-4e66-40e4-aaf3-279bdb155615 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:20.974925 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f9151-4e66-40e4-aaf3-279bdb155615 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:20.975192 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f9151-4e66-40e4-aaf3-279bdb155615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:20.979880 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-07d8beee-b3a3-4794-83cf-af3c5fbda8e8 None None] MFA Rules not processed for user `70f40070d1b847ccbd3cdd3283183bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:20.981102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-07d8beee-b3a3-4794-83cf-af3c5fbda8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:20.993586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c21f9151-4e66-40e4-aaf3-279bdb155615 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:20.994808 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c21f9151-4e66-40e4-aaf3-279bdb155615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:21.002736 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1075/2156] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:21.006022 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f9151-4e66-40e4-aaf3-279bdb155615 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:21.006022 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c21f9151-4e66-40e4-aaf3-279bdb155615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:21.027120 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f9151-4e66-40e4-aaf3-279bdb155615 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:21.031906 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d35baf-92dd-4dfb-8d64-f2e4616943c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:21.032756 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d35baf-92dd-4dfb-8d64-f2e4616943c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.033048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d35baf-92dd-4dfb-8d64-f2e4616943c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.033331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d35baf-92dd-4dfb-8d64-f2e4616943c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.034082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d35baf-92dd-4dfb-8d64-f2e4616943c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:21.035792 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d35baf-92dd-4dfb-8d64-f2e4616943c1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:21.049329 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1076/2157] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:21.051022 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bcfe0-cf3b-4fb5-9841-f8424a55267d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.051636 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bcfe0-cf3b-4fb5-9841-f8424a55267d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.051636 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bcfe0-cf3b-4fb5-9841-f8424a55267d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.055151 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1082/2158] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:21.056016 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8beee-b3a3-4794-83cf-af3c5fbda8e8 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:21.057361 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-07d8beee-b3a3-4794-83cf-af3c5fbda8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:21.075390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-259bcfe0-cf3b-4fb5-9841-f8424a55267d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:21.076557 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-259bcfe0-cf3b-4fb5-9841-f8424a55267d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:21.084976 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1077/2159] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:21.085802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bcfe0-cf3b-4fb5-9841-f8424a55267d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:21.087626 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-259bcfe0-cf3b-4fb5-9841-f8424a55267d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:21.125381 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:21.125665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:21.144809 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8beee-b3a3-4794-83cf-af3c5fbda8e8 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:21.148447 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd1a44-024c-47d6-a864-edeab4d7e437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:21.149626 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd1a44-024c-47d6-a864-edeab4d7e437 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.149933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd1a44-024c-47d6-a864-edeab4d7e437 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.150202 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd1a44-024c-47d6-a864-edeab4d7e437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.154819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bcfe0-cf3b-4fb5-9841-f8424a55267d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:21.158590 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b24dd-b89f-4084-9e25-9aa4b543269e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:21.159329 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b24dd-b89f-4084-9e25-9aa4b543269e service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.159689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b24dd-b89f-4084-9e25-9aa4b543269e service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.159971 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b24dd-b89f-4084-9e25-9aa4b543269e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.160349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd1a44-024c-47d6-a864-edeab4d7e437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:21.161816 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd1a44-024c-47d6-a864-edeab4d7e437 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:21.169928 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b24dd-b89f-4084-9e25-9aa4b543269e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:21.171404 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b24dd-b89f-4084-9e25-9aa4b543269e service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:21.172424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1083/2160] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:21.173207 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd1a44-024c-47d6-a864-edeab4d7e437 service neutron] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:21.182441 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd1a44-024c-47d6-a864-edeab4d7e437 service neutron] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:21.183896 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1078/2161] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:21.185251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b24dd-b89f-4084-9e25-9aa4b543269e service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:21.187064 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-580b24dd-b89f-4084-9e25-9aa4b543269e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:21.202297 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696f1a9-4e41-4636-9c4d-d25df01ff7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:21.203517 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696f1a9-4e41-4636-9c4d-d25df01ff7c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.203807 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696f1a9-4e41-4636-9c4d-d25df01ff7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.204478 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696f1a9-4e41-4636-9c4d-d25df01ff7c4 admin admin] PATH_INFO: `/v3/projects/5413ab7ee4a54d93a0f35d1ae572d7df/users/f7ea2f7cebe04a959ebd404bcebc783b/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.226183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696f1a9-4e41-4636-9c4d-d25df01ff7c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5413ab7ee4a54d93a0f35d1ae572d7df, user_id=f7ea2f7cebe04a959ebd404bcebc783b, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:21.231557 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696f1a9-4e41-4636-9c4d-d25df01ff7c4 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:21.257582 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1084/2162] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:21 2022] PUT /identity/v3/projects/5413ab7ee4a54d93a0f35d1ae572d7df/users/f7ea2f7cebe04a959ebd404bcebc783b/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:21.257582 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c101736-8a98-4e9e-997f-2e01c20471ec None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.257582 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c101736-8a98-4e9e-997f-2e01c20471ec None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.257582 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c101736-8a98-4e9e-997f-2e01c20471ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.270591 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b24dd-b89f-4084-9e25-9aa4b543269e service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:21.286191 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-4c101736-8a98-4e9e-997f-2e01c20471ec None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:21.287611 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-4c101736-8a98-4e9e-997f-2e01c20471ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:21.346253 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88626e5f-c86e-4424-b7ae-3694ed1b2c4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:21.347122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88626e5f-c86e-4424-b7ae-3694ed1b2c4c service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.347759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88626e5f-c86e-4424-b7ae-3694ed1b2c4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.348458 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88626e5f-c86e-4424-b7ae-3694ed1b2c4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.351303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-88626e5f-c86e-4424-b7ae-3694ed1b2c4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:21.370784 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1085/2163] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:21.371604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c101736-8a98-4e9e-997f-2e01c20471ec None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:21.382442 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c101736-8a98-4e9e-997f-2e01c20471ec None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:21.388102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd1925-96da-4f44-8260-c74c4296d9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:21.390546 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd1925-96da-4f44-8260-c74c4296d9ab admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.390854 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd1925-96da-4f44-8260-c74c4296d9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.391143 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd1925-96da-4f44-8260-c74c4296d9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.391894 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd1925-96da-4f44-8260-c74c4296d9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:21.393656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd1925-96da-4f44-8260-c74c4296d9ab admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:21.408098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1086/2164] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:21.408098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd1925-96da-4f44-8260-c74c4296d9ab admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:21.418079 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd1925-96da-4f44-8260-c74c4296d9ab admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:21.424265 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ada39-5b93-4d52-98df-9e1eb4651ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:21.424989 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ada39-5b93-4d52-98df-9e1eb4651ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.425288 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ada39-5b93-4d52-98df-9e1eb4651ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.425573 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ada39-5b93-4d52-98df-9e1eb4651ba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.426323 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ada39-5b93-4d52-98df-9e1eb4651ba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:21.426688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ada39-5b93-4d52-98df-9e1eb4651ba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:21.428337 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ada39-5b93-4d52-98df-9e1eb4651ba7 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:21.440120 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88626e5f-c86e-4424-b7ae-3694ed1b2c4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:21.442999 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88626e5f-c86e-4424-b7ae-3694ed1b2c4c service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:21.446125 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1087/2165] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:21.446995 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ada39-5b93-4d52-98df-9e1eb4651ba7 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:21.455513 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1079/2166] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:21.456970 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88626e5f-c86e-4424-b7ae-3694ed1b2c4c service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:21.470662 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88626e5f-c86e-4424-b7ae-3694ed1b2c4c service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:21.475741 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ada39-5b93-4d52-98df-9e1eb4651ba7 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:21.477745 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e2d1d-6f3f-473d-852d-3ee893ed067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:21.478713 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e2d1d-6f3f-473d-852d-3ee893ed067f admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.479167 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e2d1d-6f3f-473d-852d-3ee893ed067f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.479577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e2d1d-6f3f-473d-852d-3ee893ed067f admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.480929 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e2d1d-6f3f-473d-852d-3ee893ed067f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:21.483703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e2d1d-6f3f-473d-852d-3ee893ed067f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:21.487597 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577044bb-4f16-4eee-b020-83672a261f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:21.488519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577044bb-4f16-4eee-b020-83672a261f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.488811 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577044bb-4f16-4eee-b020-83672a261f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.489093 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577044bb-4f16-4eee-b020-83672a261f90 admin admin] PATH_INFO: `/v3/projects/5413ab7ee4a54d93a0f35d1ae572d7df/users/f7ea2f7cebe04a959ebd404bcebc783b/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.491785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577044bb-4f16-4eee-b020-83672a261f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5413ab7ee4a54d93a0f35d1ae572d7df, user_id=f7ea2f7cebe04a959ebd404bcebc783b, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:21.495523 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577044bb-4f16-4eee-b020-83672a261f90 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:21.512877 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1088/2167] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:21 2022] PUT /identity/v3/projects/5413ab7ee4a54d93a0f35d1ae572d7df/users/f7ea2f7cebe04a959ebd404bcebc783b/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:21.538345 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4111bd-1f34-429b-951b-7439c440964c None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.538690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4111bd-1f34-429b-951b-7439c440964c None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.538945 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4111bd-1f34-429b-951b-7439c440964c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.547120 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1080/2168] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:21 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:21.551449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e2d1d-6f3f-473d-852d-3ee893ed067f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:21.573886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-ba4111bd-1f34-429b-951b-7439c440964c None None] MFA Rules not processed for user `f7ea2f7cebe04a959ebd404bcebc783b`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:21.575662 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ba4111bd-1f34-429b-951b-7439c440964c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:21.603128 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:21.682610 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e2d1d-6f3f-473d-852d-3ee893ed067f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:21.695796 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd55e9d-8cb5-4456-96e2-37b0e7a95df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:21.697203 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd55e9d-8cb5-4456-96e2-37b0e7a95df0 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.697497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd55e9d-8cb5-4456-96e2-37b0e7a95df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.697805 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd55e9d-8cb5-4456-96e2-37b0e7a95df0 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.698717 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd55e9d-8cb5-4456-96e2-37b0e7a95df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:21.700809 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd55e9d-8cb5-4456-96e2-37b0e7a95df0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:21.713924 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1089/2169] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:21.715201 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4111bd-1f34-429b-951b-7439c440964c None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:21.716618 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ba4111bd-1f34-429b-951b-7439c440964c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:21.726751 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:21.727751 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1081/2170] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:21 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:34:21.728850 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd55e9d-8cb5-4456-96e2-37b0e7a95df0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:21.730802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3cd55e9d-8cb5-4456-96e2-37b0e7a95df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:21.735526 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4111bd-1f34-429b-951b-7439c440964c None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:21.741427 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b94611-be7c-439a-b709-c1712aba4a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:21.742385 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b94611-be7c-439a-b709-c1712aba4a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.743279 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b94611-be7c-439a-b709-c1712aba4a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.744006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b94611-be7c-439a-b709-c1712aba4a84 admin admin] PATH_INFO: `/v3/projects/5faf0bff0de84fd091d23f31946bcd1e` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.745210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b94611-be7c-439a-b709-c1712aba4a84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5faf0bff0de84fd091d23f31946bcd1e)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:21.746018 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd55e9d-8cb5-4456-96e2-37b0e7a95df0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:21.747360 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b94611-be7c-439a-b709-c1712aba4a84 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:21.753328 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf3988-b5b6-4679-8ce2-ad464ff2dffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:21.754354 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf3988-b5b6-4679-8ce2-ad464ff2dffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.754696 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf3988-b5b6-4679-8ce2-ad464ff2dffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.754981 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf3988-b5b6-4679-8ce2-ad464ff2dffd admin admin] PATH_INFO: `/v3/projects/5b4ea229a8b048739dfb3b56f661d6da` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.756195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf3988-b5b6-4679-8ce2-ad464ff2dffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b4ea229a8b048739dfb3b56f661d6da)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:21.758314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf3988-b5b6-4679-8ce2-ad464ff2dffd admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:21.808886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-f3b94611-be7c-439a-b709-c1712aba4a84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5faf0bff0de84fd091d23f31946bcd1e', 'request_id': 'req-f3b94611-be7c-439a-b709-c1712aba4a84'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:21.816223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-f3b94611-be7c-439a-b709-c1712aba4a84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5faf0bff0de84fd091d23f31946bcd1e', 'request_id': 'req-f3b94611-be7c-439a-b709-c1712aba4a84'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:21.817900 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8acf3988-b5b6-4679-8ce2-ad464ff2dffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b4ea229a8b048739dfb3b56f661d6da', 'request_id': 'req-8acf3988-b5b6-4679-8ce2-ad464ff2dffd'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:21.825017 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-f3b94611-be7c-439a-b709-c1712aba4a84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5faf0bff0de84fd091d23f31946bcd1e', 'request_id': 'req-f3b94611-be7c-439a-b709-c1712aba4a84'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:21.826357 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8acf3988-b5b6-4679-8ce2-ad464ff2dffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b4ea229a8b048739dfb3b56f661d6da', 'request_id': 'req-8acf3988-b5b6-4679-8ce2-ad464ff2dffd'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:21.834309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8acf3988-b5b6-4679-8ce2-ad464ff2dffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b4ea229a8b048739dfb3b56f661d6da', 'request_id': 'req-8acf3988-b5b6-4679-8ce2-ad464ff2dffd'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:21.836980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-f3b94611-be7c-439a-b709-c1712aba4a84 admin admin] The token cache is being invalidate because project 5faf0bff0de84fd091d23f31946bcd1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:21.837409 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-f3b94611-be7c-439a-b709-c1712aba4a84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:21.838088 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-f3b94611-be7c-439a-b709-c1712aba4a84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:21.839707 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1090/2171] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:21 2022] DELETE /identity/v3/projects/5faf0bff0de84fd091d23f31946bcd1e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:21.841390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b94611-be7c-439a-b709-c1712aba4a84 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:21.843954 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-f3b94611-be7c-439a-b709-c1712aba4a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:21.850305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8acf3988-b5b6-4679-8ce2-ad464ff2dffd admin admin] The token cache is being invalidate because project 5b4ea229a8b048739dfb3b56f661d6da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:21.850810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8acf3988-b5b6-4679-8ce2-ad464ff2dffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:21.851502 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8acf3988-b5b6-4679-8ce2-ad464ff2dffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:21.863102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1082/2172] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:21 2022] DELETE /identity/v3/projects/5b4ea229a8b048739dfb3b56f661d6da => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:21.863962 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf3988-b5b6-4679-8ce2-ad464ff2dffd admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:21.865390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8acf3988-b5b6-4679-8ce2-ad464ff2dffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:21.917014 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b94611-be7c-439a-b709-c1712aba4a84 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:21.950339 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf3988-b5b6-4679-8ce2-ad464ff2dffd admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:21.955415 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8523d6-0d6d-48c6-ac3f-e2a8a0099de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:21.956160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8523d6-0d6d-48c6-ac3f-e2a8a0099de6 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.956516 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8523d6-0d6d-48c6-ac3f-e2a8a0099de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.956871 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8523d6-0d6d-48c6-ac3f-e2a8a0099de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.957819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8523d6-0d6d-48c6-ac3f-e2a8a0099de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:21.959598 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8523d6-0d6d-48c6-ac3f-e2a8a0099de6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:21.974879 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547c786-c9c3-47e7-accd-6018348c1011 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:21.975634 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547c786-c9c3-47e7-accd-6018348c1011 service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.976117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547c786-c9c3-47e7-accd-6018348c1011 service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.976462 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547c786-c9c3-47e7-accd-6018348c1011 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.976937 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1083/2173] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:21.978706 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ca789-30e9-43ba-9497-831637d9be15 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:21.978999 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ca789-30e9-43ba-9497-831637d9be15 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:21.979236 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-0547c786-c9c3-47e7-accd-6018348c1011 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:21.979326 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ca789-30e9-43ba-9497-831637d9be15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:21.997636 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-616ca789-30e9-43ba-9497-831637d9be15 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:21.999120 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-616ca789-30e9-43ba-9497-831637d9be15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:22.007361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1084/2174] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:22.008238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ca789-30e9-43ba-9497-831637d9be15 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:22.009595 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-616ca789-30e9-43ba-9497-831637d9be15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:22.021135 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ca789-30e9-43ba-9497-831637d9be15 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:22.026264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf4c5c-35aa-43ff-9428-000ac8586bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:22.027153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf4c5c-35aa-43ff-9428-000ac8586bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.027439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf4c5c-35aa-43ff-9428-000ac8586bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.027718 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf4c5c-35aa-43ff-9428-000ac8586bef admin admin] PATH_INFO: `/v3/users/6136674a6913432bbae2f8a31fb9f444` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.028952 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf4c5c-35aa-43ff-9428-000ac8586bef admin admin] RBAC: Authorizing `identity:delete_user(user_id=6136674a6913432bbae2f8a31fb9f444)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:22.030930 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf4c5c-35aa-43ff-9428-000ac8586bef admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:22.041189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:22.052652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:22.054698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547c786-c9c3-47e7-accd-6018348c1011 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:22.056424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547c786-c9c3-47e7-accd-6018348c1011 service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:22.066549 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1091/2175] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:22.067337 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547c786-c9c3-47e7-accd-6018348c1011 service cinder] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:22.077944 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547c786-c9c3-47e7-accd-6018348c1011 service cinder] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:22.082853 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d98e4-74a6-44fe-b1c1-d9f520999c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:22.083510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d98e4-74a6-44fe-b1c1-d9f520999c9d admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.083898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d98e4-74a6-44fe-b1c1-d9f520999c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.084076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d98e4-74a6-44fe-b1c1-d9f520999c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.084803 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d98e4-74a6-44fe-b1c1-d9f520999c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:22.085084 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dbaf4c5c-35aa-43ff-9428-000ac8586bef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6136674a6913432bbae2f8a31fb9f444'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:22.086399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d98e4-74a6-44fe-b1c1-d9f520999c9d admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:22.093731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dbaf4c5c-35aa-43ff-9428-000ac8586bef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6136674a6913432bbae2f8a31fb9f444'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:22.094421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dbaf4c5c-35aa-43ff-9428-000ac8586bef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6136674a6913432bbae2f8a31fb9f444'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:22.095090 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dbaf4c5c-35aa-43ff-9428-000ac8586bef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6136674a6913432bbae2f8a31fb9f444'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:22.098742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1092/2176] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:22.099917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6922e84-e54c-4425-b337-a4dbebbf315b None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.100366 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6922e84-e54c-4425-b337-a4dbebbf315b None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.100793 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6922e84-e54c-4425-b337-a4dbebbf315b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.119700 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dbaf4c5c-35aa-43ff-9428-000ac8586bef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6136674a6913432bbae2f8a31fb9f444'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:22.121535 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-a6922e84-e54c-4425-b337-a4dbebbf315b None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:22.122709 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-a6922e84-e54c-4425-b337-a4dbebbf315b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:22.130975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1093/2177] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:22.131767 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6922e84-e54c-4425-b337-a4dbebbf315b None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:22.133048 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-a6922e84-e54c-4425-b337-a4dbebbf315b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:22.137805 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1085/2178] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:22 2022] DELETE /identity/v3/users/6136674a6913432bbae2f8a31fb9f444 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:22.138655 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf4c5c-35aa-43ff-9428-000ac8586bef admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:22.153400 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6922e84-e54c-4425-b337-a4dbebbf315b None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:22.232298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf4c5c-35aa-43ff-9428-000ac8586bef admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:22.237438 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4388212-2e10-491d-9fe2-0fd83f2d8a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:22.238898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4388212-2e10-491d-9fe2-0fd83f2d8a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.239364 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cf924-de02-429a-9f28-42611aa0b032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:22.239519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4388212-2e10-491d-9fe2-0fd83f2d8a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.239954 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4388212-2e10-491d-9fe2-0fd83f2d8a1b admin admin] PATH_INFO: `/v3/projects/fef8b35d9b7843e3be275e3045427cac/users/eb43e96c14354f95b4e1ac2c18a47623/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.240289 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cf924-de02-429a-9f28-42611aa0b032 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.240709 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cf924-de02-429a-9f28-42611aa0b032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.241046 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cf924-de02-429a-9f28-42611aa0b032 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.242073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388cf924-de02-429a-9f28-42611aa0b032 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:22.242385 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388cf924-de02-429a-9f28-42611aa0b032 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:22.244281 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388cf924-de02-429a-9f28-42611aa0b032 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:22.264312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4388212-2e10-491d-9fe2-0fd83f2d8a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fef8b35d9b7843e3be275e3045427cac, user_id=eb43e96c14354f95b4e1ac2c18a47623, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:22.265785 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1086/2179] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:22.269567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4388212-2e10-491d-9fe2-0fd83f2d8a1b admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:22.270572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cf924-de02-429a-9f28-42611aa0b032 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:22.285748 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cf924-de02-429a-9f28-42611aa0b032 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:22.293908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1094/2180] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:22 2022] PUT /identity/v3/projects/fef8b35d9b7843e3be275e3045427cac/users/eb43e96c14354f95b4e1ac2c18a47623/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:22.304962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cfe54-fbf6-4bd9-bac7-fa348dc7e404 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.305953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cfe54-fbf6-4bd9-bac7-fa348dc7e404 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.306185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cfe54-fbf6-4bd9-bac7-fa348dc7e404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.351023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-744cfe54-fbf6-4bd9-bac7-fa348dc7e404 None None] MFA Rules not processed for user `eb43e96c14354f95b4e1ac2c18a47623`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:22.354468 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-744cfe54-fbf6-4bd9-bac7-fa348dc7e404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:22.372760 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e35f0c-b8f4-4f87-90a4-e162f6e4bdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:22.374142 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e35f0c-b8f4-4f87-90a4-e162f6e4bdce admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.374432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e35f0c-b8f4-4f87-90a4-e162f6e4bdce admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.374771 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e35f0c-b8f4-4f87-90a4-e162f6e4bdce admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.375486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e35f0c-b8f4-4f87-90a4-e162f6e4bdce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:22.377433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e35f0c-b8f4-4f87-90a4-e162f6e4bdce admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:22.415892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1087/2181] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:22 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:22.418216 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e35f0c-b8f4-4f87-90a4-e162f6e4bdce admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:22.440783 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:22.448081 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1095/2182] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:22.452473 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cfe54-fbf6-4bd9-bac7-fa348dc7e404 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:22.468981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cfe54-fbf6-4bd9-bac7-fa348dc7e404 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:22.499176 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e35f0c-b8f4-4f87-90a4-e162f6e4bdce admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:22.504406 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b74d1-b0ef-4778-82c3-c31731ec544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:22.505114 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b74d1-b0ef-4778-82c3-c31731ec544b admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.505383 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b74d1-b0ef-4778-82c3-c31731ec544b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.505660 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b74d1-b0ef-4778-82c3-c31731ec544b admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.506356 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b74d1-b0ef-4778-82c3-c31731ec544b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:22.508562 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b74d1-b0ef-4778-82c3-c31731ec544b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:22.528621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:22.535186 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1088/2183] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:22 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:22.536291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b74d1-b0ef-4778-82c3-c31731ec544b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:22.538685 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-497b74d1-b0ef-4778-82c3-c31731ec544b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:22.545385 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e65a0-3c76-43b0-b1c1-2e2e1ca1e669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:22.545992 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e65a0-3c76-43b0-b1c1-2e2e1ca1e669 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.546370 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e65a0-3c76-43b0-b1c1-2e2e1ca1e669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.546682 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e65a0-3c76-43b0-b1c1-2e2e1ca1e669 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.547269 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e65a0-3c76-43b0-b1c1-2e2e1ca1e669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:22.551424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e65a0-3c76-43b0-b1c1-2e2e1ca1e669 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:22.552935 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b74d1-b0ef-4778-82c3-c31731ec544b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:22.560775 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8cf6f-49dc-4dd4-bc81-99f9cbb8f6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:22.562274 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8cf6f-49dc-4dd4-bc81-99f9cbb8f6b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.562737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8cf6f-49dc-4dd4-bc81-99f9cbb8f6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.563044 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8cf6f-49dc-4dd4-bc81-99f9cbb8f6b4 admin admin] PATH_INFO: `/v3/projects/d4eb3848f3974fc9981d95fadf3bbccd` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.564878 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8cf6f-49dc-4dd4-bc81-99f9cbb8f6b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4eb3848f3974fc9981d95fadf3bbccd)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:22.567222 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8cf6f-49dc-4dd4-bc81-99f9cbb8f6b4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:22.583517 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1096/2184] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:22 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:22.584617 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e65a0-3c76-43b0-b1c1-2e2e1ca1e669 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:22.624040 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f9a8cf6f-49dc-4dd4-bc81-99f9cbb8f6b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4eb3848f3974fc9981d95fadf3bbccd', 'request_id': 'req-f9a8cf6f-49dc-4dd4-bc81-99f9cbb8f6b4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:22.631515 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f9a8cf6f-49dc-4dd4-bc81-99f9cbb8f6b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4eb3848f3974fc9981d95fadf3bbccd', 'request_id': 'req-f9a8cf6f-49dc-4dd4-bc81-99f9cbb8f6b4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:22.644374 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f9a8cf6f-49dc-4dd4-bc81-99f9cbb8f6b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4eb3848f3974fc9981d95fadf3bbccd', 'request_id': 'req-f9a8cf6f-49dc-4dd4-bc81-99f9cbb8f6b4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:22.664289 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f9a8cf6f-49dc-4dd4-bc81-99f9cbb8f6b4 admin admin] The token cache is being invalidate because project d4eb3848f3974fc9981d95fadf3bbccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:22.664566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e65a0-3c76-43b0-b1c1-2e2e1ca1e669 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:22.664789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f9a8cf6f-49dc-4dd4-bc81-99f9cbb8f6b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:22.665473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f9a8cf6f-49dc-4dd4-bc81-99f9cbb8f6b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:22.667156 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1089/2185] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:22 2022] DELETE /identity/v3/projects/d4eb3848f3974fc9981d95fadf3bbccd => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:22.667908 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8cf6f-49dc-4dd4-bc81-99f9cbb8f6b4 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:22.670213 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f9a8cf6f-49dc-4dd4-bc81-99f9cbb8f6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:22.745412 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f50cb1-ade3-4343-9ee5-55d7660efa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:22.745674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8cf6f-49dc-4dd4-bc81-99f9cbb8f6b4 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:22.746485 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f50cb1-ade3-4343-9ee5-55d7660efa6d admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.747141 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f50cb1-ade3-4343-9ee5-55d7660efa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.747589 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f50cb1-ade3-4343-9ee5-55d7660efa6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.750893 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392b758-5b8f-4777-8ecc-de0ab2e9b9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:22.751511 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f50cb1-ade3-4343-9ee5-55d7660efa6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:22.751665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392b758-5b8f-4777-8ecc-de0ab2e9b9fc admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.751855 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392b758-5b8f-4777-8ecc-de0ab2e9b9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.752142 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392b758-5b8f-4777-8ecc-de0ab2e9b9fc admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.752844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392b758-5b8f-4777-8ecc-de0ab2e9b9fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:22.754844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392b758-5b8f-4777-8ecc-de0ab2e9b9fc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:22.755197 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f50cb1-ade3-4343-9ee5-55d7660efa6d admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:22.771220 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1097/2186] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:22.772825 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a7f8c-8060-48b1-a593-ab4292bd9356 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.773219 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a7f8c-8060-48b1-a593-ab4292bd9356 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.773601 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a7f8c-8060-48b1-a593-ab4292bd9356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.782931 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1090/2187] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:22 2022] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:22.782931 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392b758-5b8f-4777-8ecc-de0ab2e9b9fc admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:22.783390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7392b758-5b8f-4777-8ecc-de0ab2e9b9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:22.798081 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-c14a7f8c-8060-48b1-a593-ab4292bd9356 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:22.799267 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-c14a7f8c-8060-48b1-a593-ab4292bd9356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:22.806545 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:22.821965 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1098/2188] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:22.821965 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a7f8c-8060-48b1-a593-ab4292bd9356 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:22.821965 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-c14a7f8c-8060-48b1-a593-ab4292bd9356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:22.834322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a7f8c-8060-48b1-a593-ab4292bd9356 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:22.842260 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c0dc6-d592-4f64-90a7-c547ac3805d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:22.843141 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c0dc6-d592-4f64-90a7-c547ac3805d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.843663 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c0dc6-d592-4f64-90a7-c547ac3805d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.844029 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c0dc6-d592-4f64-90a7-c547ac3805d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.845327 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c0dc6-d592-4f64-90a7-c547ac3805d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:22.847225 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c0dc6-d592-4f64-90a7-c547ac3805d1 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:22.852345 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392b758-5b8f-4777-8ecc-de0ab2e9b9fc admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:22.856246 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef2011-78a0-4f74-b65b-baffcb7d37d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:22.856899 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef2011-78a0-4f74-b65b-baffcb7d37d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.857187 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef2011-78a0-4f74-b65b-baffcb7d37d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.857467 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef2011-78a0-4f74-b65b-baffcb7d37d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.859103 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1099/2189] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:22.860417 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c0dc6-d592-4f64-90a7-c547ac3805d1 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:22.862391 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b0ef2011-78a0-4f74-b65b-baffcb7d37d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:22.874343 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c0dc6-d592-4f64-90a7-c547ac3805d1 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:22.879218 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446838f-2da5-449a-b478-c6651548b573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:22.879873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446838f-2da5-449a-b478-c6651548b573 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.880163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446838f-2da5-449a-b478-c6651548b573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.880451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446838f-2da5-449a-b478-c6651548b573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.881175 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446838f-2da5-449a-b478-c6651548b573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:22.882841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446838f-2da5-449a-b478-c6651548b573 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:22.893268 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1100/2190] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:22.894675 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35177ac2-a1b1-4c5e-9a11-f84d65159c60 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.894802 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35177ac2-a1b1-4c5e-9a11-f84d65159c60 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.895063 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35177ac2-a1b1-4c5e-9a11-f84d65159c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.912488 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-35177ac2-a1b1-4c5e-9a11-f84d65159c60 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:22.913701 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-35177ac2-a1b1-4c5e-9a11-f84d65159c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:22.922389 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1101/2191] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:22.923619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35177ac2-a1b1-4c5e-9a11-f84d65159c60 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:22.933017 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef2011-78a0-4f74-b65b-baffcb7d37d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:22.934366 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35177ac2-a1b1-4c5e-9a11-f84d65159c60 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:22.934483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef2011-78a0-4f74-b65b-baffcb7d37d5 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:22.941895 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92e3be-a44f-4e67-9723-854b67425f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:22.942270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92e3be-a44f-4e67-9723-854b67425f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.942843 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92e3be-a44f-4e67-9723-854b67425f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.943122 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92e3be-a44f-4e67-9723-854b67425f93 admin admin] PATH_INFO: `/v3/projects/7b4dbac4f6d84e698c1d3b40f1639365/users/25ec2787a1f740f3ae074ac09aebcfd0/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.945372 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1091/2192] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:22.951925 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef2011-78a0-4f74-b65b-baffcb7d37d5 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:22.959014 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92e3be-a44f-4e67-9723-854b67425f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4dbac4f6d84e698c1d3b40f1639365, user_id=25ec2787a1f740f3ae074ac09aebcfd0, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:22.961734 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92e3be-a44f-4e67-9723-854b67425f93 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:22.967663 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef2011-78a0-4f74-b65b-baffcb7d37d5 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:22.975068 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d4770-bb36-4f03-a318-9efbf467aab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:22.976058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d4770-bb36-4f03-a318-9efbf467aab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:22.976477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d4770-bb36-4f03-a318-9efbf467aab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:22.976901 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d4770-bb36-4f03-a318-9efbf467aab9 admin admin] PATH_INFO: `/v3/projects/21df24824ef2413884b83fad3c436763/users/aaf6ec170a7a408c945f11cc235b664e/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:22.983873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1102/2193] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:22 2022] PUT /identity/v3/projects/7b4dbac4f6d84e698c1d3b40f1639365/users/25ec2787a1f740f3ae074ac09aebcfd0/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:22.984927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92e3be-a44f-4e67-9723-854b67425f93 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:23.001819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d4770-bb36-4f03-a318-9efbf467aab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21df24824ef2413884b83fad3c436763, user_id=aaf6ec170a7a408c945f11cc235b664e, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:23.005602 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d4770-bb36-4f03-a318-9efbf467aab9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:23.013485 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:23.027495 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1092/2194] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:22 2022] PUT /identity/v3/projects/21df24824ef2413884b83fad3c436763/users/aaf6ec170a7a408c945f11cc235b664e/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:23.029654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1761bb-328d-44ea-a094-226bbea4064e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.029950 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1761bb-328d-44ea-a094-226bbea4064e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.030976 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1761bb-328d-44ea-a094-226bbea4064e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:23.061763 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-da1761bb-328d-44ea-a094-226bbea4064e None None] MFA Rules not processed for user `25ec2787a1f740f3ae074ac09aebcfd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:23.063129 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-da1761bb-328d-44ea-a094-226bbea4064e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:23.085290 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92e3be-a44f-4e67-9723-854b67425f93 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:23.158812 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1093/2195] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:23.158812 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1761bb-328d-44ea-a094-226bbea4064e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:23.165602 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4ab75-0458-40fe-b8ff-f15b09b49978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:23.166204 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4ab75-0458-40fe-b8ff-f15b09b49978 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.166543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4ab75-0458-40fe-b8ff-f15b09b49978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.167318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4ab75-0458-40fe-b8ff-f15b09b49978 admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:23.168098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4ab75-0458-40fe-b8ff-f15b09b49978 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:23.168642 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4ab75-0458-40fe-b8ff-f15b09b49978 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:23.171316 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4ab75-0458-40fe-b8ff-f15b09b49978 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:23.187866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1103/2196] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:23.187866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4ab75-0458-40fe-b8ff-f15b09b49978 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:23.197426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4ab75-0458-40fe-b8ff-f15b09b49978 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:23.202457 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a16eb9-5d00-4fec-a193-cefa11d78325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:23.203136 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a16eb9-5d00-4fec-a193-cefa11d78325 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.203424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a16eb9-5d00-4fec-a193-cefa11d78325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.203701 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a16eb9-5d00-4fec-a193-cefa11d78325 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:23.204385 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a16eb9-5d00-4fec-a193-cefa11d78325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:23.206423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a16eb9-5d00-4fec-a193-cefa11d78325 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:23.220494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:23.248148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1104/2197] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:23 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:23.249375 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a16eb9-5d00-4fec-a193-cefa11d78325 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:23.255465 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1761bb-328d-44ea-a094-226bbea4064e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:23.336133 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a16eb9-5d00-4fec-a193-cefa11d78325 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:23.339120 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877c8e8-39d8-4232-a051-ef2b2a2a01a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:23.340063 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877c8e8-39d8-4232-a051-ef2b2a2a01a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.340514 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877c8e8-39d8-4232-a051-ef2b2a2a01a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.341013 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877c8e8-39d8-4232-a051-ef2b2a2a01a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:23.341321 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28874383-b6a7-48a1-ad32-3072370b33c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:23.342049 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28874383-b6a7-48a1-ad32-3072370b33c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.342388 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877c8e8-39d8-4232-a051-ef2b2a2a01a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:23.342537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28874383-b6a7-48a1-ad32-3072370b33c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.342901 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28874383-b6a7-48a1-ad32-3072370b33c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:23.343721 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28874383-b6a7-48a1-ad32-3072370b33c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:23.344900 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877c8e8-39d8-4232-a051-ef2b2a2a01a3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:23.345870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28874383-b6a7-48a1-ad32-3072370b33c0 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:23.356784 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1094/2198] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:23.357874 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877c8e8-39d8-4232-a051-ef2b2a2a01a3 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:23.359935 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1877c8e8-39d8-4232-a051-ef2b2a2a01a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:23.375756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1105/2199] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:23 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:23.376578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28874383-b6a7-48a1-ad32-3072370b33c0 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:23.398051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:23.422113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877c8e8-39d8-4232-a051-ef2b2a2a01a3 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:23.440794 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28874383-b6a7-48a1-ad32-3072370b33c0 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:23.445629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b89ab-90f8-47fa-9d91-a014dbed8438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:23.446924 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b89ab-90f8-47fa-9d91-a014dbed8438 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.447208 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b89ab-90f8-47fa-9d91-a014dbed8438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.447484 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b89ab-90f8-47fa-9d91-a014dbed8438 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:23.448189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b89ab-90f8-47fa-9d91-a014dbed8438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:23.450089 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b89ab-90f8-47fa-9d91-a014dbed8438 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:23.472988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1106/2200] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:23 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:23.472988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b89ab-90f8-47fa-9d91-a014dbed8438 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:23.473277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b4c71-92de-44f2-9921-846929f6a167 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:23.473277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b4c71-92de-44f2-9921-846929f6a167 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.473277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b4c71-92de-44f2-9921-846929f6a167 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.473277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b4c71-92de-44f2-9921-846929f6a167 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:23.475070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-413b4c71-92de-44f2-9921-846929f6a167 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:23.480963 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b89ab-90f8-47fa-9d91-a014dbed8438 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:23.485498 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36052b01-e2ed-4872-bc9d-fc67a4e9cb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:23.486710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36052b01-e2ed-4872-bc9d-fc67a4e9cb10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.486995 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36052b01-e2ed-4872-bc9d-fc67a4e9cb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.487436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36052b01-e2ed-4872-bc9d-fc67a4e9cb10 admin admin] PATH_INFO: `/v3/projects/21df24824ef2413884b83fad3c436763/users/aaf6ec170a7a408c945f11cc235b664e/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:23.489581 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36052b01-e2ed-4872-bc9d-fc67a4e9cb10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21df24824ef2413884b83fad3c436763, user_id=aaf6ec170a7a408c945f11cc235b664e, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:23.492236 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36052b01-e2ed-4872-bc9d-fc67a4e9cb10 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:23.505010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1107/2201] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:23 2022] PUT /identity/v3/projects/21df24824ef2413884b83fad3c436763/users/aaf6ec170a7a408c945f11cc235b664e/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:23.505640 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36052b01-e2ed-4872-bc9d-fc67a4e9cb10 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:23.534534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:23.545702 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b4c71-92de-44f2-9921-846929f6a167 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:23.547205 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b4c71-92de-44f2-9921-846929f6a167 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:23.556960 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1095/2202] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:23.557820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b4c71-92de-44f2-9921-846929f6a167 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:23.569903 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b4c71-92de-44f2-9921-846929f6a167 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:23.576688 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5af8a-44f8-46d9-b2f4-e57ea1375dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:23.577366 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5af8a-44f8-46d9-b2f4-e57ea1375dea admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.577655 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5af8a-44f8-46d9-b2f4-e57ea1375dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.577926 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5af8a-44f8-46d9-b2f4-e57ea1375dea admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:23.578851 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5af8a-44f8-46d9-b2f4-e57ea1375dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:23.580469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5af8a-44f8-46d9-b2f4-e57ea1375dea admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:23.583788 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36052b01-e2ed-4872-bc9d-fc67a4e9cb10 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:23.589460 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3251689-acdf-496f-adec-54ded5d2e469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:23.590136 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3251689-acdf-496f-adec-54ded5d2e469 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.590583 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3251689-acdf-496f-adec-54ded5d2e469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.590871 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3251689-acdf-496f-adec-54ded5d2e469 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:23.591569 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3251689-acdf-496f-adec-54ded5d2e469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:23.593547 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3251689-acdf-496f-adec-54ded5d2e469 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:23.594234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1096/2203] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:23.595540 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bcd4b-2444-45aa-a372-b185a51a9a6f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.595832 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bcd4b-2444-45aa-a372-b185a51a9a6f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.596108 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bcd4b-2444-45aa-a372-b185a51a9a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:23.618928 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1108/2204] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:23 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:23.619772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3251689-acdf-496f-adec-54ded5d2e469 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:23.629204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b92bcd4b-2444-45aa-a372-b185a51a9a6f None None] MFA Rules not processed for user `aaf6ec170a7a408c945f11cc235b664e`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:23.629966 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3251689-acdf-496f-adec-54ded5d2e469 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:23.630431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b92bcd4b-2444-45aa-a372-b185a51a9a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:23.635492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833e01a-67e4-4046-b1f7-b3c26e2c2c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:23.636619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833e01a-67e4-4046-b1f7-b3c26e2c2c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.636915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833e01a-67e4-4046-b1f7-b3c26e2c2c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.637348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833e01a-67e4-4046-b1f7-b3c26e2c2c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:23.638197 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833e01a-67e4-4046-b1f7-b3c26e2c2c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:23.640154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833e01a-67e4-4046-b1f7-b3c26e2c2c74 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:23.651362 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1109/2205] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:23.656109 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833e01a-67e4-4046-b1f7-b3c26e2c2c74 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:23.672570 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833e01a-67e4-4046-b1f7-b3c26e2c2c74 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:23.679314 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38cacf-c9ba-4e4a-9742-3d2317d3f9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:23.680004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38cacf-c9ba-4e4a-9742-3d2317d3f9bd admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.680383 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38cacf-c9ba-4e4a-9742-3d2317d3f9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.680714 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38cacf-c9ba-4e4a-9742-3d2317d3f9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:23.681798 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38cacf-c9ba-4e4a-9742-3d2317d3f9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:23.684113 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38cacf-c9ba-4e4a-9742-3d2317d3f9bd admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:23.701149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1110/2206] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:23.701149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38cacf-c9ba-4e4a-9742-3d2317d3f9bd admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:23.710672 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38cacf-c9ba-4e4a-9742-3d2317d3f9bd admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:23.716449 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822a628-0da8-4ac8-8b25-3b04c4b6cc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:23.717361 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822a628-0da8-4ac8-8b25-3b04c4b6cc09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.717720 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822a628-0da8-4ac8-8b25-3b04c4b6cc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.718106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822a628-0da8-4ac8-8b25-3b04c4b6cc09 admin admin] PATH_INFO: `/v3/projects/de12103039d540ebb4ce07bca0f3de6d/users/8c7d651f18784768a11dbae6b3128c75/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:23.719557 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1097/2207] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:23.720435 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bcd4b-2444-45aa-a372-b185a51a9a6f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:23.732983 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bcd4b-2444-45aa-a372-b185a51a9a6f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:23.738604 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16431af-4c93-40cd-9f36-70b5e92e7c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:23.739280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16431af-4c93-40cd-9f36-70b5e92e7c2b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.739569 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16431af-4c93-40cd-9f36-70b5e92e7c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.739848 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16431af-4c93-40cd-9f36-70b5e92e7c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:23.740601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16431af-4c93-40cd-9f36-70b5e92e7c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:23.742170 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822a628-0da8-4ac8-8b25-3b04c4b6cc09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de12103039d540ebb4ce07bca0f3de6d, user_id=8c7d651f18784768a11dbae6b3128c75, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:23.742367 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16431af-4c93-40cd-9f36-70b5e92e7c2b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:23.745220 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822a628-0da8-4ac8-8b25-3b04c4b6cc09 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:23.754573 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1098/2208] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:23.759305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16431af-4c93-40cd-9f36-70b5e92e7c2b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:23.764622 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1111/2209] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:23 2022] PUT /identity/v3/projects/de12103039d540ebb4ce07bca0f3de6d/users/8c7d651f18784768a11dbae6b3128c75/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:23.774077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822a628-0da8-4ac8-8b25-3b04c4b6cc09 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:23.828999 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:23.829294 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16431af-4c93-40cd-9f36-70b5e92e7c2b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:23.853741 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822a628-0da8-4ac8-8b25-3b04c4b6cc09 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:23.859113 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55f976-033a-4660-9cd3-7e559409d038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:23.859997 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55f976-033a-4660-9cd3-7e559409d038 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.860281 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55f976-033a-4660-9cd3-7e559409d038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.860556 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55f976-033a-4660-9cd3-7e559409d038 admin admin] PATH_INFO: `/v3/projects/313a432cf4a345a0b7fd4528e943da9d/users/045817048d544c498a46e5e15ffbdada/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:23.879399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55f976-033a-4660-9cd3-7e559409d038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=313a432cf4a345a0b7fd4528e943da9d, user_id=045817048d544c498a46e5e15ffbdada, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:23.883883 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55f976-033a-4660-9cd3-7e559409d038 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:23.885647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7efb56-5c3a-46e2-9cfe-25371a5fa7f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:23.886374 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7efb56-5c3a-46e2-9cfe-25371a5fa7f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.886759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7efb56-5c3a-46e2-9cfe-25371a5fa7f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.887044 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7efb56-5c3a-46e2-9cfe-25371a5fa7f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:23.889036 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9b7efb56-5c3a-46e2-9cfe-25371a5fa7f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:23.901421 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1112/2210] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:23 2022] PUT /identity/v3/projects/313a432cf4a345a0b7fd4528e943da9d/users/045817048d544c498a46e5e15ffbdada/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:23.903064 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d00ea9-77f7-4623-91de-8c1c9a964729 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.903512 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d00ea9-77f7-4623-91de-8c1c9a964729 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.903894 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d00ea9-77f7-4623-91de-8c1c9a964729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:23.925924 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:23.946065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-60d00ea9-77f7-4623-91de-8c1c9a964729 None None] MFA Rules not processed for user `8c7d651f18784768a11dbae6b3128c75`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:23.948455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-60d00ea9-77f7-4623-91de-8c1c9a964729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:23.965527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7efb56-5c3a-46e2-9cfe-25371a5fa7f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:23.968236 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7efb56-5c3a-46e2-9cfe-25371a5fa7f7 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:23.984193 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1099/2211] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:23.985567 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f5d43-828e-4055-8165-0cd86e91c167 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:23.986178 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f5d43-828e-4055-8165-0cd86e91c167 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:23.986560 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f5d43-828e-4055-8165-0cd86e91c167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:24.011699 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ae3f5d43-828e-4055-8165-0cd86e91c167 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:24.013530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ae3f5d43-828e-4055-8165-0cd86e91c167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:24.080099 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1113/2212] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:24.084783 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d00ea9-77f7-4623-91de-8c1c9a964729 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:24.125534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1100/2213] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:24.136066 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f5d43-828e-4055-8165-0cd86e91c167 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:24.137739 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ae3f5d43-828e-4055-8165-0cd86e91c167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:24.193091 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d00ea9-77f7-4623-91de-8c1c9a964729 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:24.201614 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eca066-26bb-4511-89d3-b86d7ef7affe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:24.202872 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eca066-26bb-4511-89d3-b86d7ef7affe admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:24.203812 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eca066-26bb-4511-89d3-b86d7ef7affe admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:24.204268 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eca066-26bb-4511-89d3-b86d7ef7affe admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:24.205247 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eca066-26bb-4511-89d3-b86d7ef7affe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:24.207389 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eca066-26bb-4511-89d3-b86d7ef7affe admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:24.224418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f5d43-828e-4055-8165-0cd86e91c167 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:24.229126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f89aa-ec9c-4d2a-816a-bce8c893fc9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:24.229800 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f89aa-ec9c-4d2a-816a-bce8c893fc9d service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:24.230095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f89aa-ec9c-4d2a-816a-bce8c893fc9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:24.230394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f89aa-ec9c-4d2a-816a-bce8c893fc9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:24.243184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f89aa-ec9c-4d2a-816a-bce8c893fc9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:24.243184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f89aa-ec9c-4d2a-816a-bce8c893fc9d service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:24.257283 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1114/2214] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:24 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:34:24.257426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1101/2215] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:34:24.258907 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eca066-26bb-4511-89d3-b86d7ef7affe admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:24.271127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f89aa-ec9c-4d2a-816a-bce8c893fc9d service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:24.318238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:24.350955 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f89aa-ec9c-4d2a-816a-bce8c893fc9d service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:24.366134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eca066-26bb-4511-89d3-b86d7ef7affe admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:24.379270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a7a1b-a967-4acb-bfdb-b01aad3f651f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:24.379795 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:24.380099 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a7a1b-a967-4acb-bfdb-b01aad3f651f admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:24.380648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a7a1b-a967-4acb-bfdb-b01aad3f651f admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:24.381006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a7a1b-a967-4acb-bfdb-b01aad3f651f admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:24.381789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a7a1b-a967-4acb-bfdb-b01aad3f651f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:24.389098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a7a1b-a967-4acb-bfdb-b01aad3f651f admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:24.417557 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b1dce-3932-4977-8441-e6fe703a3ae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:24.418283 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b1dce-3932-4977-8441-e6fe703a3ae6 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:24.418632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b1dce-3932-4977-8441-e6fe703a3ae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:24.419382 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b1dce-3932-4977-8441-e6fe703a3ae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:24.421796 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-800b1dce-3932-4977-8441-e6fe703a3ae6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:24.433271 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1115/2216] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:24 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:34:24.438100 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a7a1b-a967-4acb-bfdb-b01aad3f651f admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:24.456596 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a7a1b-a967-4acb-bfdb-b01aad3f651f admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:24.473859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203ce01-2327-4a0e-a595-5c3e8b3cdc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:24.474912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203ce01-2327-4a0e-a595-5c3e8b3cdc50 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:24.475536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203ce01-2327-4a0e-a595-5c3e8b3cdc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:24.475875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203ce01-2327-4a0e-a595-5c3e8b3cdc50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:24.476791 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203ce01-2327-4a0e-a595-5c3e8b3cdc50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:24.481711 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203ce01-2327-4a0e-a595-5c3e8b3cdc50 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:24.501737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b1dce-3932-4977-8441-e6fe703a3ae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:24.502888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1116/2217] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:24.503614 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b1dce-3932-4977-8441-e6fe703a3ae6 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:24.506988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203ce01-2327-4a0e-a595-5c3e8b3cdc50 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:24.518959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203ce01-2327-4a0e-a595-5c3e8b3cdc50 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:24.519161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1102/2218] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:34:24.525623 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6ac60-126a-43d8-9a38-88582268cd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:24.526759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6ac60-126a-43d8-9a38-88582268cd1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:24.527064 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6ac60-126a-43d8-9a38-88582268cd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:24.527436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6ac60-126a-43d8-9a38-88582268cd1b admin admin] PATH_INFO: `/v3/projects/a28318fb74b44d06a03a6cc4498fa1b4/users/7e090048e505481eaf0e6a77daec4ab9/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:24.550004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6ac60-126a-43d8-9a38-88582268cd1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28318fb74b44d06a03a6cc4498fa1b4, user_id=7e090048e505481eaf0e6a77daec4ab9, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:24.553070 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6ac60-126a-43d8-9a38-88582268cd1b admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:24.576485 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1117/2219] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:24 2022] PUT /identity/v3/projects/a28318fb74b44d06a03a6cc4498fa1b4/users/7e090048e505481eaf0e6a77daec4ab9/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:24.577507 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b1dce-3932-4977-8441-e6fe703a3ae6 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:24.590798 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b1dce-3932-4977-8441-e6fe703a3ae6 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:24.691261 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a9425-c13c-4113-ad99-4833808b65c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:24.692241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a9425-c13c-4113-ad99-4833808b65c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:24.692895 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a9425-c13c-4113-ad99-4833808b65c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:24.693286 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a9425-c13c-4113-ad99-4833808b65c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:24.694093 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a9425-c13c-4113-ad99-4833808b65c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:24.696456 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a9425-c13c-4113-ad99-4833808b65c0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:24.707611 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1103/2220] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:34:24.712688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6ac60-126a-43d8-9a38-88582268cd1b admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:24.733833 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6ac60-126a-43d8-9a38-88582268cd1b admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:24.741322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6144d3-f07b-4cd0-b600-04aff25193f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:24.743529 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6144d3-f07b-4cd0-b600-04aff25193f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:24.744039 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6144d3-f07b-4cd0-b600-04aff25193f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:24.744596 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6144d3-f07b-4cd0-b600-04aff25193f5 admin admin] PATH_INFO: `/v3/projects/a28318fb74b44d06a03a6cc4498fa1b4/users/7e090048e505481eaf0e6a77daec4ab9/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:24.747201 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6144d3-f07b-4cd0-b600-04aff25193f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28318fb74b44d06a03a6cc4498fa1b4, user_id=7e090048e505481eaf0e6a77daec4ab9, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:24.750647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6144d3-f07b-4cd0-b600-04aff25193f5 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:24.763643 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1118/2221] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:24 2022] PUT /identity/v3/projects/a28318fb74b44d06a03a6cc4498fa1b4/users/7e090048e505481eaf0e6a77daec4ab9/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:24.775426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f91d76-efa3-482a-94fd-3050ce95a29f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:24.775743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f91d76-efa3-482a-94fd-3050ce95a29f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:24.776001 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f91d76-efa3-482a-94fd-3050ce95a29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:24.814189 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-42f91d76-efa3-482a-94fd-3050ce95a29f None None] MFA Rules not processed for user `7e090048e505481eaf0e6a77daec4ab9`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:24.818492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-42f91d76-efa3-482a-94fd-3050ce95a29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:24.888777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:24.894938 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1104/2222] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:24.908556 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6144d3-f07b-4cd0-b600-04aff25193f5 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:24.972615 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6144d3-f07b-4cd0-b600-04aff25193f5 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:24.977597 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5246e6-0ba9-4f0c-90f4-6466dd5b911f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:24.978253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5246e6-0ba9-4f0c-90f4-6466dd5b911f service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:24.978638 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5246e6-0ba9-4f0c-90f4-6466dd5b911f service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:24.978927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5246e6-0ba9-4f0c-90f4-6466dd5b911f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:25.041926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5246e6-0ba9-4f0c-90f4-6466dd5b911f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:25.043047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5246e6-0ba9-4f0c-90f4-6466dd5b911f service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:25.052959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1119/2223] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:25.075462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0420dc0-b306-4460-8b75-19c0cdc80433 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:25.076500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0420dc0-b306-4460-8b75-19c0cdc80433 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:25.076500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0420dc0-b306-4460-8b75-19c0cdc80433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:25.129839 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d0420dc0-b306-4460-8b75-19c0cdc80433 None None] MFA Rules not processed for user `045817048d544c498a46e5e15ffbdada`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:25.131783 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d0420dc0-b306-4460-8b75-19c0cdc80433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:25.247916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1105/2224] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:25.249124 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5246e6-0ba9-4f0c-90f4-6466dd5b911f service cinder] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:25.296994 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:25.328926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5246e6-0ba9-4f0c-90f4-6466dd5b911f service cinder] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:25.334907 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8629bb-a76b-4ecf-bb28-38a4e3148cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:25.336348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8629bb-a76b-4ecf-bb28-38a4e3148cc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:25.337090 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8629bb-a76b-4ecf-bb28-38a4e3148cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:25.337905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8629bb-a76b-4ecf-bb28-38a4e3148cc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:25.338773 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8629bb-a76b-4ecf-bb28-38a4e3148cc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:25.340702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8629bb-a76b-4ecf-bb28-38a4e3148cc3 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:25.369284 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1120/2225] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:25 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:25.379376 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0420dc0-b306-4460-8b75-19c0cdc80433 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:25.391428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0420dc0-b306-4460-8b75-19c0cdc80433 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:25.453082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b42e3-6883-4509-872c-75c714e133b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:25.453758 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b42e3-6883-4509-872c-75c714e133b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:25.454049 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b42e3-6883-4509-872c-75c714e133b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:25.454336 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b42e3-6883-4509-872c-75c714e133b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:25.455077 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b42e3-6883-4509-872c-75c714e133b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:25.457036 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b42e3-6883-4509-872c-75c714e133b5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:25.484432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1106/2226] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:25 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:25.485641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8629bb-a76b-4ecf-bb28-38a4e3148cc3 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:25.496609 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8629bb-a76b-4ecf-bb28-38a4e3148cc3 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:25.502123 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cec7c-b6e8-463e-899b-eda88f820d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:25.502816 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cec7c-b6e8-463e-899b-eda88f820d7a admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:25.503101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cec7c-b6e8-463e-899b-eda88f820d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:25.503376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cec7c-b6e8-463e-899b-eda88f820d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:25.504089 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cec7c-b6e8-463e-899b-eda88f820d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:25.505678 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cec7c-b6e8-463e-899b-eda88f820d7a admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:25.517489 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1121/2227] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:25.521748 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b42e3-6883-4509-872c-75c714e133b5 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:25.529204 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cec7c-b6e8-463e-899b-eda88f820d7a admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:25.532606 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b42e3-6883-4509-872c-75c714e133b5 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:25.537314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa952d-a5b9-4a40-af8a-797beb87ffc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:25.538217 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa952d-a5b9-4a40-af8a-797beb87ffc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:25.538526 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa952d-a5b9-4a40-af8a-797beb87ffc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:25.538800 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa952d-a5b9-4a40-af8a-797beb87ffc7 admin admin] PATH_INFO: `/v3/projects/343b5f0bcffb4aefb08100d6cd59e52a/users/7b6ed73f6be7471db8369c7b3048ab83/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:25.553980 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa952d-a5b9-4a40-af8a-797beb87ffc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=343b5f0bcffb4aefb08100d6cd59e52a, user_id=7b6ed73f6be7471db8369c7b3048ab83, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:25.557367 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa952d-a5b9-4a40-af8a-797beb87ffc7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:25.573667 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1107/2228] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:25 2022] PUT /identity/v3/projects/343b5f0bcffb4aefb08100d6cd59e52a/users/7b6ed73f6be7471db8369c7b3048ab83/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:25.577975 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa952d-a5b9-4a40-af8a-797beb87ffc7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:25.590988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cec7c-b6e8-463e-899b-eda88f820d7a admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:25.629761 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:25.641120 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7afc8-8c3a-45db-b5d1-5ae3a175c3b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:25.641838 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7afc8-8c3a-45db-b5d1-5ae3a175c3b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:25.642131 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7afc8-8c3a-45db-b5d1-5ae3a175c3b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:25.642339 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa952d-a5b9-4a40-af8a-797beb87ffc7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:25.642449 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7afc8-8c3a-45db-b5d1-5ae3a175c3b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:25.647770 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89d72e-9468-4eef-b855-bbad876bec90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:25.648557 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89d72e-9468-4eef-b855-bbad876bec90 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:25.649422 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89d72e-9468-4eef-b855-bbad876bec90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:25.649756 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89d72e-9468-4eef-b855-bbad876bec90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:25.650694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89d72e-9468-4eef-b855-bbad876bec90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:25.652557 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89d72e-9468-4eef-b855-bbad876bec90 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:25.665210 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1108/2229] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:34:25.669233 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89d72e-9468-4eef-b855-bbad876bec90 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:25.680845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89d72e-9468-4eef-b855-bbad876bec90 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:25.686204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d2696-bc7b-4469-b34f-660d9ca848b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:25.687162 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d2696-bc7b-4469-b34f-660d9ca848b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:25.687453 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d2696-bc7b-4469-b34f-660d9ca848b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:25.687734 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d2696-bc7b-4469-b34f-660d9ca848b0 admin admin] PATH_INFO: `/v3/projects/343b5f0bcffb4aefb08100d6cd59e52a/users/7b6ed73f6be7471db8369c7b3048ab83/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:25.689791 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d2696-bc7b-4469-b34f-660d9ca848b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=343b5f0bcffb4aefb08100d6cd59e52a, user_id=7b6ed73f6be7471db8369c7b3048ab83, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:25.692797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d2696-bc7b-4469-b34f-660d9ca848b0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:25.707758 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1109/2230] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:25 2022] PUT /identity/v3/projects/343b5f0bcffb4aefb08100d6cd59e52a/users/7b6ed73f6be7471db8369c7b3048ab83/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:25.719377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7afc8-8c3a-45db-b5d1-5ae3a175c3b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:25.721786 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7afc8-8c3a-45db-b5d1-5ae3a175c3b6 service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:25.732396 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1122/2231] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:34:26.508573 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75731d-1f6a-4976-902c-1fc37320978c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:26.509528 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75731d-1f6a-4976-902c-1fc37320978c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:26.509822 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75731d-1f6a-4976-902c-1fc37320978c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:26.546106 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3f75731d-1f6a-4976-902c-1fc37320978c None None] MFA Rules not processed for user `7b6ed73f6be7471db8369c7b3048ab83`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:26.547572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3f75731d-1f6a-4976-902c-1fc37320978c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:26.632768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1110/2232] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:26.645486 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b217b-85b5-4b32-a5fa-d49425450226 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:26.646010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b217b-85b5-4b32-a5fa-d49425450226 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:26.646102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b217b-85b5-4b32-a5fa-d49425450226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:26.670530 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-000b217b-85b5-4b32-a5fa-d49425450226 None None] MFA Rules not processed for user `045817048d544c498a46e5e15ffbdada`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:26.677593 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-000b217b-85b5-4b32-a5fa-d49425450226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:26.685596 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75731d-1f6a-4976-902c-1fc37320978c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:26.690532 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:26.745202 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1123/2233] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:34:26.752409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75731d-1f6a-4976-902c-1fc37320978c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:26.756497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a70fab-10a1-4eee-ac18-87a0f885455b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:26.756822 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b217b-85b5-4b32-a5fa-d49425450226 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:26.757687 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a70fab-10a1-4eee-ac18-87a0f885455b service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:26.757947 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a70fab-10a1-4eee-ac18-87a0f885455b service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:26.758923 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a70fab-10a1-4eee-ac18-87a0f885455b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:26.759356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-000b217b-85b5-4b32-a5fa-d49425450226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:26.820276 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a70fab-10a1-4eee-ac18-87a0f885455b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:26.822294 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a70fab-10a1-4eee-ac18-87a0f885455b service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:26.831921 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1111/2234] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:34:26.837171 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b217b-85b5-4b32-a5fa-d49425450226 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:26.843064 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c098dbd-78ca-4731-9d46-5ed375555ee9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:26.843776 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c098dbd-78ca-4731-9d46-5ed375555ee9 service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:26.844158 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c098dbd-78ca-4731-9d46-5ed375555ee9 service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:26.844410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c098dbd-78ca-4731-9d46-5ed375555ee9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:26.853906 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c098dbd-78ca-4731-9d46-5ed375555ee9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:26.855535 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c098dbd-78ca-4731-9d46-5ed375555ee9 service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:26.864410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1124/2235] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:34:27.569561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a70fab-10a1-4eee-ac18-87a0f885455b service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:27.579842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a70fab-10a1-4eee-ac18-87a0f885455b service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:27.589090 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc470b73-3655-45cb-a6c8-c0c314a06f86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:27.589839 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc470b73-3655-45cb-a6c8-c0c314a06f86 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:27.590186 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc470b73-3655-45cb-a6c8-c0c314a06f86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:27.590650 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc470b73-3655-45cb-a6c8-c0c314a06f86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:27.609541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:27.690958 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c098dbd-78ca-4731-9d46-5ed375555ee9 service nova] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:27.697565 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc470b73-3655-45cb-a6c8-c0c314a06f86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:27.699147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc470b73-3655-45cb-a6c8-c0c314a06f86 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:27.702153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c098dbd-78ca-4731-9d46-5ed375555ee9 service nova] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:27.705683 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b9282-0916-496c-967b-c7bb6b5fcda7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:27.706726 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b9282-0916-496c-967b-c7bb6b5fcda7 service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:27.707274 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b9282-0916-496c-967b-c7bb6b5fcda7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:27.707688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b9282-0916-496c-967b-c7bb6b5fcda7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:27.709709 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-502b9282-0916-496c-967b-c7bb6b5fcda7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:27.726360 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1112/2236] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:27.803404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b9282-0916-496c-967b-c7bb6b5fcda7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:27.805842 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b9282-0916-496c-967b-c7bb6b5fcda7 service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:27.817765 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1125/2237] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:34:28.766089 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc470b73-3655-45cb-a6c8-c0c314a06f86 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:28.767668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fc470b73-3655-45cb-a6c8-c0c314a06f86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:28.832444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc470b73-3655-45cb-a6c8-c0c314a06f86 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:28.837490 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d7f54-5717-49d2-9630-10c3df1a0d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:28.838371 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d7f54-5717-49d2-9630-10c3df1a0d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:28.838687 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d7f54-5717-49d2-9630-10c3df1a0d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:28.838969 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d7f54-5717-49d2-9630-10c3df1a0d42 admin admin] PATH_INFO: `/v3/users/1b63ed9ad32b4a4bb85c1f791c2fb356` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:28.840283 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d7f54-5717-49d2-9630-10c3df1a0d42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b63ed9ad32b4a4bb85c1f791c2fb356)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:28.842395 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d7f54-5717-49d2-9630-10c3df1a0d42 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:28.894442 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e77d7f54-5717-49d2-9630-10c3df1a0d42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b63ed9ad32b4a4bb85c1f791c2fb356'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:28.902599 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e77d7f54-5717-49d2-9630-10c3df1a0d42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b63ed9ad32b4a4bb85c1f791c2fb356'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:28.903223 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e77d7f54-5717-49d2-9630-10c3df1a0d42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b63ed9ad32b4a4bb85c1f791c2fb356'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:28.903831 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e77d7f54-5717-49d2-9630-10c3df1a0d42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b63ed9ad32b4a4bb85c1f791c2fb356'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:28.918149 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e77d7f54-5717-49d2-9630-10c3df1a0d42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b63ed9ad32b4a4bb85c1f791c2fb356'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:28.937173 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1113/2238] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:28 2022] DELETE /identity/v3/users/1b63ed9ad32b4a4bb85c1f791c2fb356 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:28.941951 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bf1e9-d940-4745-9d32-99a7ea912a85 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:28.943304 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bf1e9-d940-4745-9d32-99a7ea912a85 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:28.943599 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bf1e9-d940-4745-9d32-99a7ea912a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:28.972405 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-ed4bf1e9-d940-4745-9d32-99a7ea912a85 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:28.974717 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ed4bf1e9-d940-4745-9d32-99a7ea912a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:29.027654 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:29.057706 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d7f54-5717-49d2-9630-10c3df1a0d42 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:29.060114 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e77d7f54-5717-49d2-9630-10c3df1a0d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:29.084214 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1126/2239] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:29.101288 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4bf1e9-d940-4745-9d32-99a7ea912a85 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:29.103603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ed4bf1e9-d940-4745-9d32-99a7ea912a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:29.106168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:29.188588 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4bf1e9-d940-4745-9d32-99a7ea912a85 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:29.191582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d7f54-5717-49d2-9630-10c3df1a0d42 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:29.195521 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36488e86-aaa7-4c50-b44f-92d6ddf165fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:29.196366 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36488e86-aaa7-4c50-b44f-92d6ddf165fc service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:29.196655 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36488e86-aaa7-4c50-b44f-92d6ddf165fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:29.196931 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36488e86-aaa7-4c50-b44f-92d6ddf165fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:29.207223 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0a2ed-3e65-4acc-9009-6d385e975bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:29.208743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0a2ed-3e65-4acc-9009-6d385e975bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:29.208743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0a2ed-3e65-4acc-9009-6d385e975bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:29.208743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0a2ed-3e65-4acc-9009-6d385e975bcd admin admin] PATH_INFO: `/v3/users/eb43e96c14354f95b4e1ac2c18a47623` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:29.210048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0a2ed-3e65-4acc-9009-6d385e975bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb43e96c14354f95b4e1ac2c18a47623)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:29.213321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0a2ed-3e65-4acc-9009-6d385e975bcd admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:29.215895 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36488e86-aaa7-4c50-b44f-92d6ddf165fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:29.217789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36488e86-aaa7-4c50-b44f-92d6ddf165fc service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:29.231550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1127/2240] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:34:29.295380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-cef0a2ed-3e65-4acc-9009-6d385e975bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb43e96c14354f95b4e1ac2c18a47623'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:29.303737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-cef0a2ed-3e65-4acc-9009-6d385e975bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb43e96c14354f95b4e1ac2c18a47623'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:29.304537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-cef0a2ed-3e65-4acc-9009-6d385e975bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb43e96c14354f95b4e1ac2c18a47623'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:29.306153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-cef0a2ed-3e65-4acc-9009-6d385e975bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb43e96c14354f95b4e1ac2c18a47623'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:29.324240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-cef0a2ed-3e65-4acc-9009-6d385e975bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb43e96c14354f95b4e1ac2c18a47623'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:29.339520 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1114/2241] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:29 2022] DELETE /identity/v3/users/eb43e96c14354f95b4e1ac2c18a47623 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:29.344044 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8e431-c839-4246-9392-8d40788f41ec None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:29.344343 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8e431-c839-4246-9392-8d40788f41ec None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:29.344629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8e431-c839-4246-9392-8d40788f41ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:29.362357 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-dbb8e431-c839-4246-9392-8d40788f41ec None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:29.363751 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-dbb8e431-c839-4246-9392-8d40788f41ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:29.430476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1128/2242] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:29.436423 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0a2ed-3e65-4acc-9009-6d385e975bcd admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:29.437962 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cef0a2ed-3e65-4acc-9009-6d385e975bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:29.503730 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0a2ed-3e65-4acc-9009-6d385e975bcd admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:29.507597 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a8eb7-6e26-4c34-a88b-1fdb870fe7ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:29.508284 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a8eb7-6e26-4c34-a88b-1fdb870fe7ea service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:29.508571 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a8eb7-6e26-4c34-a88b-1fdb870fe7ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:29.508850 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a8eb7-6e26-4c34-a88b-1fdb870fe7ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:29.518564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a8eb7-6e26-4c34-a88b-1fdb870fe7ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:29.520149 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a8eb7-6e26-4c34-a88b-1fdb870fe7ea service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:29.534228 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1115/2243] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:29.573880 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8e431-c839-4246-9392-8d40788f41ec None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:29.576217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-dbb8e431-c839-4246-9392-8d40788f41ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:29.609565 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8e431-c839-4246-9392-8d40788f41ec None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:29.616016 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754850a-0d9e-47ce-85fa-d2cf21b155ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:29.617088 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754850a-0d9e-47ce-85fa-d2cf21b155ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:29.618019 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754850a-0d9e-47ce-85fa-d2cf21b155ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:29.618644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754850a-0d9e-47ce-85fa-d2cf21b155ab admin admin] PATH_INFO: `/v3/projects/2fcb3c82c27e476ea14628195b486b67` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:29.620006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754850a-0d9e-47ce-85fa-d2cf21b155ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fcb3c82c27e476ea14628195b486b67)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:29.623193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754850a-0d9e-47ce-85fa-d2cf21b155ab admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:29.705220 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-1754850a-0d9e-47ce-85fa-d2cf21b155ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fcb3c82c27e476ea14628195b486b67', 'request_id': 'req-1754850a-0d9e-47ce-85fa-d2cf21b155ab'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:29.714730 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-1754850a-0d9e-47ce-85fa-d2cf21b155ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fcb3c82c27e476ea14628195b486b67', 'request_id': 'req-1754850a-0d9e-47ce-85fa-d2cf21b155ab'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:29.729659 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-1754850a-0d9e-47ce-85fa-d2cf21b155ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fcb3c82c27e476ea14628195b486b67', 'request_id': 'req-1754850a-0d9e-47ce-85fa-d2cf21b155ab'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:29.745843 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-1754850a-0d9e-47ce-85fa-d2cf21b155ab admin admin] The token cache is being invalidate because project 2fcb3c82c27e476ea14628195b486b67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:29.746102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-1754850a-0d9e-47ce-85fa-d2cf21b155ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:29.746784 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-1754850a-0d9e-47ce-85fa-d2cf21b155ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:29.748404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1129/2244] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:29 2022] DELETE /identity/v3/projects/2fcb3c82c27e476ea14628195b486b67 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:29.752420 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a8eb7-6e26-4c34-a88b-1fdb870fe7ea service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:29.766734 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a8eb7-6e26-4c34-a88b-1fdb870fe7ea service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:29.828320 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:29.859569 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc8ac6-dc72-4429-8daf-7e0c8318c6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:29.861198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc8ac6-dc72-4429-8daf-7e0c8318c6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:29.861605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc8ac6-dc72-4429-8daf-7e0c8318c6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:29.861990 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc8ac6-dc72-4429-8daf-7e0c8318c6bc admin admin] PATH_INFO: `/v3/users/d445f2ca06f54853beb1bb518ffb41ab` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:29.864427 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc8ac6-dc72-4429-8daf-7e0c8318c6bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d445f2ca06f54853beb1bb518ffb41ab)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:29.867148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc8ac6-dc72-4429-8daf-7e0c8318c6bc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:29.983870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754850a-0d9e-47ce-85fa-d2cf21b155ab admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:29.984771 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c1fc8ac6-dc72-4429-8daf-7e0c8318c6bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd445f2ca06f54853beb1bb518ffb41ab'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:29.985515 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-1754850a-0d9e-47ce-85fa-d2cf21b155ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:29.999314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c1fc8ac6-dc72-4429-8daf-7e0c8318c6bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd445f2ca06f54853beb1bb518ffb41ab'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:29.999919 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c1fc8ac6-dc72-4429-8daf-7e0c8318c6bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd445f2ca06f54853beb1bb518ffb41ab'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:30.001196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c1fc8ac6-dc72-4429-8daf-7e0c8318c6bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd445f2ca06f54853beb1bb518ffb41ab'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:30.002695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754850a-0d9e-47ce-85fa-d2cf21b155ab admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:30.008331 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66967e-c000-4061-8ded-d07c580c02b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:30.009350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66967e-c000-4061-8ded-d07c580c02b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:30.009704 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66967e-c000-4061-8ded-d07c580c02b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:30.010240 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66967e-c000-4061-8ded-d07c580c02b3 admin admin] PATH_INFO: `/v3/projects/fef8b35d9b7843e3be275e3045427cac` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:30.011647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66967e-c000-4061-8ded-d07c580c02b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fef8b35d9b7843e3be275e3045427cac)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:30.013916 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66967e-c000-4061-8ded-d07c580c02b3 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:30.017746 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:30.030570 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c1fc8ac6-dc72-4429-8daf-7e0c8318c6bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd445f2ca06f54853beb1bb518ffb41ab'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:30.048839 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1116/2245] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:29 2022] DELETE /identity/v3/users/d445f2ca06f54853beb1bb518ffb41ab => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:30.112801 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-3e66967e-c000-4061-8ded-d07c580c02b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fef8b35d9b7843e3be275e3045427cac', 'request_id': 'req-3e66967e-c000-4061-8ded-d07c580c02b3'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:30.120856 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-3e66967e-c000-4061-8ded-d07c580c02b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fef8b35d9b7843e3be275e3045427cac', 'request_id': 'req-3e66967e-c000-4061-8ded-d07c580c02b3'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:30.142780 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-3e66967e-c000-4061-8ded-d07c580c02b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fef8b35d9b7843e3be275e3045427cac', 'request_id': 'req-3e66967e-c000-4061-8ded-d07c580c02b3'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:30.167054 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc8ac6-dc72-4429-8daf-7e0c8318c6bc admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:30.167193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-3e66967e-c000-4061-8ded-d07c580c02b3 admin admin] The token cache is being invalidate because project fef8b35d9b7843e3be275e3045427cac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:30.167452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-3e66967e-c000-4061-8ded-d07c580c02b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:30.169041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-3e66967e-c000-4061-8ded-d07c580c02b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:30.169952 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c1fc8ac6-dc72-4429-8daf-7e0c8318c6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:30.170943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1130/2246] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:29 2022] DELETE /identity/v3/projects/fef8b35d9b7843e3be275e3045427cac => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:30.174552 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66967e-c000-4061-8ded-d07c580c02b3 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:30.175920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-3e66967e-c000-4061-8ded-d07c580c02b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:30.260416 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66967e-c000-4061-8ded-d07c580c02b3 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:30.270601 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ce1d5-eba0-4306-939c-50be2cd3af0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:30.272207 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ce1d5-eba0-4306-939c-50be2cd3af0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:30.272940 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ce1d5-eba0-4306-939c-50be2cd3af0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:30.273427 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ce1d5-eba0-4306-939c-50be2cd3af0f admin admin] PATH_INFO: `/v3/users/aaf6ec170a7a408c945f11cc235b664e` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:30.274100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc8ac6-dc72-4429-8daf-7e0c8318c6bc admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:30.276111 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ce1d5-eba0-4306-939c-50be2cd3af0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaf6ec170a7a408c945f11cc235b664e)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:30.279054 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc2b94-0c1c-45ab-81c0-c628bddc7be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:30.279521 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ce1d5-eba0-4306-939c-50be2cd3af0f admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:30.280069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc2b94-0c1c-45ab-81c0-c628bddc7be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:30.281033 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc2b94-0c1c-45ab-81c0-c628bddc7be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:30.281033 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc2b94-0c1c-45ab-81c0-c628bddc7be1 admin admin] PATH_INFO: `/v3/users/7c2be925f5dd40faa2fc99d1f289eceb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:30.282814 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc2b94-0c1c-45ab-81c0-c628bddc7be1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c2be925f5dd40faa2fc99d1f289eceb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:30.285974 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc2b94-0c1c-45ab-81c0-c628bddc7be1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:30.363902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d8bc2b94-0c1c-45ab-81c0-c628bddc7be1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c2be925f5dd40faa2fc99d1f289eceb'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:30.377551 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d8bc2b94-0c1c-45ab-81c0-c628bddc7be1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c2be925f5dd40faa2fc99d1f289eceb'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:30.378324 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d8bc2b94-0c1c-45ab-81c0-c628bddc7be1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c2be925f5dd40faa2fc99d1f289eceb'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:30.379810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d8bc2b94-0c1c-45ab-81c0-c628bddc7be1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c2be925f5dd40faa2fc99d1f289eceb'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:30.398337 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-5f4ce1d5-eba0-4306-939c-50be2cd3af0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaf6ec170a7a408c945f11cc235b664e'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:30.405401 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:30.407532 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d8bc2b94-0c1c-45ab-81c0-c628bddc7be1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c2be925f5dd40faa2fc99d1f289eceb'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:30.411679 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-5f4ce1d5-eba0-4306-939c-50be2cd3af0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaf6ec170a7a408c945f11cc235b664e'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:30.429488 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-5f4ce1d5-eba0-4306-939c-50be2cd3af0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaf6ec170a7a408c945f11cc235b664e'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:30.434416 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1117/2247] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:30 2022] DELETE /identity/v3/users/7c2be925f5dd40faa2fc99d1f289eceb => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:30.438534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803012ef-bc44-4b81-8f38-974c60bdc30f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:30.438909 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803012ef-bc44-4b81-8f38-974c60bdc30f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:30.439322 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803012ef-bc44-4b81-8f38-974c60bdc30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:30.453035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-5f4ce1d5-eba0-4306-939c-50be2cd3af0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaf6ec170a7a408c945f11cc235b664e'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:30.455031 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-5f4ce1d5-eba0-4306-939c-50be2cd3af0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaf6ec170a7a408c945f11cc235b664e'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:30.460854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-803012ef-bc44-4b81-8f38-974c60bdc30f None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:30.462039 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-803012ef-bc44-4b81-8f38-974c60bdc30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:30.465509 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1131/2248] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:30 2022] DELETE /identity/v3/users/aaf6ec170a7a408c945f11cc235b664e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:30.582868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1118/2249] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:34:30.603058 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ce1d5-eba0-4306-939c-50be2cd3af0f admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:30.604601 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-5f4ce1d5-eba0-4306-939c-50be2cd3af0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:30.629522 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:30.683376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ce1d5-eba0-4306-939c-50be2cd3af0f admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:30.687465 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3ca26-f259-4bef-8c5a-2afcc0b0ce9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:30.688213 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3ca26-f259-4bef-8c5a-2afcc0b0ce9b service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:30.688716 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3ca26-f259-4bef-8c5a-2afcc0b0ce9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:30.689091 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3ca26-f259-4bef-8c5a-2afcc0b0ce9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:30.724860 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3ca26-f259-4bef-8c5a-2afcc0b0ce9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:30.728816 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3ca26-f259-4bef-8c5a-2afcc0b0ce9b service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:30.744742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1132/2250] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:30.854589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803012ef-bc44-4b81-8f38-974c60bdc30f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:30.856802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-803012ef-bc44-4b81-8f38-974c60bdc30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:30.870857 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803012ef-bc44-4b81-8f38-974c60bdc30f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:30.876010 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a7167-ccf7-494a-b556-e64d549813b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:30.876951 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a7167-ccf7-494a-b556-e64d549813b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:30.877324 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a7167-ccf7-494a-b556-e64d549813b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:30.878156 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a7167-ccf7-494a-b556-e64d549813b9 admin admin] PATH_INFO: `/v3/projects/67e265510e774e4faa7460d42fcf90e4` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:30.879148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a7167-ccf7-494a-b556-e64d549813b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67e265510e774e4faa7460d42fcf90e4)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:30.882158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a7167-ccf7-494a-b556-e64d549813b9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:30.914817 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3ca26-f259-4bef-8c5a-2afcc0b0ce9b service neutron] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:30.916373 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-a7a3ca26-f259-4bef-8c5a-2afcc0b0ce9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:30.932583 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3ca26-f259-4bef-8c5a-2afcc0b0ce9b service neutron] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:30.971654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2f4a7167-ccf7-494a-b556-e64d549813b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67e265510e774e4faa7460d42fcf90e4', 'request_id': 'req-2f4a7167-ccf7-494a-b556-e64d549813b9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:30.975036 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab547e55-5804-448a-804f-af9b7ebabd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:30.981714 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab547e55-5804-448a-804f-af9b7ebabd36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:30.982581 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab547e55-5804-448a-804f-af9b7ebabd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:30.983783 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab547e55-5804-448a-804f-af9b7ebabd36 admin admin] PATH_INFO: `/v3/projects/21df24824ef2413884b83fad3c436763` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:30.984319 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2f4a7167-ccf7-494a-b556-e64d549813b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67e265510e774e4faa7460d42fcf90e4', 'request_id': 'req-2f4a7167-ccf7-494a-b556-e64d549813b9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:30.989747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab547e55-5804-448a-804f-af9b7ebabd36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21df24824ef2413884b83fad3c436763)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:30.995703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2f4a7167-ccf7-494a-b556-e64d549813b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67e265510e774e4faa7460d42fcf90e4', 'request_id': 'req-2f4a7167-ccf7-494a-b556-e64d549813b9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:31.002989 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab547e55-5804-448a-804f-af9b7ebabd36 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:31.027120 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2f4a7167-ccf7-494a-b556-e64d549813b9 admin admin] The token cache is being invalidate because project 67e265510e774e4faa7460d42fcf90e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:31.028556 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2f4a7167-ccf7-494a-b556-e64d549813b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:31.030722 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2f4a7167-ccf7-494a-b556-e64d549813b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:31.039169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1119/2251] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:30 2022] DELETE /identity/v3/projects/67e265510e774e4faa7460d42fcf90e4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:31.040316 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a7167-ccf7-494a-b556-e64d549813b9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:31.044483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2f4a7167-ccf7-494a-b556-e64d549813b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:31.085740 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ab547e55-5804-448a-804f-af9b7ebabd36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21df24824ef2413884b83fad3c436763', 'request_id': 'req-ab547e55-5804-448a-804f-af9b7ebabd36'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:31.094973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ab547e55-5804-448a-804f-af9b7ebabd36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21df24824ef2413884b83fad3c436763', 'request_id': 'req-ab547e55-5804-448a-804f-af9b7ebabd36'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:31.110013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ab547e55-5804-448a-804f-af9b7ebabd36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21df24824ef2413884b83fad3c436763', 'request_id': 'req-ab547e55-5804-448a-804f-af9b7ebabd36'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:31.132592 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ab547e55-5804-448a-804f-af9b7ebabd36 admin admin] The token cache is being invalidate because project 21df24824ef2413884b83fad3c436763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:31.132950 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ab547e55-5804-448a-804f-af9b7ebabd36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:31.133815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ab547e55-5804-448a-804f-af9b7ebabd36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:31.141376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1133/2252] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:30 2022] DELETE /identity/v3/projects/21df24824ef2413884b83fad3c436763 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:31.142877 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158e723-4fe7-4174-bc5b-aafe4a6afa7a None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:31.143182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158e723-4fe7-4174-bc5b-aafe4a6afa7a None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:31.143476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158e723-4fe7-4174-bc5b-aafe4a6afa7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:31.165426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a7167-ccf7-494a-b556-e64d549813b9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:31.169028 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-9158e723-4fe7-4174-bc5b-aafe4a6afa7a None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:31.171142 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-9158e723-4fe7-4174-bc5b-aafe4a6afa7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:31.179759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:31.291044 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1134/2253] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:31.291044 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158e723-4fe7-4174-bc5b-aafe4a6afa7a None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:31.291044 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-9158e723-4fe7-4174-bc5b-aafe4a6afa7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:31.296360 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d44722-f7fb-4d89-b959-2e2e8b1621f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:31.297328 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d44722-f7fb-4d89-b959-2e2e8b1621f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:31.297707 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d44722-f7fb-4d89-b959-2e2e8b1621f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:31.297997 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d44722-f7fb-4d89-b959-2e2e8b1621f6 admin admin] PATH_INFO: `/v3/users/70f40070d1b847ccbd3cdd3283183bd3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:31.299270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d44722-f7fb-4d89-b959-2e2e8b1621f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70f40070d1b847ccbd3cdd3283183bd3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:31.301233 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d44722-f7fb-4d89-b959-2e2e8b1621f6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:31.309460 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158e723-4fe7-4174-bc5b-aafe4a6afa7a None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:31.319430 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0178c2-db11-4908-b953-2d54c35ae392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:31.321644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0178c2-db11-4908-b953-2d54c35ae392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:31.322083 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0178c2-db11-4908-b953-2d54c35ae392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:31.322533 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0178c2-db11-4908-b953-2d54c35ae392 admin admin] PATH_INFO: `/v3/projects/47837e6fac3c455ea30e571931ce7496` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:31.324560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0178c2-db11-4908-b953-2d54c35ae392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47837e6fac3c455ea30e571931ce7496)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:31.327845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0178c2-db11-4908-b953-2d54c35ae392 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:31.369062 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-43d44722-f7fb-4d89-b959-2e2e8b1621f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70f40070d1b847ccbd3cdd3283183bd3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:31.379318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-43d44722-f7fb-4d89-b959-2e2e8b1621f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70f40070d1b847ccbd3cdd3283183bd3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:31.380233 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-43d44722-f7fb-4d89-b959-2e2e8b1621f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70f40070d1b847ccbd3cdd3283183bd3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:31.380548 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:31.381763 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-43d44722-f7fb-4d89-b959-2e2e8b1621f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70f40070d1b847ccbd3cdd3283183bd3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:31.404339 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ce0178c2-db11-4908-b953-2d54c35ae392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47837e6fac3c455ea30e571931ce7496', 'request_id': 'req-ce0178c2-db11-4908-b953-2d54c35ae392'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:31.415656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ce0178c2-db11-4908-b953-2d54c35ae392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47837e6fac3c455ea30e571931ce7496', 'request_id': 'req-ce0178c2-db11-4908-b953-2d54c35ae392'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:31.422576 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-43d44722-f7fb-4d89-b959-2e2e8b1621f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70f40070d1b847ccbd3cdd3283183bd3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:31.425097 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ce0178c2-db11-4908-b953-2d54c35ae392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47837e6fac3c455ea30e571931ce7496', 'request_id': 'req-ce0178c2-db11-4908-b953-2d54c35ae392'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:31.437558 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ce0178c2-db11-4908-b953-2d54c35ae392 admin admin] The token cache is being invalidate because project 47837e6fac3c455ea30e571931ce7496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:31.437858 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ce0178c2-db11-4908-b953-2d54c35ae392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:31.438769 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ce0178c2-db11-4908-b953-2d54c35ae392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:31.440438 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1135/2254] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:31 2022] DELETE /identity/v3/projects/47837e6fac3c455ea30e571931ce7496 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:31.443607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb920dc-2a71-4c21-ba9e-557b74c35097 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:31.444034 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb920dc-2a71-4c21-ba9e-557b74c35097 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:31.444329 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb920dc-2a71-4c21-ba9e-557b74c35097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:31.450711 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1120/2255] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:31 2022] DELETE /identity/v3/users/70f40070d1b847ccbd3cdd3283183bd3 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:31.451821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d44722-f7fb-4d89-b959-2e2e8b1621f6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:31.453410 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-43d44722-f7fb-4d89-b959-2e2e8b1621f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:31.475094 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-3eb920dc-2a71-4c21-ba9e-557b74c35097 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:31.476521 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-3eb920dc-2a71-4c21-ba9e-557b74c35097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:31.553920 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d44722-f7fb-4d89-b959-2e2e8b1621f6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:31.563206 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2b540-cd55-4beb-919a-3f92f263aa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:31.564278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2b540-cd55-4beb-919a-3f92f263aa5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:31.565052 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2b540-cd55-4beb-919a-3f92f263aa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:31.565194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2b540-cd55-4beb-919a-3f92f263aa5d admin admin] PATH_INFO: `/v3/users/1fb0946a635242e59d575559bff332a8` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:31.566695 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2b540-cd55-4beb-919a-3f92f263aa5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fb0946a635242e59d575559bff332a8)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:31.569208 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2b540-cd55-4beb-919a-3f92f263aa5d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:31.591027 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1136/2256] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:31.596930 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb920dc-2a71-4c21-ba9e-557b74c35097 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:31.608986 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb920dc-2a71-4c21-ba9e-557b74c35097 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:31.626089 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bead88-3747-4e7c-a7e1-fc31fd48fdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:31.626831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bead88-3747-4e7c-a7e1-fc31fd48fdde admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:31.627120 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bead88-3747-4e7c-a7e1-fc31fd48fdde admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:31.627401 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bead88-3747-4e7c-a7e1-fc31fd48fdde admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:31.628142 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bead88-3747-4e7c-a7e1-fc31fd48fdde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:31.628613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bead88-3747-4e7c-a7e1-fc31fd48fdde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:31.630066 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bead88-3747-4e7c-a7e1-fc31fd48fdde admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:31.640243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:31.644755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1137/2257] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:31.648330 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-96c2b540-cd55-4beb-919a-3f92f263aa5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fb0946a635242e59d575559bff332a8'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:31.650131 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bead88-3747-4e7c-a7e1-fc31fd48fdde admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:31.660269 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-96c2b540-cd55-4beb-919a-3f92f263aa5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fb0946a635242e59d575559bff332a8'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:31.661011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-96c2b540-cd55-4beb-919a-3f92f263aa5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fb0946a635242e59d575559bff332a8'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:31.661720 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-96c2b540-cd55-4beb-919a-3f92f263aa5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fb0946a635242e59d575559bff332a8'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:31.662403 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bead88-3747-4e7c-a7e1-fc31fd48fdde admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:31.667078 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd5a52-9a31-4453-9bbd-0d284d840437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:31.667740 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd5a52-9a31-4453-9bbd-0d284d840437 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:31.668022 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd5a52-9a31-4453-9bbd-0d284d840437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:31.668311 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd5a52-9a31-4453-9bbd-0d284d840437 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:31.669006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd5a52-9a31-4453-9bbd-0d284d840437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:31.670964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd5a52-9a31-4453-9bbd-0d284d840437 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:31.678740 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-96c2b540-cd55-4beb-919a-3f92f263aa5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fb0946a635242e59d575559bff332a8'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:31.695447 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1121/2258] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:31 2022] DELETE /identity/v3/users/1fb0946a635242e59d575559bff332a8 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:31.709133 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1138/2259] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:31 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:31.709791 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2b540-cd55-4beb-919a-3f92f263aa5d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:31.711845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-96c2b540-cd55-4beb-919a-3f92f263aa5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:31.801452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2b540-cd55-4beb-919a-3f92f263aa5d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:31.901395 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc87919-9740-4610-9674-35f25f15e892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:31.902555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc87919-9740-4610-9674-35f25f15e892 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:31.902860 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc87919-9740-4610-9674-35f25f15e892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:31.903153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc87919-9740-4610-9674-35f25f15e892 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:31.904794 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc87919-9740-4610-9674-35f25f15e892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:31.907817 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc87919-9740-4610-9674-35f25f15e892 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:31.967588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1122/2260] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:31 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:34:31.973370 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd5a52-9a31-4453-9bbd-0d284d840437 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:31.974743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc87919-9740-4610-9674-35f25f15e892 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:31.975251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-80bd5a52-9a31-4453-9bbd-0d284d840437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:31.977263 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5fc87919-9740-4610-9674-35f25f15e892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:31.999333 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd5a52-9a31-4453-9bbd-0d284d840437 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:32.012271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc87919-9740-4610-9674-35f25f15e892 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:32.020399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0695f1-3565-49a2-86f3-05785843b88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:32.022529 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0695f1-3565-49a2-86f3-05785843b88f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.023183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0695f1-3565-49a2-86f3-05785843b88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.023769 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0695f1-3565-49a2-86f3-05785843b88f admin admin] PATH_INFO: `/v3/projects/9ccf0577782b4ea98a9fe4f98f051d69` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.027339 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0695f1-3565-49a2-86f3-05785843b88f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ccf0577782b4ea98a9fe4f98f051d69)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:32.029298 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0695f1-3565-49a2-86f3-05785843b88f admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:32.041834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cc05d-5aaa-43dc-ae3b-d46c0d22fce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:32.042972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cc05d-5aaa-43dc-ae3b-d46c0d22fce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.043382 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cc05d-5aaa-43dc-ae3b-d46c0d22fce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.043913 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cc05d-5aaa-43dc-ae3b-d46c0d22fce1 admin admin] PATH_INFO: `/v3/users/25ec2787a1f740f3ae074ac09aebcfd0` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.046464 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376cc05d-5aaa-43dc-ae3b-d46c0d22fce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25ec2787a1f740f3ae074ac09aebcfd0)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:32.049585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376cc05d-5aaa-43dc-ae3b-d46c0d22fce1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:32.132198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-376cc05d-5aaa-43dc-ae3b-d46c0d22fce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25ec2787a1f740f3ae074ac09aebcfd0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:32.136212 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:DELETE=12,keystone:SELECT=84,keystone:INSERT=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:32.138874 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-eb0695f1-3565-49a2-86f3-05785843b88f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ccf0577782b4ea98a9fe4f98f051d69', 'request_id': 'req-eb0695f1-3565-49a2-86f3-05785843b88f'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:32.147689 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-eb0695f1-3565-49a2-86f3-05785843b88f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ccf0577782b4ea98a9fe4f98f051d69', 'request_id': 'req-eb0695f1-3565-49a2-86f3-05785843b88f'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:32.151350 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-376cc05d-5aaa-43dc-ae3b-d46c0d22fce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25ec2787a1f740f3ae074ac09aebcfd0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:32.152463 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-376cc05d-5aaa-43dc-ae3b-d46c0d22fce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25ec2787a1f740f3ae074ac09aebcfd0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:32.153228 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-376cc05d-5aaa-43dc-ae3b-d46c0d22fce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25ec2787a1f740f3ae074ac09aebcfd0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:32.159760 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-eb0695f1-3565-49a2-86f3-05785843b88f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ccf0577782b4ea98a9fe4f98f051d69', 'request_id': 'req-eb0695f1-3565-49a2-86f3-05785843b88f'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:32.171958 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-376cc05d-5aaa-43dc-ae3b-d46c0d22fce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25ec2787a1f740f3ae074ac09aebcfd0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:32.174183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-eb0695f1-3565-49a2-86f3-05785843b88f admin admin] The token cache is being invalidate because project 9ccf0577782b4ea98a9fe4f98f051d69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:32.174846 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-eb0695f1-3565-49a2-86f3-05785843b88f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:32.175647 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-eb0695f1-3565-49a2-86f3-05785843b88f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:32.177498 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1139/2261] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:31 2022] DELETE /identity/v3/projects/9ccf0577782b4ea98a9fe4f98f051d69 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:32.178340 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0695f1-3565-49a2-86f3-05785843b88f admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:32.179955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-eb0695f1-3565-49a2-86f3-05785843b88f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:32.197861 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:32.203169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1123/2262] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:31 2022] DELETE /identity/v3/users/25ec2787a1f740f3ae074ac09aebcfd0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:32.204139 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cc05d-5aaa-43dc-ae3b-d46c0d22fce1 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:32.205876 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-376cc05d-5aaa-43dc-ae3b-d46c0d22fce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:32.271283 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0695f1-3565-49a2-86f3-05785843b88f admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:32.296032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cc05d-5aaa-43dc-ae3b-d46c0d22fce1 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:32.303377 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cf80b-5dff-4b08-8775-90dd3b4d1b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:32.304257 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cf80b-5dff-4b08-8775-90dd3b4d1b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.304950 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cf80b-5dff-4b08-8775-90dd3b4d1b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.305234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cf80b-5dff-4b08-8775-90dd3b4d1b3d admin admin] PATH_INFO: `/v3/projects/e303f67f83be4cf39a0ea7b30aa7e959` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.306771 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cf80b-5dff-4b08-8775-90dd3b4d1b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e303f67f83be4cf39a0ea7b30aa7e959)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:32.309917 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cf80b-5dff-4b08-8775-90dd3b4d1b3d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:32.341783 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ed095-c80d-425e-a7b5-f422cc843e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:32.342382 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ed095-c80d-425e-a7b5-f422cc843e6a admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.342783 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ed095-c80d-425e-a7b5-f422cc843e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.343071 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ed095-c80d-425e-a7b5-f422cc843e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.347625 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ed095-c80d-425e-a7b5-f422cc843e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:32.354840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ed095-c80d-425e-a7b5-f422cc843e6a admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:32.379935 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1140/2263] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:32.382158 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6d473-05f9-49f1-9727-32c10f769cc6 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.382451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6d473-05f9-49f1-9727-32c10f769cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.383042 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6d473-05f9-49f1-9727-32c10f769cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.394659 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a06cf80b-5dff-4b08-8775-90dd3b4d1b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e303f67f83be4cf39a0ea7b30aa7e959', 'request_id': 'req-a06cf80b-5dff-4b08-8775-90dd3b4d1b3d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:32.405102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-2bb6d473-05f9-49f1-9727-32c10f769cc6 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:32.406297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a06cf80b-5dff-4b08-8775-90dd3b4d1b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e303f67f83be4cf39a0ea7b30aa7e959', 'request_id': 'req-a06cf80b-5dff-4b08-8775-90dd3b4d1b3d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:32.406411 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-2bb6d473-05f9-49f1-9727-32c10f769cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:32.415760 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a06cf80b-5dff-4b08-8775-90dd3b4d1b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e303f67f83be4cf39a0ea7b30aa7e959', 'request_id': 'req-a06cf80b-5dff-4b08-8775-90dd3b4d1b3d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:32.431091 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a06cf80b-5dff-4b08-8775-90dd3b4d1b3d admin admin] The token cache is being invalidate because project e303f67f83be4cf39a0ea7b30aa7e959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:32.431387 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a06cf80b-5dff-4b08-8775-90dd3b4d1b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:32.432651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a06cf80b-5dff-4b08-8775-90dd3b4d1b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:32.433874 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1124/2264] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:32 2022] DELETE /identity/v3/projects/e303f67f83be4cf39a0ea7b30aa7e959 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:32.435097 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c94d4-5a0a-4cee-8164-cb59901dec59 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.435388 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c94d4-5a0a-4cee-8164-cb59901dec59 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.435668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c94d4-5a0a-4cee-8164-cb59901dec59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.455716 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1a6c94d4-5a0a-4cee-8164-cb59901dec59 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:32.456686 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1a6c94d4-5a0a-4cee-8164-cb59901dec59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:32.475156 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1141/2265] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:32.476038 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6d473-05f9-49f1-9727-32c10f769cc6 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:32.477932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-2bb6d473-05f9-49f1-9727-32c10f769cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:32.490699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6d473-05f9-49f1-9727-32c10f769cc6 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:32.495700 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5e12b-c809-47aa-8432-e9b6b91de841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:32.496372 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5e12b-c809-47aa-8432-e9b6b91de841 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.496708 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5e12b-c809-47aa-8432-e9b6b91de841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.497032 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5e12b-c809-47aa-8432-e9b6b91de841 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.497765 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5e12b-c809-47aa-8432-e9b6b91de841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:32.499642 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5e12b-c809-47aa-8432-e9b6b91de841 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:32.509401 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:32.511529 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1142/2266] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:32.512368 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5e12b-c809-47aa-8432-e9b6b91de841 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:32.516032 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-01f5e12b-c809-47aa-8432-e9b6b91de841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:32.530703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1125/2267] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:32.532576 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f8d76-739d-4e29-a9e9-20091340b52a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.532873 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f8d76-739d-4e29-a9e9-20091340b52a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.533151 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f8d76-739d-4e29-a9e9-20091340b52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.535207 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5e12b-c809-47aa-8432-e9b6b91de841 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:32.542185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73282ddf-d6bb-4d2c-87c1-a08ef027f82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:32.543109 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73282ddf-d6bb-4d2c-87c1-a08ef027f82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.543397 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73282ddf-d6bb-4d2c-87c1-a08ef027f82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.543675 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73282ddf-d6bb-4d2c-87c1-a08ef027f82d admin admin] PATH_INFO: `/v3/users/f7ea2f7cebe04a959ebd404bcebc783b` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.544873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73282ddf-d6bb-4d2c-87c1-a08ef027f82d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7ea2f7cebe04a959ebd404bcebc783b)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:32.547249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73282ddf-d6bb-4d2c-87c1-a08ef027f82d admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:32.555970 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-011f8d76-739d-4e29-a9e9-20091340b52a None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:32.557355 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-011f8d76-739d-4e29-a9e9-20091340b52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:32.567697 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1126/2268] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:32.568496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f8d76-739d-4e29-a9e9-20091340b52a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:32.583620 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f8d76-739d-4e29-a9e9-20091340b52a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:32.589029 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75d772-6ecd-4926-8450-bf433144fa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:32.589946 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75d772-6ecd-4926-8450-bf433144fa4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.590240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75d772-6ecd-4926-8450-bf433144fa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.590549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75d772-6ecd-4926-8450-bf433144fa4f admin admin] PATH_INFO: `/v3/projects/0eddacf7370849d9bc823c79d1e2551c/users/fcdfcc6dd70844379383371dabddad7a/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.603595 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:32.610572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75d772-6ecd-4926-8450-bf433144fa4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eddacf7370849d9bc823c79d1e2551c, user_id=fcdfcc6dd70844379383371dabddad7a, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:32.614332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75d772-6ecd-4926-8450-bf433144fa4f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:32.614663 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-73282ddf-d6bb-4d2c-87c1-a08ef027f82d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7ea2f7cebe04a959ebd404bcebc783b'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:32.627101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-73282ddf-d6bb-4d2c-87c1-a08ef027f82d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7ea2f7cebe04a959ebd404bcebc783b'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:32.634775 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1127/2269] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:32 2022] PUT /identity/v3/projects/0eddacf7370849d9bc823c79d1e2551c/users/fcdfcc6dd70844379383371dabddad7a/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:32.635746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75d772-6ecd-4926-8450-bf433144fa4f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:32.645090 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bb75d772-6ecd-4926-8450-bf433144fa4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:32.651565 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-73282ddf-d6bb-4d2c-87c1-a08ef027f82d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7ea2f7cebe04a959ebd404bcebc783b'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:32.662982 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-73282ddf-d6bb-4d2c-87c1-a08ef027f82d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7ea2f7cebe04a959ebd404bcebc783b'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:32.663734 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-73282ddf-d6bb-4d2c-87c1-a08ef027f82d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7ea2f7cebe04a959ebd404bcebc783b'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:32.673052 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1143/2270] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:32 2022] DELETE /identity/v3/users/f7ea2f7cebe04a959ebd404bcebc783b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:32.674255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73282ddf-d6bb-4d2c-87c1-a08ef027f82d admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:32.676468 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-73282ddf-d6bb-4d2c-87c1-a08ef027f82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:32.727925 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75d772-6ecd-4926-8450-bf433144fa4f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:32.776832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73282ddf-d6bb-4d2c-87c1-a08ef027f82d admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:32.791397 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f31b1-b038-4c89-b1ea-d1cbc2377dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:32.791397 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f31b1-b038-4c89-b1ea-d1cbc2377dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.791397 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f31b1-b038-4c89-b1ea-d1cbc2377dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.791397 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f31b1-b038-4c89-b1ea-d1cbc2377dd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.791765 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f31b1-b038-4c89-b1ea-d1cbc2377dd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:32.791765 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f31b1-b038-4c89-b1ea-d1cbc2377dd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:32.791765 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f31b1-b038-4c89-b1ea-d1cbc2377dd8 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:32.803014 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1144/2271] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:32.804511 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47568a3-dbfb-4b43-8b15-3dfcbbdc5482 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.804941 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47568a3-dbfb-4b43-8b15-3dfcbbdc5482 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.805297 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47568a3-dbfb-4b43-8b15-3dfcbbdc5482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.820923 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfa074-e9c8-4066-9a2b-94dd81363d04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:32.822049 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfa074-e9c8-4066-9a2b-94dd81363d04 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.822675 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfa074-e9c8-4066-9a2b-94dd81363d04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.823290 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfa074-e9c8-4066-9a2b-94dd81363d04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.825880 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d5bfa074-e9c8-4066-9a2b-94dd81363d04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:32.838344 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-d47568a3-dbfb-4b43-8b15-3dfcbbdc5482 None None] MFA Rules not processed for user `fcdfcc6dd70844379383371dabddad7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:32.840030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-d47568a3-dbfb-4b43-8b15-3dfcbbdc5482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:32.842442 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfa074-e9c8-4066-9a2b-94dd81363d04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:32.844968 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfa074-e9c8-4066-9a2b-94dd81363d04 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:32.867206 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1128/2272] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:32.868319 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfa074-e9c8-4066-9a2b-94dd81363d04 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:32.885002 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfa074-e9c8-4066-9a2b-94dd81363d04 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:32.912747 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872ea15-f2ef-4cbe-bdb2-f2ff16896f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:32.913540 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872ea15-f2ef-4cbe-bdb2-f2ff16896f88 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:32.914763 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872ea15-f2ef-4cbe-bdb2-f2ff16896f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:32.915579 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872ea15-f2ef-4cbe-bdb2-f2ff16896f88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:32.916518 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872ea15-f2ef-4cbe-bdb2-f2ff16896f88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:32.920183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872ea15-f2ef-4cbe-bdb2-f2ff16896f88 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:32.940376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1145/2273] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:32.956180 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47568a3-dbfb-4b43-8b15-3dfcbbdc5482 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:32.958332 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-d47568a3-dbfb-4b43-8b15-3dfcbbdc5482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:32.974700 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1129/2274] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:32 2022] POST /identity/v3/projects => generated 391 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:32.976089 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872ea15-f2ef-4cbe-bdb2-f2ff16896f88 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:33.029507 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:33.064701 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47568a3-dbfb-4b43-8b15-3dfcbbdc5482 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:33.074817 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872ea15-f2ef-4cbe-bdb2-f2ff16896f88 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:33.094973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3283f61-cb4d-43d8-8c89-c6491fcddee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:33.095767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3283f61-cb4d-43d8-8c89-c6491fcddee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:33.098269 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3283f61-cb4d-43d8-8c89-c6491fcddee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:33.099132 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3283f61-cb4d-43d8-8c89-c6491fcddee3 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:33.100066 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3283f61-cb4d-43d8-8c89-c6491fcddee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:33.103325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3283f61-cb4d-43d8-8c89-c6491fcddee3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:33.123803 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:33.150555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1130/2275] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:32 2022] POST /identity/v3/users => generated 296 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:33.154772 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3283f61-cb4d-43d8-8c89-c6491fcddee3 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:33.155228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65e964-f25a-4dd7-95b6-f9cc9c1d790d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:33.156523 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65e964-f25a-4dd7-95b6-f9cc9c1d790d service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:33.156523 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65e964-f25a-4dd7-95b6-f9cc9c1d790d service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:33.156677 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65e964-f25a-4dd7-95b6-f9cc9c1d790d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:33.170001 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3283f61-cb4d-43d8-8c89-c6491fcddee3 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:33.177322 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd282e91-7d5a-45c7-9e60-5f6fdf0ab173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:33.178009 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd282e91-7d5a-45c7-9e60-5f6fdf0ab173 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:33.178296 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd282e91-7d5a-45c7-9e60-5f6fdf0ab173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:33.179295 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd282e91-7d5a-45c7-9e60-5f6fdf0ab173 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:33.180099 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd282e91-7d5a-45c7-9e60-5f6fdf0ab173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:33.188546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd282e91-7d5a-45c7-9e60-5f6fdf0ab173 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:33.206768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1131/2276] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:33.212185 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd282e91-7d5a-45c7-9e60-5f6fdf0ab173 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:33.228324 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd282e91-7d5a-45c7-9e60-5f6fdf0ab173 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:33.235524 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e5753-5d02-4f33-9941-41a532bc8ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:33.236214 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e5753-5d02-4f33-9941-41a532bc8ebb admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:33.236672 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e5753-5d02-4f33-9941-41a532bc8ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:33.236786 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e5753-5d02-4f33-9941-41a532bc8ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:33.237516 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e5753-5d02-4f33-9941-41a532bc8ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:33.239862 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e5753-5d02-4f33-9941-41a532bc8ebb admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:33.257770 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1132/2277] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:34:33.260073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e5753-5d02-4f33-9941-41a532bc8ebb admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:33.275187 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e5753-5d02-4f33-9941-41a532bc8ebb admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:33.281363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625c512-ce44-441f-bcd1-10476dcb1318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:33.282279 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625c512-ce44-441f-bcd1-10476dcb1318 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:33.282839 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625c512-ce44-441f-bcd1-10476dcb1318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:33.283263 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625c512-ce44-441f-bcd1-10476dcb1318 admin admin] PATH_INFO: `/v3/projects/23d85c1f1e6648f0a94d1209055ad920/users/ba248b57c28a4d8ba0846bd6b12074d7/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:33.293365 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65e964-f25a-4dd7-95b6-f9cc9c1d790d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:33.297744 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65e964-f25a-4dd7-95b6-f9cc9c1d790d service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:33.304042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625c512-ce44-441f-bcd1-10476dcb1318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d85c1f1e6648f0a94d1209055ad920, user_id=ba248b57c28a4d8ba0846bd6b12074d7, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:33.308112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625c512-ce44-441f-bcd1-10476dcb1318 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:33.314802 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1146/2278] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:33.328979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1133/2279] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:33 2022] PUT /identity/v3/projects/23d85c1f1e6648f0a94d1209055ad920/users/ba248b57c28a4d8ba0846bd6b12074d7/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:33.339843 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c2791-5c75-4f70-9213-cee6e86e8159 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:33.340151 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c2791-5c75-4f70-9213-cee6e86e8159 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:33.340426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c2791-5c75-4f70-9213-cee6e86e8159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:33.380808 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-ad1c2791-5c75-4f70-9213-cee6e86e8159 None None] MFA Rules not processed for user `ba248b57c28a4d8ba0846bd6b12074d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:33.382313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ad1c2791-5c75-4f70-9213-cee6e86e8159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:33.504485 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1147/2280] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:33.568725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625c512-ce44-441f-bcd1-10476dcb1318 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:33.571382 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5625c512-ce44-441f-bcd1-10476dcb1318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:33.656943 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625c512-ce44-441f-bcd1-10476dcb1318 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:33.667645 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e2f3d-5145-445a-b243-0cb7833be3dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:33.668592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e2f3d-5145-445a-b243-0cb7833be3dd service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:33.669029 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e2f3d-5145-445a-b243-0cb7833be3dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:33.669469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e2f3d-5145-445a-b243-0cb7833be3dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:33.681454 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c2791-5c75-4f70-9213-cee6e86e8159 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:33.683649 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ad1c2791-5c75-4f70-9213-cee6e86e8159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:33.685535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e2f3d-5145-445a-b243-0cb7833be3dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:33.687592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e2f3d-5145-445a-b243-0cb7833be3dd service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:33.701600 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1134/2281] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:33.728857 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e2f3d-5145-445a-b243-0cb7833be3dd service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:33.730229 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-717e2f3d-5145-445a-b243-0cb7833be3dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:33.768870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:33.815393 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c2791-5c75-4f70-9213-cee6e86e8159 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:33.826250 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909604e-9e5b-430f-a211-274c797104d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:33.827799 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909604e-9e5b-430f-a211-274c797104d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:33.828090 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909604e-9e5b-430f-a211-274c797104d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:33.830746 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909604e-9e5b-430f-a211-274c797104d3 admin admin] PATH_INFO: `/v3/projects/5413ab7ee4a54d93a0f35d1ae572d7df` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:33.833140 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909604e-9e5b-430f-a211-274c797104d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5413ab7ee4a54d93a0f35d1ae572d7df)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:33.836885 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909604e-9e5b-430f-a211-274c797104d3 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:33.853695 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e2f3d-5145-445a-b243-0cb7833be3dd service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:33.858986 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e6a22-f320-49eb-b9ca-39b7f69b4d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:33.860176 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6a22-f320-49eb-b9ca-39b7f69b4d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:33.860506 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6a22-f320-49eb-b9ca-39b7f69b4d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:33.860812 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6a22-f320-49eb-b9ca-39b7f69b4d60 admin admin] PATH_INFO: `/v3/projects/7b4dbac4f6d84e698c1d3b40f1639365` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:33.862326 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e6a22-f320-49eb-b9ca-39b7f69b4d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b4dbac4f6d84e698c1d3b40f1639365)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:33.864350 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e6a22-f320-49eb-b9ca-39b7f69b4d60 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:33.893000 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9909604e-9e5b-430f-a211-274c797104d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5413ab7ee4a54d93a0f35d1ae572d7df', 'request_id': 'req-9909604e-9e5b-430f-a211-274c797104d3'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:33.901228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9909604e-9e5b-430f-a211-274c797104d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5413ab7ee4a54d93a0f35d1ae572d7df', 'request_id': 'req-9909604e-9e5b-430f-a211-274c797104d3'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:33.911015 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9909604e-9e5b-430f-a211-274c797104d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5413ab7ee4a54d93a0f35d1ae572d7df', 'request_id': 'req-9909604e-9e5b-430f-a211-274c797104d3'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:33.924182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9909604e-9e5b-430f-a211-274c797104d3 admin admin] The token cache is being invalidate because project 5413ab7ee4a54d93a0f35d1ae572d7df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:33.924446 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3d9e6a22-f320-49eb-b9ca-39b7f69b4d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b4dbac4f6d84e698c1d3b40f1639365', 'request_id': 'req-3d9e6a22-f320-49eb-b9ca-39b7f69b4d60'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:33.924959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9909604e-9e5b-430f-a211-274c797104d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:33.925245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9909604e-9e5b-430f-a211-274c797104d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:33.925868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:33.926958 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1148/2282] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:33 2022] DELETE /identity/v3/projects/5413ab7ee4a54d93a0f35d1ae572d7df => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:33.933603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eb6e1-7278-4fef-832e-e9635c5b2762 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:33.933729 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eb6e1-7278-4fef-832e-e9635c5b2762 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:33.933973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3d9e6a22-f320-49eb-b9ca-39b7f69b4d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b4dbac4f6d84e698c1d3b40f1639365', 'request_id': 'req-3d9e6a22-f320-49eb-b9ca-39b7f69b4d60'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:33.934089 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eb6e1-7278-4fef-832e-e9635c5b2762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:33.940463 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3d9e6a22-f320-49eb-b9ca-39b7f69b4d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b4dbac4f6d84e698c1d3b40f1639365', 'request_id': 'req-3d9e6a22-f320-49eb-b9ca-39b7f69b4d60'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:33.954303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3d9e6a22-f320-49eb-b9ca-39b7f69b4d60 admin admin] The token cache is being invalidate because project 7b4dbac4f6d84e698c1d3b40f1639365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:33.954883 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3d9e6a22-f320-49eb-b9ca-39b7f69b4d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:33.955788 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3d9e6a22-f320-49eb-b9ca-39b7f69b4d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:33.956010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-d20eb6e1-7278-4fef-832e-e9635c5b2762 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:33.957232 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-d20eb6e1-7278-4fef-832e-e9635c5b2762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:33.962059 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1135/2283] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:33 2022] DELETE /identity/v3/projects/7b4dbac4f6d84e698c1d3b40f1639365 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:33.963121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e6a22-f320-49eb-b9ca-39b7f69b4d60 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:33.964781 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3d9e6a22-f320-49eb-b9ca-39b7f69b4d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:34.037671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1149/2284] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:34:34.046268 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccf386-817f-46ad-8a42-3562b05d244a None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:34.046614 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccf386-817f-46ad-8a42-3562b05d244a None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:34.046956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccf386-817f-46ad-8a42-3562b05d244a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:34.071313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-ecccf386-817f-46ad-8a42-3562b05d244a None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:34.072669 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ecccf386-817f-46ad-8a42-3562b05d244a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:34.073833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e6a22-f320-49eb-b9ca-39b7f69b4d60 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:34.079368 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48999d74-e722-4562-b7b2-2f1ca7ef65d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:34.080283 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48999d74-e722-4562-b7b2-2f1ca7ef65d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:34.080572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48999d74-e722-4562-b7b2-2f1ca7ef65d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:34.080878 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48999d74-e722-4562-b7b2-2f1ca7ef65d0 admin admin] PATH_INFO: `/v3/users/8c7d651f18784768a11dbae6b3128c75` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:34.082443 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48999d74-e722-4562-b7b2-2f1ca7ef65d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c7d651f18784768a11dbae6b3128c75)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:34.084944 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48999d74-e722-4562-b7b2-2f1ca7ef65d0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:34.091156 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1150/2285] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:34.095759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccf386-817f-46ad-8a42-3562b05d244a None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:34.107568 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccf386-817f-46ad-8a42-3562b05d244a None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:34.113845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13385c30-c965-40eb-8cfb-75b733bb28c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:34.114879 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13385c30-c965-40eb-8cfb-75b733bb28c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:34.115363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13385c30-c965-40eb-8cfb-75b733bb28c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:34.115803 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13385c30-c965-40eb-8cfb-75b733bb28c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:34.116629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13385c30-c965-40eb-8cfb-75b733bb28c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:34.117024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13385c30-c965-40eb-8cfb-75b733bb28c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:34.118930 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13385c30-c965-40eb-8cfb-75b733bb28c9 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:34.138990 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1151/2286] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:34.140642 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13385c30-c965-40eb-8cfb-75b733bb28c9 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:34.152874 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13385c30-c965-40eb-8cfb-75b733bb28c9 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:34.157603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662f39a-5d4e-40af-b04b-8951ebfe87d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:34.158266 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662f39a-5d4e-40af-b04b-8951ebfe87d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:34.158585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662f39a-5d4e-40af-b04b-8951ebfe87d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:34.158867 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662f39a-5d4e-40af-b04b-8951ebfe87d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:34.159559 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662f39a-5d4e-40af-b04b-8951ebfe87d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:34.160483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-48999d74-e722-4562-b7b2-2f1ca7ef65d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c7d651f18784768a11dbae6b3128c75'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:34.161522 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662f39a-5d4e-40af-b04b-8951ebfe87d4 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:34.171206 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-48999d74-e722-4562-b7b2-2f1ca7ef65d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c7d651f18784768a11dbae6b3128c75'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:34.171868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-48999d74-e722-4562-b7b2-2f1ca7ef65d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c7d651f18784768a11dbae6b3128c75'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:34.172497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-48999d74-e722-4562-b7b2-2f1ca7ef65d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c7d651f18784768a11dbae6b3128c75'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:34.187952 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-48999d74-e722-4562-b7b2-2f1ca7ef65d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c7d651f18784768a11dbae6b3128c75'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:34.198923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1152/2287] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:34 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:34:34.200681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662f39a-5d4e-40af-b04b-8951ebfe87d4 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:34.201879 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-1662f39a-5d4e-40af-b04b-8951ebfe87d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:34.209159 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1136/2288] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:33 2022] DELETE /identity/v3/users/8c7d651f18784768a11dbae6b3128c75 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:34.235551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:34.280793 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662f39a-5d4e-40af-b04b-8951ebfe87d4 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:34.346833 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f0810-866b-4226-97d2-f8887374763d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:34.347657 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f0810-866b-4226-97d2-f8887374763d admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:34.347962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f0810-866b-4226-97d2-f8887374763d admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:34.348386 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f0810-866b-4226-97d2-f8887374763d admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:34.349422 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f0810-866b-4226-97d2-f8887374763d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:34.351378 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f0810-866b-4226-97d2-f8887374763d admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:34.385386 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1153/2289] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:34 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:34:34.390020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48999d74-e722-4562-b7b2-2f1ca7ef65d0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:34.401263 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48999d74-e722-4562-b7b2-2f1ca7ef65d0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:34.407129 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9ea65-e0b3-4c18-ade6-f61a1116eb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:34.407738 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9ea65-e0b3-4c18-ade6-f61a1116eb04 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:34.408021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9ea65-e0b3-4c18-ade6-f61a1116eb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:34.408297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9ea65-e0b3-4c18-ade6-f61a1116eb04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:34.409033 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9ea65-e0b3-4c18-ade6-f61a1116eb04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:34.410709 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9ea65-e0b3-4c18-ade6-f61a1116eb04 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:34.422734 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1137/2290] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:34.427061 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f0810-866b-4226-97d2-f8887374763d admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:34.437544 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f0810-866b-4226-97d2-f8887374763d admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:34.443279 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473cedb-075b-4f69-8396-4da8cd7e571d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:34.444157 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473cedb-075b-4f69-8396-4da8cd7e571d admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:34.444855 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473cedb-075b-4f69-8396-4da8cd7e571d admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:34.444855 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473cedb-075b-4f69-8396-4da8cd7e571d admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:34.446371 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473cedb-075b-4f69-8396-4da8cd7e571d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:34.448698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473cedb-075b-4f69-8396-4da8cd7e571d admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:34.463369 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1154/2291] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:34.464610 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9ea65-e0b3-4c18-ade6-f61a1116eb04 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:34.475233 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9ea65-e0b3-4c18-ade6-f61a1116eb04 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:34.482392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1cd91-e6b9-4802-9cad-1e4ff76f1909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:34.483455 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1cd91-e6b9-4802-9cad-1e4ff76f1909 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:34.484067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1cd91-e6b9-4802-9cad-1e4ff76f1909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:34.484460 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1cd91-e6b9-4802-9cad-1e4ff76f1909 admin admin] PATH_INFO: `/v3/projects/8950a9dada1a43bba4ff975afee5ffa4/users/93795b1ff7de4730b39a4cb0899ce5c0/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:34.504580 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1cd91-e6b9-4802-9cad-1e4ff76f1909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8950a9dada1a43bba4ff975afee5ffa4, user_id=93795b1ff7de4730b39a4cb0899ce5c0, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:34.505664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473cedb-075b-4f69-8396-4da8cd7e571d admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:34.506046 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1cd91-e6b9-4802-9cad-1e4ff76f1909 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:34.507536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-d473cedb-075b-4f69-8396-4da8cd7e571d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:34.526273 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473cedb-075b-4f69-8396-4da8cd7e571d admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:34.537456 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1138/2292] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:34 2022] PUT /identity/v3/projects/8950a9dada1a43bba4ff975afee5ffa4/users/93795b1ff7de4730b39a4cb0899ce5c0/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:34.539566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81dcb5-4086-4338-8de5-35f347fa8df8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:34.539936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81dcb5-4086-4338-8de5-35f347fa8df8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:34.540445 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81dcb5-4086-4338-8de5-35f347fa8df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:34.572846 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ee81dcb5-4086-4338-8de5-35f347fa8df8 None None] MFA Rules not processed for user `93795b1ff7de4730b39a4cb0899ce5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:34.574244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ee81dcb5-4086-4338-8de5-35f347fa8df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:34.586760 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:34.605611 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3becdde-2942-4a95-9ccd-400f6e075753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:34.606818 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3becdde-2942-4a95-9ccd-400f6e075753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:34.607102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3becdde-2942-4a95-9ccd-400f6e075753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:34.607377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3becdde-2942-4a95-9ccd-400f6e075753 admin admin] PATH_INFO: `/v3/projects/de12103039d540ebb4ce07bca0f3de6d` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:34.608620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3becdde-2942-4a95-9ccd-400f6e075753 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de12103039d540ebb4ce07bca0f3de6d)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:34.611109 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3becdde-2942-4a95-9ccd-400f6e075753 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:34.666208 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1139/2293] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:34.677681 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81dcb5-4086-4338-8de5-35f347fa8df8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:34.680123 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ee81dcb5-4086-4338-8de5-35f347fa8df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:34.682546 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-e3becdde-2942-4a95-9ccd-400f6e075753 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de12103039d540ebb4ce07bca0f3de6d', 'request_id': 'req-e3becdde-2942-4a95-9ccd-400f6e075753'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:34.690651 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-e3becdde-2942-4a95-9ccd-400f6e075753 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de12103039d540ebb4ce07bca0f3de6d', 'request_id': 'req-e3becdde-2942-4a95-9ccd-400f6e075753'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:34.694943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:34.705074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-e3becdde-2942-4a95-9ccd-400f6e075753 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de12103039d540ebb4ce07bca0f3de6d', 'request_id': 'req-e3becdde-2942-4a95-9ccd-400f6e075753'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:34.719224 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-e3becdde-2942-4a95-9ccd-400f6e075753 admin admin] The token cache is being invalidate because project de12103039d540ebb4ce07bca0f3de6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:34.719638 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-e3becdde-2942-4a95-9ccd-400f6e075753 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:34.720714 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-e3becdde-2942-4a95-9ccd-400f6e075753 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:34.722447 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1155/2294] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:34 2022] DELETE /identity/v3/projects/de12103039d540ebb4ce07bca0f3de6d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:34.726760 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3becdde-2942-4a95-9ccd-400f6e075753 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:34.729960 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e3becdde-2942-4a95-9ccd-400f6e075753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:34.789195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81dcb5-4086-4338-8de5-35f347fa8df8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:34.839955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3becdde-2942-4a95-9ccd-400f6e075753 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:34.855295 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2edf4-8e4a-4a3c-8fdc-c135cdad26f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:34.856083 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2edf4-8e4a-4a3c-8fdc-c135cdad26f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:34.856277 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40da0b5-f222-40c0-ab73-d4e473606c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:34.856408 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2edf4-8e4a-4a3c-8fdc-c135cdad26f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:34.857344 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2edf4-8e4a-4a3c-8fdc-c135cdad26f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:34.859304 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40da0b5-f222-40c0-ab73-d4e473606c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:34.859601 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40da0b5-f222-40c0-ab73-d4e473606c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:34.859893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40da0b5-f222-40c0-ab73-d4e473606c50 admin admin] PATH_INFO: `/v3/users/7e090048e505481eaf0e6a77daec4ab9` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:34.860380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e5b2edf4-8e4a-4a3c-8fdc-c135cdad26f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:34.862175 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40da0b5-f222-40c0-ab73-d4e473606c50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e090048e505481eaf0e6a77daec4ab9)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:34.870583 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40da0b5-f222-40c0-ab73-d4e473606c50 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:34.947114 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2edf4-8e4a-4a3c-8fdc-c135cdad26f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:34.948825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2edf4-8e4a-4a3c-8fdc-c135cdad26f3 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:34.963228 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1140/2295] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:35.002734 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-c40da0b5-f222-40c0-ab73-d4e473606c50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e090048e505481eaf0e6a77daec4ab9'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:35.017833 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-c40da0b5-f222-40c0-ab73-d4e473606c50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e090048e505481eaf0e6a77daec4ab9'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:35.035269 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-c40da0b5-f222-40c0-ab73-d4e473606c50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e090048e505481eaf0e6a77daec4ab9'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:35.045840 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-c40da0b5-f222-40c0-ab73-d4e473606c50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e090048e505481eaf0e6a77daec4ab9'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:35.046494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-c40da0b5-f222-40c0-ab73-d4e473606c50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e090048e505481eaf0e6a77daec4ab9'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:35.053644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1156/2296] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:34 2022] DELETE /identity/v3/users/7e090048e505481eaf0e6a77daec4ab9 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:35.481651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2edf4-8e4a-4a3c-8fdc-c135cdad26f3 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:35.498699 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2edf4-8e4a-4a3c-8fdc-c135cdad26f3 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:35.545187 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:35.628181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01819e5-8168-4585-99d1-d400b545cf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:35.629080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01819e5-8168-4585-99d1-d400b545cf0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:35.629655 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01819e5-8168-4585-99d1-d400b545cf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:35.629888 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01819e5-8168-4585-99d1-d400b545cf0d admin admin] PATH_INFO: `/v3/projects/a28318fb74b44d06a03a6cc4498fa1b4` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:35.631349 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01819e5-8168-4585-99d1-d400b545cf0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a28318fb74b44d06a03a6cc4498fa1b4)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:35.633687 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01819e5-8168-4585-99d1-d400b545cf0d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:35.704320 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d01819e5-8168-4585-99d1-d400b545cf0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a28318fb74b44d06a03a6cc4498fa1b4', 'request_id': 'req-d01819e5-8168-4585-99d1-d400b545cf0d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:35.711482 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d01819e5-8168-4585-99d1-d400b545cf0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a28318fb74b44d06a03a6cc4498fa1b4', 'request_id': 'req-d01819e5-8168-4585-99d1-d400b545cf0d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:35.717264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d01819e5-8168-4585-99d1-d400b545cf0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a28318fb74b44d06a03a6cc4498fa1b4', 'request_id': 'req-d01819e5-8168-4585-99d1-d400b545cf0d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:35.732418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d01819e5-8168-4585-99d1-d400b545cf0d admin admin] The token cache is being invalidate because project a28318fb74b44d06a03a6cc4498fa1b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:35.732708 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d01819e5-8168-4585-99d1-d400b545cf0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:35.733366 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d01819e5-8168-4585-99d1-d400b545cf0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:35.734973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1141/2297] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:35 2022] DELETE /identity/v3/projects/a28318fb74b44d06a03a6cc4498fa1b4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:35.739933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83c353-e4b3-4973-b9a1-9c19a5e090ce None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:35.740296 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83c353-e4b3-4973-b9a1-9c19a5e090ce None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:35.740663 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83c353-e4b3-4973-b9a1-9c19a5e090ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:35.761292 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-6a83c353-e4b3-4973-b9a1-9c19a5e090ce None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:35.762812 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-6a83c353-e4b3-4973-b9a1-9c19a5e090ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:35.827984 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1157/2298] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:35.836264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bd13c-9178-496f-9291-9e3ac76837df None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:35.836615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bd13c-9178-496f-9291-9e3ac76837df None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:35.836892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bd13c-9178-496f-9291-9e3ac76837df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:35.857187 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-df4bd13c-9178-496f-9291-9e3ac76837df None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:35.859106 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-df4bd13c-9178-496f-9291-9e3ac76837df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:35.866819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1142/2299] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:35.871697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83c353-e4b3-4973-b9a1-9c19a5e090ce None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:35.876589 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:35.882601 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83c353-e4b3-4973-b9a1-9c19a5e090ce None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:35.888244 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad0b44-1074-4453-9762-6403769a0b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:35.888907 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad0b44-1074-4453-9762-6403769a0b8f admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:35.889225 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad0b44-1074-4453-9762-6403769a0b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:35.889502 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad0b44-1074-4453-9762-6403769a0b8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:35.890240 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad0b44-1074-4453-9762-6403769a0b8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:35.890576 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad0b44-1074-4453-9762-6403769a0b8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:35.892205 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad0b44-1074-4453-9762-6403769a0b8f admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:35.905148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1158/2300] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:35.910139 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bd13c-9178-496f-9291-9e3ac76837df None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:35.920059 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bd13c-9178-496f-9291-9e3ac76837df None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:35.924829 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266de263-8c07-48d7-9d41-344f491f60b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:35.925480 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266de263-8c07-48d7-9d41-344f491f60b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:35.925841 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266de263-8c07-48d7-9d41-344f491f60b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:35.926206 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266de263-8c07-48d7-9d41-344f491f60b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:35.927517 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266de263-8c07-48d7-9d41-344f491f60b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:35.931410 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266de263-8c07-48d7-9d41-344f491f60b4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:35.961674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1143/2301] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:35 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:35.965719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad0b44-1074-4453-9762-6403769a0b8f admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:35.975878 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad0b44-1074-4453-9762-6403769a0b8f admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:36.034287 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb7bdb-a9eb-465b-9bb9-840bd0676fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:36.034985 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb7bdb-a9eb-465b-9bb9-840bd0676fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:36.035272 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb7bdb-a9eb-465b-9bb9-840bd0676fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:36.035730 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb7bdb-a9eb-465b-9bb9-840bd0676fb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:36.036841 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb7bdb-a9eb-465b-9bb9-840bd0676fb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:36.038328 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb7bdb-a9eb-465b-9bb9-840bd0676fb2 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:36.066549 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1159/2302] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:35 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:34:36.068095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266de263-8c07-48d7-9d41-344f491f60b4 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:36.079669 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266de263-8c07-48d7-9d41-344f491f60b4 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:36.084667 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4454e-b341-482d-b901-bc53b7c1ec11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:36.085438 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4454e-b341-482d-b901-bc53b7c1ec11 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:36.086323 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4454e-b341-482d-b901-bc53b7c1ec11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:36.086711 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4454e-b341-482d-b901-bc53b7c1ec11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:36.087516 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4454e-b341-482d-b901-bc53b7c1ec11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:36.089322 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4454e-b341-482d-b901-bc53b7c1ec11 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:36.105914 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1144/2303] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:36.110098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb7bdb-a9eb-465b-9bb9-840bd0676fb2 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:36.124061 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb7bdb-a9eb-465b-9bb9-840bd0676fb2 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:36.130278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab831f7-67b3-4def-bf9e-b21a0c127205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:36.131070 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab831f7-67b3-4def-bf9e-b21a0c127205 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:36.131430 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab831f7-67b3-4def-bf9e-b21a0c127205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:36.131785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab831f7-67b3-4def-bf9e-b21a0c127205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:36.132613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab831f7-67b3-4def-bf9e-b21a0c127205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:36.134570 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab831f7-67b3-4def-bf9e-b21a0c127205 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:36.150623 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1160/2304] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:36.151312 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4454e-b341-482d-b901-bc53b7c1ec11 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:36.161998 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4454e-b341-482d-b901-bc53b7c1ec11 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:36.182365 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e4573-75ae-4f51-90b6-9b8bd4745b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:36.183531 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e4573-75ae-4f51-90b6-9b8bd4745b39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:36.183921 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e4573-75ae-4f51-90b6-9b8bd4745b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:36.184304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e4573-75ae-4f51-90b6-9b8bd4745b39 admin admin] PATH_INFO: `/v3/projects/a9b8b0f78ca5462a9cfeb1adc024a1ff/users/d253db77e564406d97532238ca4b2d04/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:36.207024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e4573-75ae-4f51-90b6-9b8bd4745b39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b8b0f78ca5462a9cfeb1adc024a1ff, user_id=d253db77e564406d97532238ca4b2d04, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:36.209386 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e4573-75ae-4f51-90b6-9b8bd4745b39 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:36.231665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1145/2305] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:36 2022] PUT /identity/v3/projects/a9b8b0f78ca5462a9cfeb1adc024a1ff/users/d253db77e564406d97532238ca4b2d04/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:36.242623 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636675c-8138-48a8-bbf9-788eb8dcf1d5 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:36.243038 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636675c-8138-48a8-bbf9-788eb8dcf1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:36.243359 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636675c-8138-48a8-bbf9-788eb8dcf1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:36.271196 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-3636675c-8138-48a8-bbf9-788eb8dcf1d5 None None] MFA Rules not processed for user `d253db77e564406d97532238ca4b2d04`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:36.272539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-3636675c-8138-48a8-bbf9-788eb8dcf1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:36.354236 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1161/2306] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:36.363072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e4573-75ae-4f51-90b6-9b8bd4745b39 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:36.365335 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8f5e4573-75ae-4f51-90b6-9b8bd4745b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:36.424139 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:36.428276 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e4573-75ae-4f51-90b6-9b8bd4745b39 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:36.432974 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f2e3f-3691-472d-8096-c3439ccfa5d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ed824e419544b33a2c4413da4b45aaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:36.433809 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f2e3f-3691-472d-8096-c3439ccfa5d0 service glance] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:36.434281 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f2e3f-3691-472d-8096-c3439ccfa5d0 service glance] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:36.434783 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f2e3f-3691-472d-8096-c3439ccfa5d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:36.444638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f2e3f-3691-472d-8096-c3439ccfa5d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:36.446978 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f2e3f-3691-472d-8096-c3439ccfa5d0 service glance] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:36.456631 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1146/2307] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:39.455000 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636675c-8138-48a8-bbf9-788eb8dcf1d5 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:39.456542 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-3636675c-8138-48a8-bbf9-788eb8dcf1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:39.526028 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:39.530689 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636675c-8138-48a8-bbf9-788eb8dcf1d5 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:39.536198 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef31d9-d28a-43a9-8ae0-bed66dfbaa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:39.537067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef31d9-d28a-43a9-8ae0-bed66dfbaa8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:39.537358 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef31d9-d28a-43a9-8ae0-bed66dfbaa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:39.537632 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef31d9-d28a-43a9-8ae0-bed66dfbaa8f admin admin] PATH_INFO: `/v3/users/fcdfcc6dd70844379383371dabddad7a` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:39.538859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef31d9-d28a-43a9-8ae0-bed66dfbaa8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcdfcc6dd70844379383371dabddad7a)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:39.540782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef31d9-d28a-43a9-8ae0-bed66dfbaa8f admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:39.595837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d8ef31d9-d28a-43a9-8ae0-bed66dfbaa8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcdfcc6dd70844379383371dabddad7a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:39.604227 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d8ef31d9-d28a-43a9-8ae0-bed66dfbaa8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcdfcc6dd70844379383371dabddad7a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:39.618725 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d8ef31d9-d28a-43a9-8ae0-bed66dfbaa8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcdfcc6dd70844379383371dabddad7a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:39.626347 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d8ef31d9-d28a-43a9-8ae0-bed66dfbaa8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcdfcc6dd70844379383371dabddad7a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:39.635003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d8ef31d9-d28a-43a9-8ae0-bed66dfbaa8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcdfcc6dd70844379383371dabddad7a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:39.644499 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1162/2308] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:39 2022] DELETE /identity/v3/users/fcdfcc6dd70844379383371dabddad7a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:39.648902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95bd21-9628-4f47-9e4b-da190626994d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:39.649976 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95bd21-9628-4f47-9e4b-da190626994d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:39.650427 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95bd21-9628-4f47-9e4b-da190626994d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:39.673320 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-fe95bd21-9628-4f47-9e4b-da190626994d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:39.675994 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fe95bd21-9628-4f47-9e4b-da190626994d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:39.757620 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1147/2309] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:39.769015 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef31d9-d28a-43a9-8ae0-bed66dfbaa8f admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:39.770759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-d8ef31d9-d28a-43a9-8ae0-bed66dfbaa8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:39.914169 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef31d9-d28a-43a9-8ae0-bed66dfbaa8f admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:39.927107 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ca440-9a8e-44aa-a08a-c0e0b6478c08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:39.927107 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ca440-9a8e-44aa-a08a-c0e0b6478c08 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:39.927107 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ca440-9a8e-44aa-a08a-c0e0b6478c08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:39.927107 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ca440-9a8e-44aa-a08a-c0e0b6478c08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:39.932323 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ca440-9a8e-44aa-a08a-c0e0b6478c08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:39.933782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ca440-9a8e-44aa-a08a-c0e0b6478c08 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:39.947114 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1163/2310] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:40.346903 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95bd21-9628-4f47-9e4b-da190626994d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:40.346903 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fe95bd21-9628-4f47-9e4b-da190626994d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:40.426525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95bd21-9628-4f47-9e4b-da190626994d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:40.431328 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7f835-626b-4493-90d9-22ce8c2a7a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:40.432187 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7f835-626b-4493-90d9-22ce8c2a7a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:40.432476 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7f835-626b-4493-90d9-22ce8c2a7a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:40.432785 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7f835-626b-4493-90d9-22ce8c2a7a00 admin admin] PATH_INFO: `/v3/projects/0eddacf7370849d9bc823c79d1e2551c` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:40.433973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7f835-626b-4493-90d9-22ce8c2a7a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eddacf7370849d9bc823c79d1e2551c)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:40.435939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7f835-626b-4493-90d9-22ce8c2a7a00 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:40.485847 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-47b7f835-626b-4493-90d9-22ce8c2a7a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eddacf7370849d9bc823c79d1e2551c', 'request_id': 'req-47b7f835-626b-4493-90d9-22ce8c2a7a00'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:40.493029 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-47b7f835-626b-4493-90d9-22ce8c2a7a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eddacf7370849d9bc823c79d1e2551c', 'request_id': 'req-47b7f835-626b-4493-90d9-22ce8c2a7a00'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:40.499131 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-47b7f835-626b-4493-90d9-22ce8c2a7a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eddacf7370849d9bc823c79d1e2551c', 'request_id': 'req-47b7f835-626b-4493-90d9-22ce8c2a7a00'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:40.512386 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-47b7f835-626b-4493-90d9-22ce8c2a7a00 admin admin] The token cache is being invalidate because project 0eddacf7370849d9bc823c79d1e2551c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:40.512791 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-47b7f835-626b-4493-90d9-22ce8c2a7a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:40.513652 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-47b7f835-626b-4493-90d9-22ce8c2a7a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:40.515290 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1148/2311] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:40 2022] DELETE /identity/v3/projects/0eddacf7370849d9bc823c79d1e2551c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:40.520254 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b581ccb-ac47-4509-96c9-aa44aa234d16 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:40.520712 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b581ccb-ac47-4509-96c9-aa44aa234d16 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:40.520892 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b581ccb-ac47-4509-96c9-aa44aa234d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:40.543134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-2b581ccb-ac47-4509-96c9-aa44aa234d16 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:40.544381 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-2b581ccb-ac47-4509-96c9-aa44aa234d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:40.611993 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1164/2312] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:40.621698 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5b8d1-a7da-4382-a2c1-0ff0aff026a6 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:40.622000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5b8d1-a7da-4382-a2c1-0ff0aff026a6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:40.622341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5b8d1-a7da-4382-a2c1-0ff0aff026a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:40.643176 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4de5b8d1-a7da-4382-a2c1-0ff0aff026a6 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:40.644420 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4de5b8d1-a7da-4382-a2c1-0ff0aff026a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:40.653123 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1149/2313] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:34:40.657949 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b581ccb-ac47-4509-96c9-aa44aa234d16 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:40.669112 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b581ccb-ac47-4509-96c9-aa44aa234d16 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:40.673887 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf00e3-fd36-4437-8e68-0b50ec188e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:40.674614 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf00e3-fd36-4437-8e68-0b50ec188e12 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:40.674879 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf00e3-fd36-4437-8e68-0b50ec188e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:40.675153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf00e3-fd36-4437-8e68-0b50ec188e12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:40.675880 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf00e3-fd36-4437-8e68-0b50ec188e12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:34:40.676185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf00e3-fd36-4437-8e68-0b50ec188e12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:40.677797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf00e3-fd36-4437-8e68-0b50ec188e12 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:40.681022 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:40.695555 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1165/2314] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:34:40.696785 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5b8d1-a7da-4382-a2c1-0ff0aff026a6 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:40.707626 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5b8d1-a7da-4382-a2c1-0ff0aff026a6 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:40.712805 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c46cf7-1ee6-4202-b272-a3977fb83149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:40.713502 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c46cf7-1ee6-4202-b272-a3977fb83149 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:40.713790 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c46cf7-1ee6-4202-b272-a3977fb83149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:40.714069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c46cf7-1ee6-4202-b272-a3977fb83149 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:40.714798 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c46cf7-1ee6-4202-b272-a3977fb83149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:40.716741 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c46cf7-1ee6-4202-b272-a3977fb83149 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:40.748416 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1150/2315] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:34:40 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:34:40.752500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf00e3-fd36-4437-8e68-0b50ec188e12 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:40.762947 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf00e3-fd36-4437-8e68-0b50ec188e12 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:40.827382 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e72439-caea-40ea-83fd-e5457491a927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:40.828068 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e72439-caea-40ea-83fd-e5457491a927 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:40.828355 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e72439-caea-40ea-83fd-e5457491a927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:40.828639 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e72439-caea-40ea-83fd-e5457491a927 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:40.829332 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e72439-caea-40ea-83fd-e5457491a927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:40.831396 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e72439-caea-40ea-83fd-e5457491a927 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:40.856417 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1166/2316] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:34:40 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:34:40.860718 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c46cf7-1ee6-4202-b272-a3977fb83149 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:40.866107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:40.872357 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c46cf7-1ee6-4202-b272-a3977fb83149 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:40.878700 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd204f-f6b5-4ab6-9ee6-40b739ec7e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:40.879358 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd204f-f6b5-4ab6-9ee6-40b739ec7e0f admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:40.879643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd204f-f6b5-4ab6-9ee6-40b739ec7e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:40.879918 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd204f-f6b5-4ab6-9ee6-40b739ec7e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:40.880644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd204f-f6b5-4ab6-9ee6-40b739ec7e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:40.882303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd204f-f6b5-4ab6-9ee6-40b739ec7e0f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:40.894311 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1151/2317] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:40.900113 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e72439-caea-40ea-83fd-e5457491a927 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:40.910461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e72439-caea-40ea-83fd-e5457491a927 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:40.927093 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b1044-9ec0-4f1d-8a48-c2e9a25d467b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:40.927780 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b1044-9ec0-4f1d-8a48-c2e9a25d467b admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:40.928063 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b1044-9ec0-4f1d-8a48-c2e9a25d467b admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:40.928334 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b1044-9ec0-4f1d-8a48-c2e9a25d467b admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:40.929060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b1044-9ec0-4f1d-8a48-c2e9a25d467b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:40.930749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b1044-9ec0-4f1d-8a48-c2e9a25d467b admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:40.942967 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1167/2318] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:34:40.947730 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd204f-f6b5-4ab6-9ee6-40b739ec7e0f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:40.960549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd204f-f6b5-4ab6-9ee6-40b739ec7e0f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:40.966938 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab26c7-2d2f-493c-8ec1-47d0c14974b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:40.967831 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab26c7-2d2f-493c-8ec1-47d0c14974b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:40.968122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab26c7-2d2f-493c-8ec1-47d0c14974b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:40.968405 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab26c7-2d2f-493c-8ec1-47d0c14974b9 admin admin] PATH_INFO: `/v3/projects/a34d85429aea4f44994cf4f8ed23e56e/users/968eb88622b8461f901fdec8806243b6/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:40.995043 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab26c7-2d2f-493c-8ec1-47d0c14974b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34d85429aea4f44994cf4f8ed23e56e, user_id=968eb88622b8461f901fdec8806243b6, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:40.997992 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab26c7-2d2f-493c-8ec1-47d0c14974b9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:41.016297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1152/2319] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:34:40 2022] PUT /identity/v3/projects/a34d85429aea4f44994cf4f8ed23e56e/users/968eb88622b8461f901fdec8806243b6/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:34:41.026630 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f043cc-ef2b-43d3-9799-a20c7dda84f5 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:41.026932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f043cc-ef2b-43d3-9799-a20c7dda84f5 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:41.027224 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f043cc-ef2b-43d3-9799-a20c7dda84f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:41.058347 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-10f043cc-ef2b-43d3-9799-a20c7dda84f5 None None] MFA Rules not processed for user `968eb88622b8461f901fdec8806243b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:41.059768 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-10f043cc-ef2b-43d3-9799-a20c7dda84f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:41.146205 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1168/2320] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:41.159338 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab26c7-2d2f-493c-8ec1-47d0c14974b9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:41.162054 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-78ab26c7-2d2f-493c-8ec1-47d0c14974b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:41.259739 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab26c7-2d2f-493c-8ec1-47d0c14974b9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:41.263506 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b62646-4fcb-40e0-a3ed-fc303dc3b9b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:41.264178 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b62646-4fcb-40e0-a3ed-fc303dc3b9b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:41.264462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b62646-4fcb-40e0-a3ed-fc303dc3b9b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:41.264758 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b62646-4fcb-40e0-a3ed-fc303dc3b9b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:41.274775 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b62646-4fcb-40e0-a3ed-fc303dc3b9b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:41.276260 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b62646-4fcb-40e0-a3ed-fc303dc3b9b0 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:41.286489 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1153/2321] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:41 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:42.023748 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f043cc-ef2b-43d3-9799-a20c7dda84f5 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:42.025187 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-10f043cc-ef2b-43d3-9799-a20c7dda84f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:42.039246 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f043cc-ef2b-43d3-9799-a20c7dda84f5 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:42.044103 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445bdf7-52d4-410c-a2f6-256f57c00ce9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:42.044744 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445bdf7-52d4-410c-a2f6-256f57c00ce9 service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:42.045036 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445bdf7-52d4-410c-a2f6-256f57c00ce9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:42.045321 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445bdf7-52d4-410c-a2f6-256f57c00ce9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:42.047322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-a445bdf7-52d4-410c-a2f6-256f57c00ce9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:42.131426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445bdf7-52d4-410c-a2f6-256f57c00ce9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:42.132978 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445bdf7-52d4-410c-a2f6-256f57c00ce9 service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:42.136916 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:42.150602 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1169/2322] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:44.343535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b62646-4fcb-40e0-a3ed-fc303dc3b9b0 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:44.345435 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-07b62646-4fcb-40e0-a3ed-fc303dc3b9b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:44.419320 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b62646-4fcb-40e0-a3ed-fc303dc3b9b0 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:44.424236 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc1c78-fb07-43a4-8d59-b85f2cb79fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:44.425123 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc1c78-fb07-43a4-8d59-b85f2cb79fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:44.425447 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc1c78-fb07-43a4-8d59-b85f2cb79fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:44.425921 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc1c78-fb07-43a4-8d59-b85f2cb79fd7 admin admin] PATH_INFO: `/v3/users/ba248b57c28a4d8ba0846bd6b12074d7` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:44.427543 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc1c78-fb07-43a4-8d59-b85f2cb79fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba248b57c28a4d8ba0846bd6b12074d7)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:44.429672 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc1c78-fb07-43a4-8d59-b85f2cb79fd7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:44.482273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d1dc1c78-fb07-43a4-8d59-b85f2cb79fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba248b57c28a4d8ba0846bd6b12074d7'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:44.489860 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d1dc1c78-fb07-43a4-8d59-b85f2cb79fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba248b57c28a4d8ba0846bd6b12074d7'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:44.490510 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d1dc1c78-fb07-43a4-8d59-b85f2cb79fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba248b57c28a4d8ba0846bd6b12074d7'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:44.491126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d1dc1c78-fb07-43a4-8d59-b85f2cb79fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba248b57c28a4d8ba0846bd6b12074d7'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:44.499183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:44.507429 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d1dc1c78-fb07-43a4-8d59-b85f2cb79fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba248b57c28a4d8ba0846bd6b12074d7'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:44.525587 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1154/2323] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:44 2022] DELETE /identity/v3/users/ba248b57c28a4d8ba0846bd6b12074d7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:44.530184 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62353e-9550-4358-ae4f-c34552e6ef00 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:44.530705 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62353e-9550-4358-ae4f-c34552e6ef00 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:44.530835 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62353e-9550-4358-ae4f-c34552e6ef00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:44.567389 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-1f62353e-9550-4358-ae4f-c34552e6ef00 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:44.568655 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-1f62353e-9550-4358-ae4f-c34552e6ef00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:44.654331 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1170/2324] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:34:44.665048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc1c78-fb07-43a4-8d59-b85f2cb79fd7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:44.666590 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d1dc1c78-fb07-43a4-8d59-b85f2cb79fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:44.759729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc1c78-fb07-43a4-8d59-b85f2cb79fd7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:44.764796 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc15a9-1cf9-4821-b3c7-373aef79d964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:44.765784 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc15a9-1cf9-4821-b3c7-373aef79d964 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:44.766215 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc15a9-1cf9-4821-b3c7-373aef79d964 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:44.766673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc15a9-1cf9-4821-b3c7-373aef79d964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:44.777473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc15a9-1cf9-4821-b3c7-373aef79d964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:44.778973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc15a9-1cf9-4821-b3c7-373aef79d964 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:44.789471 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1155/2325] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:34:45.250911 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62353e-9550-4358-ae4f-c34552e6ef00 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:45.252915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-1f62353e-9550-4358-ae4f-c34552e6ef00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:45.276572 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62353e-9550-4358-ae4f-c34552e6ef00 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:45.286472 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c4236-5894-4d26-ba39-3e3ce0991f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:45.298735 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c4236-5894-4d26-ba39-3e3ce0991f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:45.299377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c4236-5894-4d26-ba39-3e3ce0991f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:45.300215 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c4236-5894-4d26-ba39-3e3ce0991f6c admin admin] PATH_INFO: `/v3/projects/23d85c1f1e6648f0a94d1209055ad920` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:45.303532 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c4236-5894-4d26-ba39-3e3ce0991f6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=23d85c1f1e6648f0a94d1209055ad920)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:45.318550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c4236-5894-4d26-ba39-3e3ce0991f6c admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:45.382390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-973c4236-5894-4d26-ba39-3e3ce0991f6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23d85c1f1e6648f0a94d1209055ad920', 'request_id': 'req-973c4236-5894-4d26-ba39-3e3ce0991f6c'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:45.389465 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-973c4236-5894-4d26-ba39-3e3ce0991f6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23d85c1f1e6648f0a94d1209055ad920', 'request_id': 'req-973c4236-5894-4d26-ba39-3e3ce0991f6c'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:45.396685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-973c4236-5894-4d26-ba39-3e3ce0991f6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23d85c1f1e6648f0a94d1209055ad920', 'request_id': 'req-973c4236-5894-4d26-ba39-3e3ce0991f6c'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:45.408612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-973c4236-5894-4d26-ba39-3e3ce0991f6c admin admin] The token cache is being invalidate because project 23d85c1f1e6648f0a94d1209055ad920 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:45.408908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-973c4236-5894-4d26-ba39-3e3ce0991f6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:45.409656 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-973c4236-5894-4d26-ba39-3e3ce0991f6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:45.411393 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1171/2326] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:45 2022] DELETE /identity/v3/projects/23d85c1f1e6648f0a94d1209055ad920 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:46.304226 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc15a9-1cf9-4821-b3c7-373aef79d964 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:46.305679 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e1cc15a9-1cf9-4821-b3c7-373aef79d964 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:46.318603 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc15a9-1cf9-4821-b3c7-373aef79d964 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:46.377086 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017868b-0220-4ec1-8e01-c7a750d51991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:46.377980 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017868b-0220-4ec1-8e01-c7a750d51991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:46.378569 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017868b-0220-4ec1-8e01-c7a750d51991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:46.378857 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017868b-0220-4ec1-8e01-c7a750d51991 admin admin] PATH_INFO: `/v3/users/93795b1ff7de4730b39a4cb0899ce5c0` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:46.380089 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017868b-0220-4ec1-8e01-c7a750d51991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93795b1ff7de4730b39a4cb0899ce5c0)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:46.382030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017868b-0220-4ec1-8e01-c7a750d51991 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:46.449138 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f017868b-0220-4ec1-8e01-c7a750d51991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93795b1ff7de4730b39a4cb0899ce5c0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:46.457460 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f017868b-0220-4ec1-8e01-c7a750d51991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93795b1ff7de4730b39a4cb0899ce5c0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:46.458441 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f017868b-0220-4ec1-8e01-c7a750d51991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93795b1ff7de4730b39a4cb0899ce5c0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:46.459103 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f017868b-0220-4ec1-8e01-c7a750d51991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93795b1ff7de4730b39a4cb0899ce5c0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:46.467311 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:46.473965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f017868b-0220-4ec1-8e01-c7a750d51991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93795b1ff7de4730b39a4cb0899ce5c0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:46.493277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1156/2327] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:34:46 2022] DELETE /identity/v3/users/93795b1ff7de4730b39a4cb0899ce5c0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:46.497895 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24398f51-544b-469c-be43-53210607aa51 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:46.498371 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24398f51-544b-469c-be43-53210607aa51 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:46.498463 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24398f51-544b-469c-be43-53210607aa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:46.516458 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-24398f51-544b-469c-be43-53210607aa51 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:34:46.517698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-24398f51-544b-469c-be43-53210607aa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:46.571866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:46.582874 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1172/2328] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:34:46.593345 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017868b-0220-4ec1-8e01-c7a750d51991 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:46.594803 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f017868b-0220-4ec1-8e01-c7a750d51991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:46.684095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017868b-0220-4ec1-8e01-c7a750d51991 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:46.689394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bab67e-b985-46ac-8375-dc42aa1136b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:46.690264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bab67e-b985-46ac-8375-dc42aa1136b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:46.690463 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bab67e-b985-46ac-8375-dc42aa1136b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:46.690780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bab67e-b985-46ac-8375-dc42aa1136b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:46.702980 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bab67e-b985-46ac-8375-dc42aa1136b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:46.706647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bab67e-b985-46ac-8375-dc42aa1136b0 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:46.719246 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1157/2329] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:34:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:34:47.021414 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24398f51-544b-469c-be43-53210607aa51 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:34:47.023434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-24398f51-544b-469c-be43-53210607aa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:34:47.038089 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24398f51-544b-469c-be43-53210607aa51 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:34:47.044160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22bbd7-6e12-496d-a563-5d5946920096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:34:47.045284 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22bbd7-6e12-496d-a563-5d5946920096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:34:47.045284 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22bbd7-6e12-496d-a563-5d5946920096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:34:47.045575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22bbd7-6e12-496d-a563-5d5946920096 admin admin] PATH_INFO: `/v3/projects/8950a9dada1a43bba4ff975afee5ffa4` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:34:47.046887 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22bbd7-6e12-496d-a563-5d5946920096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8950a9dada1a43bba4ff975afee5ffa4)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:34:47.048845 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22bbd7-6e12-496d-a563-5d5946920096 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:34:47.098481 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-cb22bbd7-6e12-496d-a563-5d5946920096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8950a9dada1a43bba4ff975afee5ffa4', 'request_id': 'req-cb22bbd7-6e12-496d-a563-5d5946920096'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:47.105863 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-cb22bbd7-6e12-496d-a563-5d5946920096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8950a9dada1a43bba4ff975afee5ffa4', 'request_id': 'req-cb22bbd7-6e12-496d-a563-5d5946920096'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:47.115255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-cb22bbd7-6e12-496d-a563-5d5946920096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8950a9dada1a43bba4ff975afee5ffa4', 'request_id': 'req-cb22bbd7-6e12-496d-a563-5d5946920096'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:47.127261 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-cb22bbd7-6e12-496d-a563-5d5946920096 admin admin] The token cache is being invalidate because project 8950a9dada1a43bba4ff975afee5ffa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:34:47.127687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-cb22bbd7-6e12-496d-a563-5d5946920096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:47.128438 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-cb22bbd7-6e12-496d-a563-5d5946920096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:34:47.130092 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1173/2330] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:34:47 2022] DELETE /identity/v3/projects/8950a9dada1a43bba4ff975afee5ffa4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:34:56.713918 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=33,keystone:DELETE=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:34:57.123986 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:01.724375 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8c0e2-9051-4b61-9092-e7895ca15e34 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:01.726483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8c0e2-9051-4b61-9092-e7895ca15e34 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:01.726941 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8c0e2-9051-4b61-9092-e7895ca15e34 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:01.728641 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1158/2331] 10.222.0.25 () {54 vars in 921 bytes} [Mon May 23 12:35:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:01.741548 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c85ba-3d54-43db-a7d9-db108c46533d None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:01.742195 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c85ba-3d54-43db-a7d9-db108c46533d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:01.742291 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c85ba-3d54-43db-a7d9-db108c46533d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:01.844590 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-574c85ba-3d54-43db-a7d9-db108c46533d None None] MFA Rules not processed for user `a3fde90ab1e0490ebb7cb514173d984e`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:01.845965 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-574c85ba-3d54-43db-a7d9-db108c46533d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:01.970016 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1174/2332] 10.222.0.25 () {58 vars in 1018 bytes} [Mon May 23 12:35:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:35:01.986032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8c0e2-9051-4b61-9092-e7895ca15e34 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:01.988273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6aa8c0e2-9051-4b61-9092-e7895ca15e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:02.008935 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8c0e2-9051-4b61-9092-e7895ca15e34 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:02.018331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503a4f9-2a2f-4705-8535-a764a1053073 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fde90ab1e0490ebb7cb514173d984e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:02.019088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503a4f9-2a2f-4705-8535-a764a1053073 service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:02.019383 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503a4f9-2a2f-4705-8535-a764a1053073 service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:02.019665 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503a4f9-2a2f-4705-8535-a764a1053073 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:02.051200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503a4f9-2a2f-4705-8535-a764a1053073 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:02.051200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503a4f9-2a2f-4705-8535-a764a1053073 service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:02.062102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1159/2333] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:35:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:35:02.575694 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c85ba-3d54-43db-a7d9-db108c46533d None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:02.577214 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-574c85ba-3d54-43db-a7d9-db108c46533d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:02.653957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c85ba-3d54-43db-a7d9-db108c46533d None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:02.658257 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bf0c7-00a6-40f2-9fb5-afc2823a1040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:02.659168 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bf0c7-00a6-40f2-9fb5-afc2823a1040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:02.659500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bf0c7-00a6-40f2-9fb5-afc2823a1040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:02.659739 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bf0c7-00a6-40f2-9fb5-afc2823a1040 admin admin] PATH_INFO: `/v3/users/045817048d544c498a46e5e15ffbdada` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:02.660951 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6bf0c7-00a6-40f2-9fb5-afc2823a1040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=045817048d544c498a46e5e15ffbdada)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:02.663453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6bf0c7-00a6-40f2-9fb5-afc2823a1040 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:02.717197 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-fc6bf0c7-00a6-40f2-9fb5-afc2823a1040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '045817048d544c498a46e5e15ffbdada'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:02.718906 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:02.728286 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-fc6bf0c7-00a6-40f2-9fb5-afc2823a1040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '045817048d544c498a46e5e15ffbdada'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:02.740176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-fc6bf0c7-00a6-40f2-9fb5-afc2823a1040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '045817048d544c498a46e5e15ffbdada'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:02.747597 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-fc6bf0c7-00a6-40f2-9fb5-afc2823a1040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '045817048d544c498a46e5e15ffbdada'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:02.748309 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-fc6bf0c7-00a6-40f2-9fb5-afc2823a1040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '045817048d544c498a46e5e15ffbdada'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:02.754668 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1175/2334] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:35:02 2022] DELETE /identity/v3/users/045817048d544c498a46e5e15ffbdada => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:35:02.952228 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503a4f9-2a2f-4705-8535-a764a1053073 service placement] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:02.965704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503a4f9-2a2f-4705-8535-a764a1053073 service placement] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:03.030435 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29926ca1-735e-42e1-89f7-72adf398127b None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:03.030666 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29926ca1-735e-42e1-89f7-72adf398127b None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:03.030873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29926ca1-735e-42e1-89f7-72adf398127b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:03.044722 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4d959-ff30-4e0f-90b7-4d56074dceb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:03.045604 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4d959-ff30-4e0f-90b7-4d56074dceb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:03.045888 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4d959-ff30-4e0f-90b7-4d56074dceb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:03.046157 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4d959-ff30-4e0f-90b7-4d56074dceb2 admin admin] PATH_INFO: `/v3/projects/313a432cf4a345a0b7fd4528e943da9d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:03.047403 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4d959-ff30-4e0f-90b7-4d56074dceb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=313a432cf4a345a0b7fd4528e943da9d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:03.049326 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4d959-ff30-4e0f-90b7-4d56074dceb2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:03.051074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-29926ca1-735e-42e1-89f7-72adf398127b None None] MFA Rules not processed for user `ae9ed5cec9cb45f58203e41048d8e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:03.053819 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-29926ca1-735e-42e1-89f7-72adf398127b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:03.140818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d4a4d959-ff30-4e0f-90b7-4d56074dceb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '313a432cf4a345a0b7fd4528e943da9d', 'request_id': 'req-d4a4d959-ff30-4e0f-90b7-4d56074dceb2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:03.151922 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d4a4d959-ff30-4e0f-90b7-4d56074dceb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '313a432cf4a345a0b7fd4528e943da9d', 'request_id': 'req-d4a4d959-ff30-4e0f-90b7-4d56074dceb2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:03.174924 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1176/2335] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:35:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:35:03.175434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d4a4d959-ff30-4e0f-90b7-4d56074dceb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '313a432cf4a345a0b7fd4528e943da9d', 'request_id': 'req-d4a4d959-ff30-4e0f-90b7-4d56074dceb2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:03.196997 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d4a4d959-ff30-4e0f-90b7-4d56074dceb2 admin admin] The token cache is being invalidate because project 313a432cf4a345a0b7fd4528e943da9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:35:03.197353 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d4a4d959-ff30-4e0f-90b7-4d56074dceb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:03.198000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d4a4d959-ff30-4e0f-90b7-4d56074dceb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:03.199628 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1160/2336] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:35:02 2022] DELETE /identity/v3/projects/313a432cf4a345a0b7fd4528e943da9d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:35:03.203832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29926ca1-735e-42e1-89f7-72adf398127b None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:03.205501 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-29926ca1-735e-42e1-89f7-72adf398127b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:03.220365 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29926ca1-735e-42e1-89f7-72adf398127b None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:03.293577 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42366adf-2c45-442f-9c3b-7c85703f596a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:03.294367 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42366adf-2c45-442f-9c3b-7c85703f596a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:03.294687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42366adf-2c45-442f-9c3b-7c85703f596a admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:03.294960 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42366adf-2c45-442f-9c3b-7c85703f596a admin admin] PATH_INFO: `/v3/users/7b6ed73f6be7471db8369c7b3048ab83` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:03.296163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42366adf-2c45-442f-9c3b-7c85703f596a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b6ed73f6be7471db8369c7b3048ab83)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:03.298168 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42366adf-2c45-442f-9c3b-7c85703f596a admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:03.349438 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-42366adf-2c45-442f-9c3b-7c85703f596a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b6ed73f6be7471db8369c7b3048ab83'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:03.357942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-42366adf-2c45-442f-9c3b-7c85703f596a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b6ed73f6be7471db8369c7b3048ab83'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:03.371940 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-42366adf-2c45-442f-9c3b-7c85703f596a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b6ed73f6be7471db8369c7b3048ab83'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:03.373294 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:03.384903 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-42366adf-2c45-442f-9c3b-7c85703f596a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b6ed73f6be7471db8369c7b3048ab83'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:03.385742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-42366adf-2c45-442f-9c3b-7c85703f596a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b6ed73f6be7471db8369c7b3048ab83'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:03.393554 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1177/2337] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:35:03 2022] DELETE /identity/v3/users/7b6ed73f6be7471db8369c7b3048ab83 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:35:03.595373 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4d959-ff30-4e0f-90b7-4d56074dceb2 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:03.614727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d4a4d959-ff30-4e0f-90b7-4d56074dceb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:03.629885 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4d959-ff30-4e0f-90b7-4d56074dceb2 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:03.699883 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9368c-b369-4c00-aae8-bce9d067a50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:03.700869 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9368c-b369-4c00-aae8-bce9d067a50e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:03.701164 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9368c-b369-4c00-aae8-bce9d067a50e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:03.701528 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9368c-b369-4c00-aae8-bce9d067a50e admin admin] PATH_INFO: `/v3/projects/343b5f0bcffb4aefb08100d6cd59e52a` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:03.702959 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9368c-b369-4c00-aae8-bce9d067a50e admin admin] RBAC: Authorizing `identity:delete_project(project_id=343b5f0bcffb4aefb08100d6cd59e52a)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:03.705912 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9368c-b369-4c00-aae8-bce9d067a50e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:03.734557 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:03.766360 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9ad9368c-b369-4c00-aae8-bce9d067a50e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '343b5f0bcffb4aefb08100d6cd59e52a', 'request_id': 'req-9ad9368c-b369-4c00-aae8-bce9d067a50e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:03.778057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9ad9368c-b369-4c00-aae8-bce9d067a50e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '343b5f0bcffb4aefb08100d6cd59e52a', 'request_id': 'req-9ad9368c-b369-4c00-aae8-bce9d067a50e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:03.783972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9ad9368c-b369-4c00-aae8-bce9d067a50e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '343b5f0bcffb4aefb08100d6cd59e52a', 'request_id': 'req-9ad9368c-b369-4c00-aae8-bce9d067a50e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:03.797566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9ad9368c-b369-4c00-aae8-bce9d067a50e admin admin] The token cache is being invalidate because project 343b5f0bcffb4aefb08100d6cd59e52a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:35:03.797789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9ad9368c-b369-4c00-aae8-bce9d067a50e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:03.798601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9ad9368c-b369-4c00-aae8-bce9d067a50e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:03.800270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1161/2338] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:35:03 2022] DELETE /identity/v3/projects/343b5f0bcffb4aefb08100d6cd59e52a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:35:03.805670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e858fc7-1e48-484a-bfea-653ed527d71e None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:03.806165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e858fc7-1e48-484a-bfea-653ed527d71e None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:03.806260 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e858fc7-1e48-484a-bfea-653ed527d71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:03.860906 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-4e858fc7-1e48-484a-bfea-653ed527d71e None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:03.860906 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-4e858fc7-1e48-484a-bfea-653ed527d71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:03.963839 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1178/2339] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:35:03.971461 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77746238-639f-4013-aac6-e5a9c458fc17 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:03.971918 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77746238-639f-4013-aac6-e5a9c458fc17 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:03.972020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77746238-639f-4013-aac6-e5a9c458fc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:03.992902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-77746238-639f-4013-aac6-e5a9c458fc17 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:03.994300 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-77746238-639f-4013-aac6-e5a9c458fc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:04.005210 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1162/2340] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:35:04.009698 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e858fc7-1e48-484a-bfea-653ed527d71e None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:04.019356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e858fc7-1e48-484a-bfea-653ed527d71e None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:04.024444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b95b1-36d5-491a-9746-2e320d5209b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:04.025156 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b95b1-36d5-491a-9746-2e320d5209b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:04.025368 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b95b1-36d5-491a-9746-2e320d5209b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:04.025643 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b95b1-36d5-491a-9746-2e320d5209b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:04.026364 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b95b1-36d5-491a-9746-2e320d5209b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:04.026699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b95b1-36d5-491a-9746-2e320d5209b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:04.028294 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b95b1-36d5-491a-9746-2e320d5209b4 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:04.041488 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1179/2341] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:04.045600 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77746238-639f-4013-aac6-e5a9c458fc17 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:04.055006 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77746238-639f-4013-aac6-e5a9c458fc17 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:04.059557 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bea5ac-7652-4f27-a0eb-29eb36bc0716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:04.060207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bea5ac-7652-4f27-a0eb-29eb36bc0716 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:04.060504 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bea5ac-7652-4f27-a0eb-29eb36bc0716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:04.060773 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bea5ac-7652-4f27-a0eb-29eb36bc0716 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:04.061459 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bea5ac-7652-4f27-a0eb-29eb36bc0716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:04.064166 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bea5ac-7652-4f27-a0eb-29eb36bc0716 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:04.091537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1163/2342] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:35:04 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:35:04.095611 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b95b1-36d5-491a-9746-2e320d5209b4 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:04.106390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b95b1-36d5-491a-9746-2e320d5209b4 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:04.177945 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec469b78-1ab9-4bb9-8317-8d18d1d3a17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:04.178778 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec469b78-1ab9-4bb9-8317-8d18d1d3a17b admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:04.179168 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec469b78-1ab9-4bb9-8317-8d18d1d3a17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:04.180243 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec469b78-1ab9-4bb9-8317-8d18d1d3a17b admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:04.181177 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec469b78-1ab9-4bb9-8317-8d18d1d3a17b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:04.183699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec469b78-1ab9-4bb9-8317-8d18d1d3a17b admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:04.212847 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1180/2343] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:35:04 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:35:04.217651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bea5ac-7652-4f27-a0eb-29eb36bc0716 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:04.230283 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bea5ac-7652-4f27-a0eb-29eb36bc0716 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:04.235314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc248e99-ca52-48f8-b98c-1107a90e5470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:04.236046 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc248e99-ca52-48f8-b98c-1107a90e5470 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:04.236338 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc248e99-ca52-48f8-b98c-1107a90e5470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:04.237725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc248e99-ca52-48f8-b98c-1107a90e5470 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:04.238592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc248e99-ca52-48f8-b98c-1107a90e5470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:04.241122 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc248e99-ca52-48f8-b98c-1107a90e5470 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:04.258130 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1164/2344] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:35:04.270849 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec469b78-1ab9-4bb9-8317-8d18d1d3a17b admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:04.283798 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec469b78-1ab9-4bb9-8317-8d18d1d3a17b admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:04.295029 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6f45b-ecae-494c-9049-1a1a8f30e5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:04.295682 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6f45b-ecae-494c-9049-1a1a8f30e5cb admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:04.295980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6f45b-ecae-494c-9049-1a1a8f30e5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:04.296299 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6f45b-ecae-494c-9049-1a1a8f30e5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:04.297758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6f45b-ecae-494c-9049-1a1a8f30e5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:04.299705 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6f45b-ecae-494c-9049-1a1a8f30e5cb admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:04.317680 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1181/2345] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:35:04.319471 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc248e99-ca52-48f8-b98c-1107a90e5470 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:04.330229 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc248e99-ca52-48f8-b98c-1107a90e5470 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:04.338477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c0469-745b-4960-991f-baf4b9d284a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:04.339559 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c0469-745b-4960-991f-baf4b9d284a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:04.340430 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c0469-745b-4960-991f-baf4b9d284a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:04.340430 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c0469-745b-4960-991f-baf4b9d284a3 admin admin] PATH_INFO: `/v3/projects/393bcf672143410e96abaf843b3ad79c/users/6eb4ce4cac2743ddbdad7bee0682ddae/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:04.361803 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c0469-745b-4960-991f-baf4b9d284a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=393bcf672143410e96abaf843b3ad79c, user_id=6eb4ce4cac2743ddbdad7bee0682ddae, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:04.365208 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c0469-745b-4960-991f-baf4b9d284a3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:04.390389 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1165/2346] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:35:04 2022] PUT /identity/v3/projects/393bcf672143410e96abaf843b3ad79c/users/6eb4ce4cac2743ddbdad7bee0682ddae/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:35:04.405973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed3107-2aeb-45dd-8fe1-7ee7c7b5bf2c None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:04.408663 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed3107-2aeb-45dd-8fe1-7ee7c7b5bf2c None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:04.409036 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed3107-2aeb-45dd-8fe1-7ee7c7b5bf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:04.449012 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-efed3107-2aeb-45dd-8fe1-7ee7c7b5bf2c None None] MFA Rules not processed for user `6eb4ce4cac2743ddbdad7bee0682ddae`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:04.451022 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-efed3107-2aeb-45dd-8fe1-7ee7c7b5bf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:04.488695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:04.532241 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1182/2347] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:35:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:35:04.544407 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c0469-745b-4960-991f-baf4b9d284a3 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:04.546954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-887c0469-745b-4960-991f-baf4b9d284a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:04.625612 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c0469-745b-4960-991f-baf4b9d284a3 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:04.633057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4b101-22cd-4152-ba54-4c5460d0f6e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ed824e419544b33a2c4413da4b45aaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:04.634242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4b101-22cd-4152-ba54-4c5460d0f6e9 service glance] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:04.634655 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4b101-22cd-4152-ba54-4c5460d0f6e9 service glance] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:04.634914 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4b101-22cd-4152-ba54-4c5460d0f6e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:04.641312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed3107-2aeb-45dd-8fe1-7ee7c7b5bf2c None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:04.644307 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-efed3107-2aeb-45dd-8fe1-7ee7c7b5bf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:04.651325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4b101-22cd-4152-ba54-4c5460d0f6e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:04.652853 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4b101-22cd-4152-ba54-4c5460d0f6e9 service glance] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:04.675263 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1166/2348] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:35:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:35:04.757222 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed3107-2aeb-45dd-8fe1-7ee7c7b5bf2c None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:04.769672 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5da7e-f218-460e-8bd9-e3388c3605a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:04.770524 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5da7e-f218-460e-8bd9-e3388c3605a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:04.770810 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5da7e-f218-460e-8bd9-e3388c3605a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:04.771109 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5da7e-f218-460e-8bd9-e3388c3605a7 admin admin] PATH_INFO: `/v3/users/d253db77e564406d97532238ca4b2d04` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:04.773111 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5da7e-f218-460e-8bd9-e3388c3605a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d253db77e564406d97532238ca4b2d04)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:04.775422 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5da7e-f218-460e-8bd9-e3388c3605a7 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:04.839143 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-b1b5da7e-f218-460e-8bd9-e3388c3605a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd253db77e564406d97532238ca4b2d04'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:04.847602 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-b1b5da7e-f218-460e-8bd9-e3388c3605a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd253db77e564406d97532238ca4b2d04'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:04.860514 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-b1b5da7e-f218-460e-8bd9-e3388c3605a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd253db77e564406d97532238ca4b2d04'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:04.868225 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-b1b5da7e-f218-460e-8bd9-e3388c3605a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd253db77e564406d97532238ca4b2d04'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:04.868948 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-b1b5da7e-f218-460e-8bd9-e3388c3605a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd253db77e564406d97532238ca4b2d04'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:04.875331 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1183/2349] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:35:04 2022] DELETE /identity/v3/users/d253db77e564406d97532238ca4b2d04 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:35:04.879683 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe389e-257a-45cb-ae25-d2f171d011c3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:04.879978 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe389e-257a-45cb-ae25-d2f171d011c3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:04.880257 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe389e-257a-45cb-ae25-d2f171d011c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:04.902757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9bfe389e-257a-45cb-ae25-d2f171d011c3 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:04.903961 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9bfe389e-257a-45cb-ae25-d2f171d011c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:04.947513 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:04.969053 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1167/2350] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:35:04.982803 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5da7e-f218-460e-8bd9-e3388c3605a7 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:04.984299 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-b1b5da7e-f218-460e-8bd9-e3388c3605a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:05.055569 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:05.060756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5da7e-f218-460e-8bd9-e3388c3605a7 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:05.066119 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3ab93-9233-4da9-ba8b-67b5d91575bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:05.066992 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3ab93-9233-4da9-ba8b-67b5d91575bc service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:05.067289 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3ab93-9233-4da9-ba8b-67b5d91575bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:05.067651 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3ab93-9233-4da9-ba8b-67b5d91575bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:05.083741 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a3ab93-9233-4da9-ba8b-67b5d91575bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:05.086477 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a3ab93-9233-4da9-ba8b-67b5d91575bc service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:05.097879 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1184/2351] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:35:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:35:05.561384 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe389e-257a-45cb-ae25-d2f171d011c3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:05.563044 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9bfe389e-257a-45cb-ae25-d2f171d011c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:05.581801 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe389e-257a-45cb-ae25-d2f171d011c3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:05.606142 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fcd35-d2c5-44e4-9197-2366953ac6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:05.608250 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fcd35-d2c5-44e4-9197-2366953ac6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:05.609371 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fcd35-d2c5-44e4-9197-2366953ac6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:05.610038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fcd35-d2c5-44e4-9197-2366953ac6a9 admin admin] PATH_INFO: `/v3/projects/a9b8b0f78ca5462a9cfeb1adc024a1ff` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:05.611743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5fcd35-d2c5-44e4-9197-2366953ac6a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9b8b0f78ca5462a9cfeb1adc024a1ff)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:05.613817 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5fcd35-d2c5-44e4-9197-2366953ac6a9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:05.683678 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-eb5fcd35-d2c5-44e4-9197-2366953ac6a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9b8b0f78ca5462a9cfeb1adc024a1ff', 'request_id': 'req-eb5fcd35-d2c5-44e4-9197-2366953ac6a9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:05.694492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-eb5fcd35-d2c5-44e4-9197-2366953ac6a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9b8b0f78ca5462a9cfeb1adc024a1ff', 'request_id': 'req-eb5fcd35-d2c5-44e4-9197-2366953ac6a9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:05.701496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-eb5fcd35-d2c5-44e4-9197-2366953ac6a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9b8b0f78ca5462a9cfeb1adc024a1ff', 'request_id': 'req-eb5fcd35-d2c5-44e4-9197-2366953ac6a9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:05.717485 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-eb5fcd35-d2c5-44e4-9197-2366953ac6a9 admin admin] The token cache is being invalidate because project a9b8b0f78ca5462a9cfeb1adc024a1ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:35:05.717803 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-eb5fcd35-d2c5-44e4-9197-2366953ac6a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:05.718548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-eb5fcd35-d2c5-44e4-9197-2366953ac6a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:05.723073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1168/2352] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:35:05 2022] DELETE /identity/v3/projects/a9b8b0f78ca5462a9cfeb1adc024a1ff => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:35:07.997144 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822a0a6-9f37-4a2e-bb73-81f463e5add3 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:07.997628 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822a0a6-9f37-4a2e-bb73-81f463e5add3 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:07.997747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822a0a6-9f37-4a2e-bb73-81f463e5add3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:08.016267 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-5822a0a6-9f37-4a2e-bb73-81f463e5add3 None None] MFA Rules not processed for user `261b8d67ef5847dc9117663de3f5c837`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:08.017494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-5822a0a6-9f37-4a2e-bb73-81f463e5add3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:08.078536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1185/2353] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:35:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:35:15.711407 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=33,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:16.965345 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fcd35-d2c5-44e4-9197-2366953ac6a9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:16.967062 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-eb5fcd35-d2c5-44e4-9197-2366953ac6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:17.045359 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fcd35-d2c5-44e4-9197-2366953ac6a9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:17.051707 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6d8f8-4dd7-483a-ba40-fd687548515a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:17.052810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6d8f8-4dd7-483a-ba40-fd687548515a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:17.053232 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6d8f8-4dd7-483a-ba40-fd687548515a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:17.053580 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6d8f8-4dd7-483a-ba40-fd687548515a admin admin] PATH_INFO: `/v3/users/968eb88622b8461f901fdec8806243b6` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:17.055113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6d8f8-4dd7-483a-ba40-fd687548515a admin admin] RBAC: Authorizing `identity:delete_user(user_id=968eb88622b8461f901fdec8806243b6)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:17.057047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6d8f8-4dd7-483a-ba40-fd687548515a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:17.136489 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-85a6d8f8-4dd7-483a-ba40-fd687548515a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '968eb88622b8461f901fdec8806243b6'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:17.155721 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-85a6d8f8-4dd7-483a-ba40-fd687548515a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '968eb88622b8461f901fdec8806243b6'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:17.156612 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-85a6d8f8-4dd7-483a-ba40-fd687548515a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '968eb88622b8461f901fdec8806243b6'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:17.157307 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-85a6d8f8-4dd7-483a-ba40-fd687548515a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '968eb88622b8461f901fdec8806243b6'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:17.172801 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-85a6d8f8-4dd7-483a-ba40-fd687548515a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '968eb88622b8461f901fdec8806243b6'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:17.185624 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1169/2354] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:35:16 2022] DELETE /identity/v3/users/968eb88622b8461f901fdec8806243b6 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:35:17.191246 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cea88-7c28-456a-8153-9e8e083a95c5 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:17.191716 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cea88-7c28-456a-8153-9e8e083a95c5 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:17.191826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cea88-7c28-456a-8153-9e8e083a95c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:17.211323 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-ee6cea88-7c28-456a-8153-9e8e083a95c5 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:17.212535 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ee6cea88-7c28-456a-8153-9e8e083a95c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:17.292968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1186/2355] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:35:17.307868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6d8f8-4dd7-483a-ba40-fd687548515a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:17.310353 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-85a6d8f8-4dd7-483a-ba40-fd687548515a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:17.377412 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6d8f8-4dd7-483a-ba40-fd687548515a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:17.382409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73998d0d-53de-4303-aac6-866ef72913e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:17.383218 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73998d0d-53de-4303-aac6-866ef72913e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:17.383759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73998d0d-53de-4303-aac6-866ef72913e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:17.384174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73998d0d-53de-4303-aac6-866ef72913e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:17.398618 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73998d0d-53de-4303-aac6-866ef72913e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:17.400814 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73998d0d-53de-4303-aac6-866ef72913e5 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:17.413155 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1170/2356] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:35:17.882791 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6cea88-7c28-456a-8153-9e8e083a95c5 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:17.887377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ee6cea88-7c28-456a-8153-9e8e083a95c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:17.906681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6cea88-7c28-456a-8153-9e8e083a95c5 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:17.917311 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56cc64-c481-4f4d-affa-5447d52c8120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:17.918631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56cc64-c481-4f4d-affa-5447d52c8120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:17.920154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56cc64-c481-4f4d-affa-5447d52c8120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:17.921207 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56cc64-c481-4f4d-affa-5447d52c8120 admin admin] PATH_INFO: `/v3/projects/a34d85429aea4f44994cf4f8ed23e56e` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:17.925821 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56cc64-c481-4f4d-affa-5447d52c8120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a34d85429aea4f44994cf4f8ed23e56e)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:17.929275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56cc64-c481-4f4d-affa-5447d52c8120 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:18.010843 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-fa56cc64-c481-4f4d-affa-5447d52c8120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34d85429aea4f44994cf4f8ed23e56e', 'request_id': 'req-fa56cc64-c481-4f4d-affa-5447d52c8120'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:18.024991 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-fa56cc64-c481-4f4d-affa-5447d52c8120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34d85429aea4f44994cf4f8ed23e56e', 'request_id': 'req-fa56cc64-c481-4f4d-affa-5447d52c8120'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:18.040802 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-fa56cc64-c481-4f4d-affa-5447d52c8120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34d85429aea4f44994cf4f8ed23e56e', 'request_id': 'req-fa56cc64-c481-4f4d-affa-5447d52c8120'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:18.058012 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-fa56cc64-c481-4f4d-affa-5447d52c8120 admin admin] The token cache is being invalidate because project a34d85429aea4f44994cf4f8ed23e56e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:35:18.058630 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-fa56cc64-c481-4f4d-affa-5447d52c8120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:18.059718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-fa56cc64-c481-4f4d-affa-5447d52c8120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:18.063293 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1187/2357] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:35:17 2022] DELETE /identity/v3/projects/a34d85429aea4f44994cf4f8ed23e56e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:35:18.068589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd56257-6c39-4306-8003-e574aaa18799 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:18.069153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd56257-6c39-4306-8003-e574aaa18799 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:18.070018 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd56257-6c39-4306-8003-e574aaa18799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:18.102125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2bd56257-6c39-4306-8003-e574aaa18799 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:18.103516 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2bd56257-6c39-4306-8003-e574aaa18799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:18.145209 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:18.266479 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1171/2358] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:35:18.276152 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53352902-7f46-41cb-b46f-ebb3b4a3ecca None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:18.276661 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53352902-7f46-41cb-b46f-ebb3b4a3ecca None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:18.276740 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53352902-7f46-41cb-b46f-ebb3b4a3ecca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:18.331620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-53352902-7f46-41cb-b46f-ebb3b4a3ecca None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:18.333429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-53352902-7f46-41cb-b46f-ebb3b4a3ecca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:18.355288 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1188/2359] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:35:18.360194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd56257-6c39-4306-8003-e574aaa18799 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:18.372330 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd56257-6c39-4306-8003-e574aaa18799 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:18.388625 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622a6f5-c090-4dac-9a8e-c7e105e3af0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:18.391457 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622a6f5-c090-4dac-9a8e-c7e105e3af0c admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:18.393430 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622a6f5-c090-4dac-9a8e-c7e105e3af0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:18.394769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622a6f5-c090-4dac-9a8e-c7e105e3af0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:18.396460 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622a6f5-c090-4dac-9a8e-c7e105e3af0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:18.396763 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622a6f5-c090-4dac-9a8e-c7e105e3af0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:18.401794 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622a6f5-c090-4dac-9a8e-c7e105e3af0c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:18.438758 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1172/2360] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:18.443947 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53352902-7f46-41cb-b46f-ebb3b4a3ecca None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:18.460882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53352902-7f46-41cb-b46f-ebb3b4a3ecca None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:18.470986 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9138ac-fa29-4d0e-b3f8-997baf9de3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:18.472133 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9138ac-fa29-4d0e-b3f8-997baf9de3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:18.472853 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9138ac-fa29-4d0e-b3f8-997baf9de3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:18.473426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9138ac-fa29-4d0e-b3f8-997baf9de3c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:18.475928 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9138ac-fa29-4d0e-b3f8-997baf9de3c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:18.480871 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9138ac-fa29-4d0e-b3f8-997baf9de3c1 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:18.495397 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:18.547061 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1189/2361] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:35:18 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:35:18.551739 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622a6f5-c090-4dac-9a8e-c7e105e3af0c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:18.565933 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622a6f5-c090-4dac-9a8e-c7e105e3af0c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:18.600061 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26f8e1-b877-4993-905e-e0dc6baf3981 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:18.600398 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26f8e1-b877-4993-905e-e0dc6baf3981 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:18.600618 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26f8e1-b877-4993-905e-e0dc6baf3981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:18.625788 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-5f26f8e1-b877-4993-905e-e0dc6baf3981 None None] MFA Rules not processed for user `eb30fc9bc5a04139b2a364ff03f4ad60`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:18.627361 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-5f26f8e1-b877-4993-905e-e0dc6baf3981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:18.662232 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd073c-ca99-498f-a387-7c10109853a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:18.663093 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd073c-ca99-498f-a387-7c10109853a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:18.663450 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd073c-ca99-498f-a387-7c10109853a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:18.664582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd073c-ca99-498f-a387-7c10109853a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:18.665444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd073c-ca99-498f-a387-7c10109853a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:18.667603 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd073c-ca99-498f-a387-7c10109853a4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:18.694155 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1173/2362] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:35:18 2022] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:35:18.695296 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd073c-ca99-498f-a387-7c10109853a4 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:18.711062 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd073c-ca99-498f-a387-7c10109853a4 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:18.717255 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c8db1-3ca1-489c-abc5-f406ff3f2555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:18.718448 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1190/2363] 10.222.0.25 () {58 vars in 1009 bytes} [Mon May 23 12:35:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:35:18.718651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c8db1-3ca1-489c-abc5-f406ff3f2555 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:18.718823 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c8db1-3ca1-489c-abc5-f406ff3f2555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:18.719097 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c8db1-3ca1-489c-abc5-f406ff3f2555 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:18.719901 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c8db1-3ca1-489c-abc5-f406ff3f2555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:18.721693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c8db1-3ca1-489c-abc5-f406ff3f2555 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:18.734844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1174/2364] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:35:18.743635 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26f8e1-b877-4993-905e-e0dc6baf3981 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:18.762140 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26f8e1-b877-4993-905e-e0dc6baf3981 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:18.769751 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15153655-1b7a-4e64-996b-b83b41ad8b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:18.770687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15153655-1b7a-4e64-996b-b83b41ad8b6d admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:18.771663 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15153655-1b7a-4e64-996b-b83b41ad8b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:18.772160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15153655-1b7a-4e64-996b-b83b41ad8b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:18.773194 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15153655-1b7a-4e64-996b-b83b41ad8b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:18.775576 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15153655-1b7a-4e64-996b-b83b41ad8b6d admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:18.789365 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1191/2365] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:35:18.793027 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c8db1-3ca1-489c-abc5-f406ff3f2555 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:18.794900 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5b7c8db1-3ca1-489c-abc5-f406ff3f2555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:18.795542 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15153655-1b7a-4e64-996b-b83b41ad8b6d admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:18.808688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15153655-1b7a-4e64-996b-b83b41ad8b6d admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:18.816881 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42995f-b7fd-40ec-b6a2-fe16ef8c0a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:18.818603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42995f-b7fd-40ec-b6a2-fe16ef8c0a29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:18.819749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42995f-b7fd-40ec-b6a2-fe16ef8c0a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:18.820077 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42995f-b7fd-40ec-b6a2-fe16ef8c0a29 admin admin] PATH_INFO: `/v3/projects/69843689bc854280895f9d0c106e6237/users/bd289d366668499692e13eaf08aab9b7/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:18.838974 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42995f-b7fd-40ec-b6a2-fe16ef8c0a29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69843689bc854280895f9d0c106e6237, user_id=bd289d366668499692e13eaf08aab9b7, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:18.841625 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42995f-b7fd-40ec-b6a2-fe16ef8c0a29 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:18.873769 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1192/2366] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:35:18 2022] PUT /identity/v3/projects/69843689bc854280895f9d0c106e6237/users/bd289d366668499692e13eaf08aab9b7/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:35:18.878862 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387db170-7ff0-45f2-b8ae-abbf70fb5d48 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:18.879176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387db170-7ff0-45f2-b8ae-abbf70fb5d48 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:18.879466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387db170-7ff0-45f2-b8ae-abbf70fb5d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:18.893576 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c8db1-3ca1-489c-abc5-f406ff3f2555 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:18.896756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-387db170-7ff0-45f2-b8ae-abbf70fb5d48 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:18.898118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-387db170-7ff0-45f2-b8ae-abbf70fb5d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:18.922778 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:18.956768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d1e7d-31b9-4093-a55f-b88d03333afb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03ca1edc22174d258ddeda25407ee6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:18.957425 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d1e7d-31b9-4093-a55f-b88d03333afb service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:18.957710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d1e7d-31b9-4093-a55f-b88d03333afb service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:18.957988 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d1e7d-31b9-4093-a55f-b88d03333afb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:18.959396 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1193/2367] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:35:18.969125 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387db170-7ff0-45f2-b8ae-abbf70fb5d48 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:18.970589 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-387db170-7ff0-45f2-b8ae-abbf70fb5d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:19.014244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d1e7d-31b9-4093-a55f-b88d03333afb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:19.015905 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d1e7d-31b9-4093-a55f-b88d03333afb service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:19.025427 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1175/2368] 10.222.0.25 () {60 vars in 1384 bytes} [Mon May 23 12:35:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:35:19.029586 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387db170-7ff0-45f2-b8ae-abbf70fb5d48 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:19.033291 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fe74d-b122-4594-bf65-fdcc8ac11895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:19.033933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fe74d-b122-4594-bf65-fdcc8ac11895 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:19.034220 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fe74d-b122-4594-bf65-fdcc8ac11895 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:19.034514 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fe74d-b122-4594-bf65-fdcc8ac11895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:19.044276 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69fe74d-b122-4594-bf65-fdcc8ac11895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:19.045730 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69fe74d-b122-4594-bf65-fdcc8ac11895 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:19.051203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:19.060483 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1194/2369] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:35:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:35:24.103031 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d1e7d-31b9-4093-a55f-b88d03333afb service swift] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:24.104701 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ce3d1e7d-31b9-4093-a55f-b88d03333afb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:24.135473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d1e7d-31b9-4093-a55f-b88d03333afb service swift] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:24.144188 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e90be-0d10-41a3-89ee-bb6335a49abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:24.145267 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e90be-0d10-41a3-89ee-bb6335a49abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:24.145568 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e90be-0d10-41a3-89ee-bb6335a49abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:24.145850 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e90be-0d10-41a3-89ee-bb6335a49abc admin admin] PATH_INFO: `/v3/users/6eb4ce4cac2743ddbdad7bee0682ddae` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:24.149297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e90be-0d10-41a3-89ee-bb6335a49abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb4ce4cac2743ddbdad7bee0682ddae)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:24.159078 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e90be-0d10-41a3-89ee-bb6335a49abc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:24.261676 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2f8e90be-0d10-41a3-89ee-bb6335a49abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb4ce4cac2743ddbdad7bee0682ddae'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:24.281743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2f8e90be-0d10-41a3-89ee-bb6335a49abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb4ce4cac2743ddbdad7bee0682ddae'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:24.282524 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2f8e90be-0d10-41a3-89ee-bb6335a49abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb4ce4cac2743ddbdad7bee0682ddae'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:24.283024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2f8e90be-0d10-41a3-89ee-bb6335a49abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb4ce4cac2743ddbdad7bee0682ddae'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:24.306897 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2f8e90be-0d10-41a3-89ee-bb6335a49abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb4ce4cac2743ddbdad7bee0682ddae'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:24.337848 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1176/2370] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:35:24 2022] DELETE /identity/v3/users/6eb4ce4cac2743ddbdad7bee0682ddae => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:35:24.342125 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb495ec-0ec3-48f6-8135-270fcc05c63f None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:24.342716 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb495ec-0ec3-48f6-8135-270fcc05c63f None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:24.342716 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb495ec-0ec3-48f6-8135-270fcc05c63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:24.372334 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-fcb495ec-0ec3-48f6-8135-270fcc05c63f None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:24.373598 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-fcb495ec-0ec3-48f6-8135-270fcc05c63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:24.506263 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1195/2371] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:35:24.519227 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e90be-0d10-41a3-89ee-bb6335a49abc admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:24.521267 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2f8e90be-0d10-41a3-89ee-bb6335a49abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:24.644036 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:24.669613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e90be-0d10-41a3-89ee-bb6335a49abc admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:24.676357 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09c859-a450-4a27-af06-da9e87cf8cdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:24.677735 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09c859-a450-4a27-af06-da9e87cf8cdc service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:24.678019 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09c859-a450-4a27-af06-da9e87cf8cdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:24.678297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09c859-a450-4a27-af06-da9e87cf8cdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:24.709995 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09c859-a450-4a27-af06-da9e87cf8cdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:24.711512 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09c859-a450-4a27-af06-da9e87cf8cdc service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:24.760760 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1177/2372] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:35:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:35:25.336900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb495ec-0ec3-48f6-8135-270fcc05c63f None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:25.338599 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-fcb495ec-0ec3-48f6-8135-270fcc05c63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:25.366318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb495ec-0ec3-48f6-8135-270fcc05c63f None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:25.372631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a4242-7a11-4cda-94af-5955b21a547b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:25.373897 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a4242-7a11-4cda-94af-5955b21a547b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:25.374591 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a4242-7a11-4cda-94af-5955b21a547b admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:25.375104 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a4242-7a11-4cda-94af-5955b21a547b admin admin] PATH_INFO: `/v3/projects/393bcf672143410e96abaf843b3ad79c` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:25.376863 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a4242-7a11-4cda-94af-5955b21a547b admin admin] RBAC: Authorizing `identity:delete_project(project_id=393bcf672143410e96abaf843b3ad79c)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:25.379430 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a4242-7a11-4cda-94af-5955b21a547b admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:25.514891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-bf9a4242-7a11-4cda-94af-5955b21a547b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '393bcf672143410e96abaf843b3ad79c', 'request_id': 'req-bf9a4242-7a11-4cda-94af-5955b21a547b'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:25.532039 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-bf9a4242-7a11-4cda-94af-5955b21a547b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '393bcf672143410e96abaf843b3ad79c', 'request_id': 'req-bf9a4242-7a11-4cda-94af-5955b21a547b'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:25.543327 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-bf9a4242-7a11-4cda-94af-5955b21a547b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '393bcf672143410e96abaf843b3ad79c', 'request_id': 'req-bf9a4242-7a11-4cda-94af-5955b21a547b'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:25.576481 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-bf9a4242-7a11-4cda-94af-5955b21a547b admin admin] The token cache is being invalidate because project 393bcf672143410e96abaf843b3ad79c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:35:25.576847 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-bf9a4242-7a11-4cda-94af-5955b21a547b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:25.580024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-bf9a4242-7a11-4cda-94af-5955b21a547b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:35:25.581970 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1196/2373] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:35:25 2022] DELETE /identity/v3/projects/393bcf672143410e96abaf843b3ad79c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:35:25.587107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b17b4-54f4-4f25-a491-ad84ff302bed None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:25.588025 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b17b4-54f4-4f25-a491-ad84ff302bed None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:25.588472 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b17b4-54f4-4f25-a491-ad84ff302bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:25.623173 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-123b17b4-54f4-4f25-a491-ad84ff302bed None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:25.626435 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-123b17b4-54f4-4f25-a491-ad84ff302bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:25.796917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a1e86-f744-4360-be97-8ea0aa43d1ac None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:25.797214 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a1e86-f744-4360-be97-8ea0aa43d1ac None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:25.797558 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a1e86-f744-4360-be97-8ea0aa43d1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:25.800450 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1178/2374] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:35:25.839808 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-fe3a1e86-f744-4360-be97-8ea0aa43d1ac None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:25.841375 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-fe3a1e86-f744-4360-be97-8ea0aa43d1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:25.869365 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1197/2375] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:35:25.874436 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b17b4-54f4-4f25-a491-ad84ff302bed None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:25.892259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b17b4-54f4-4f25-a491-ad84ff302bed None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:25.923552 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c2311-129c-49e5-864c-2a7b17c6774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:25.924840 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c2311-129c-49e5-864c-2a7b17c6774b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:25.925213 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c2311-129c-49e5-864c-2a7b17c6774b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:25.925573 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c2311-129c-49e5-864c-2a7b17c6774b admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:25.926415 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c2311-129c-49e5-864c-2a7b17c6774b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:35:25.927401 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c2311-129c-49e5-864c-2a7b17c6774b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:25.929155 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c2311-129c-49e5-864c-2a7b17c6774b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:25.958114 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1179/2376] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:35:25.962233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a1e86-f744-4360-be97-8ea0aa43d1ac None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:25.979670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a1e86-f744-4360-be97-8ea0aa43d1ac None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:25.991645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0b3f1-9082-4203-ae8f-e2f919bb306c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:25.992241 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0b3f1-9082-4203-ae8f-e2f919bb306c admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:25.992519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0b3f1-9082-4203-ae8f-e2f919bb306c admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:25.992801 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0b3f1-9082-4203-ae8f-e2f919bb306c admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:25.993521 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0b3f1-9082-4203-ae8f-e2f919bb306c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:25.996330 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0b3f1-9082-4203-ae8f-e2f919bb306c admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:26.049729 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1198/2377] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:35:25 2022] POST /identity/v3/projects => generated 371 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:35:26.054622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c2311-129c-49e5-864c-2a7b17c6774b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:26.069708 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c2311-129c-49e5-864c-2a7b17c6774b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:26.239948 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583e146-c287-4854-bdfa-2c24e500fa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:26.240648 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583e146-c287-4854-bdfa-2c24e500fa1d admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:26.240936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583e146-c287-4854-bdfa-2c24e500fa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:26.241224 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583e146-c287-4854-bdfa-2c24e500fa1d admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:26.241942 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583e146-c287-4854-bdfa-2c24e500fa1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:26.246917 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583e146-c287-4854-bdfa-2c24e500fa1d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:26.280561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1180/2378] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:35:26 2022] POST /identity/v3/users => generated 286 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:35:26.281217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0b3f1-9082-4203-ae8f-e2f919bb306c admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:26.297742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0b3f1-9082-4203-ae8f-e2f919bb306c admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:26.309408 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e70f9d-7dc5-4b97-8ef0-a2d389f1f506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:26.310119 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e70f9d-7dc5-4b97-8ef0-a2d389f1f506 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:26.310392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e70f9d-7dc5-4b97-8ef0-a2d389f1f506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:26.310695 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e70f9d-7dc5-4b97-8ef0-a2d389f1f506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:26.311446 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e70f9d-7dc5-4b97-8ef0-a2d389f1f506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:26.313068 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e70f9d-7dc5-4b97-8ef0-a2d389f1f506 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:26.349821 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1199/2379] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:35:26.354475 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583e146-c287-4854-bdfa-2c24e500fa1d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:26.377993 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583e146-c287-4854-bdfa-2c24e500fa1d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:26.388296 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bde3c8-b645-416f-819b-abaad7d5e51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:26.389261 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bde3c8-b645-416f-819b-abaad7d5e51b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:26.390360 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bde3c8-b645-416f-819b-abaad7d5e51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:26.390604 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bde3c8-b645-416f-819b-abaad7d5e51b admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:26.391360 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bde3c8-b645-416f-819b-abaad7d5e51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:26.399823 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bde3c8-b645-416f-819b-abaad7d5e51b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:26.418152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1181/2380] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:35:26.423356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e70f9d-7dc5-4b97-8ef0-a2d389f1f506 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:26.442776 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e70f9d-7dc5-4b97-8ef0-a2d389f1f506 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:26.452850 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a660a9-b352-4b61-aa0c-996f5d90140e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:26.454709 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a660a9-b352-4b61-aa0c-996f5d90140e admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:26.455220 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a660a9-b352-4b61-aa0c-996f5d90140e admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:26.455688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a660a9-b352-4b61-aa0c-996f5d90140e admin admin] PATH_INFO: `/v3/projects/aee1c047f8c54d7cba710c2d88e5e21f/users/4b75ce234a404ea49da10667c13aaa17/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:26.475584 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a660a9-b352-4b61-aa0c-996f5d90140e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee1c047f8c54d7cba710c2d88e5e21f, user_id=4b75ce234a404ea49da10667c13aaa17, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:26.478653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a660a9-b352-4b61-aa0c-996f5d90140e admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:26.510261 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1200/2381] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:35:26 2022] PUT /identity/v3/projects/aee1c047f8c54d7cba710c2d88e5e21f/users/4b75ce234a404ea49da10667c13aaa17/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:35:26.513736 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0549b0f-593b-4ab0-827f-7672c927bcab None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:26.513912 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0549b0f-593b-4ab0-827f-7672c927bcab None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:26.514140 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0549b0f-593b-4ab0-827f-7672c927bcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:26.552318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a0549b0f-593b-4ab0-827f-7672c927bcab None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:26.553719 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a0549b0f-593b-4ab0-827f-7672c927bcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:26.640745 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:26.669221 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1182/2382] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:35:26.679227 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a660a9-b352-4b61-aa0c-996f5d90140e admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:26.681284 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-50a660a9-b352-4b61-aa0c-996f5d90140e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:26.722224 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:26.779979 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a660a9-b352-4b61-aa0c-996f5d90140e admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:26.784762 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7486e6-68a2-4023-b29d-46ad8f10bf6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:26.785551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7486e6-68a2-4023-b29d-46ad8f10bf6c service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:26.786600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7486e6-68a2-4023-b29d-46ad8f10bf6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:26.786898 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7486e6-68a2-4023-b29d-46ad8f10bf6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:26.800130 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7486e6-68a2-4023-b29d-46ad8f10bf6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:26.801629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7486e6-68a2-4023-b29d-46ad8f10bf6c service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:26.818425 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1201/2383] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:35:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:35:26.896810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48725c0-f499-4c19-ad92-cbe663197c1f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:26.897091 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48725c0-f499-4c19-ad92-cbe663197c1f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:26.897296 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48725c0-f499-4c19-ad92-cbe663197c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:26.931460 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c48725c0-f499-4c19-ad92-cbe663197c1f None None] MFA Rules not processed for user `bd289d366668499692e13eaf08aab9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:26.933409 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c48725c0-f499-4c19-ad92-cbe663197c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:27.025762 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1183/2384] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:35:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:35:27.027808 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7486e6-68a2-4023-b29d-46ad8f10bf6c service neutron] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:27.030218 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-4d7486e6-68a2-4023-b29d-46ad8f10bf6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:27.048913 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7486e6-68a2-4023-b29d-46ad8f10bf6c service neutron] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:27.055272 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27623e66-b831-4bb5-804e-cbbde4bb4703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:27.055995 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27623e66-b831-4bb5-804e-cbbde4bb4703 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:27.056219 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27623e66-b831-4bb5-804e-cbbde4bb4703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:27.056502 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27623e66-b831-4bb5-804e-cbbde4bb4703 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:27.057344 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27623e66-b831-4bb5-804e-cbbde4bb4703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:27.059407 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27623e66-b831-4bb5-804e-cbbde4bb4703 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:27.095162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1202/2385] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:35:27 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:35:27.100951 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48725c0-f499-4c19-ad92-cbe663197c1f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:27.118146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48725c0-f499-4c19-ad92-cbe663197c1f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:27.225377 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252d623-f1be-42a8-885b-e67f18bf2d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:27.226759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252d623-f1be-42a8-885b-e67f18bf2d65 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:27.227260 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252d623-f1be-42a8-885b-e67f18bf2d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:27.227400 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252d623-f1be-42a8-885b-e67f18bf2d65 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:27.229844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252d623-f1be-42a8-885b-e67f18bf2d65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:27.232986 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252d623-f1be-42a8-885b-e67f18bf2d65 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:27.283586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1184/2386] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:35:27 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:35:27.287804 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27623e66-b831-4bb5-804e-cbbde4bb4703 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:27.304813 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27623e66-b831-4bb5-804e-cbbde4bb4703 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:27.312667 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bb0d2-d0ee-466e-bf48-cb1e07f95d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:27.314102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bb0d2-d0ee-466e-bf48-cb1e07f95d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:27.314471 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bb0d2-d0ee-466e-bf48-cb1e07f95d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:27.315565 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bb0d2-d0ee-466e-bf48-cb1e07f95d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:27.316385 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291bb0d2-d0ee-466e-bf48-cb1e07f95d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:27.319103 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291bb0d2-d0ee-466e-bf48-cb1e07f95d7d admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:27.358285 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1203/2387] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:35:27.360798 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252d623-f1be-42a8-885b-e67f18bf2d65 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:27.383156 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252d623-f1be-42a8-885b-e67f18bf2d65 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:27.391821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f34e1-107d-4fd8-bb30-3ecdd1821c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:27.394308 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f34e1-107d-4fd8-bb30-3ecdd1821c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:27.394677 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f34e1-107d-4fd8-bb30-3ecdd1821c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:27.394964 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f34e1-107d-4fd8-bb30-3ecdd1821c3b admin admin] PATH_INFO: `/v3/projects/b629b591ebf84af9a656cf190c64af44/users/ae2eb0d6d0954b058981eee070d33a02/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:27.425953 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f34e1-107d-4fd8-bb30-3ecdd1821c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b629b591ebf84af9a656cf190c64af44, user_id=ae2eb0d6d0954b058981eee070d33a02, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:27.433137 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f34e1-107d-4fd8-bb30-3ecdd1821c3b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:27.465400 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1185/2388] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:35:27 2022] PUT /identity/v3/projects/b629b591ebf84af9a656cf190c64af44/users/ae2eb0d6d0954b058981eee070d33a02/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:35:27.466988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bb0d2-d0ee-466e-bf48-cb1e07f95d7d admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:27.487847 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bb0d2-d0ee-466e-bf48-cb1e07f95d7d admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:27.613269 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf973e3-1495-478d-aa5f-9c2a0a5f5842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:27.616357 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf973e3-1495-478d-aa5f-9c2a0a5f5842 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:27.616649 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf973e3-1495-478d-aa5f-9c2a0a5f5842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:27.616938 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf973e3-1495-478d-aa5f-9c2a0a5f5842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:27.619537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf973e3-1495-478d-aa5f-9c2a0a5f5842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:27.625112 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf973e3-1495-478d-aa5f-9c2a0a5f5842 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:27.669092 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1204/2389] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:35:27.670739 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f34e1-107d-4fd8-bb30-3ecdd1821c3b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:27.700027 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f34e1-107d-4fd8-bb30-3ecdd1821c3b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:27.719630 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8ed49-1df8-4599-bf48-58f39561ca03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:27.721363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8ed49-1df8-4599-bf48-58f39561ca03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:27.721852 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8ed49-1df8-4599-bf48-58f39561ca03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:27.722313 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8ed49-1df8-4599-bf48-58f39561ca03 admin admin] PATH_INFO: `/v3/projects/b629b591ebf84af9a656cf190c64af44/users/ae2eb0d6d0954b058981eee070d33a02/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:27.728821 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8ed49-1df8-4599-bf48-58f39561ca03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b629b591ebf84af9a656cf190c64af44, user_id=ae2eb0d6d0954b058981eee070d33a02, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:27.733795 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8ed49-1df8-4599-bf48-58f39561ca03 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:27.764602 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1186/2390] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:35:27 2022] PUT /identity/v3/projects/b629b591ebf84af9a656cf190c64af44/users/ae2eb0d6d0954b058981eee070d33a02/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:35:27.868394 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b3946-bfb0-493e-a15c-ca7a2df35ae9 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:27.868857 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b3946-bfb0-493e-a15c-ca7a2df35ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:27.869201 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b3946-bfb0-493e-a15c-ca7a2df35ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:27.914035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-0c4b3946-bfb0-493e-a15c-ca7a2df35ae9 None None] MFA Rules not processed for user `4b75ce234a404ea49da10667c13aaa17`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:27.916470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-0c4b3946-bfb0-493e-a15c-ca7a2df35ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:28.068773 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1205/2391] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:35:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:35:28.082055 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8ed49-1df8-4599-bf48-58f39561ca03 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:28.084828 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7aa8ed49-1df8-4599-bf48-58f39561ca03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:28.173384 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:28.244431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8ed49-1df8-4599-bf48-58f39561ca03 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:28.250920 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3280a-8a29-490d-a04b-7bcb9eff15fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:28.251869 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3280a-8a29-490d-a04b-7bcb9eff15fd service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:28.252373 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3280a-8a29-490d-a04b-7bcb9eff15fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:28.252906 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3280a-8a29-490d-a04b-7bcb9eff15fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:28.277313 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3280a-8a29-490d-a04b-7bcb9eff15fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:28.280099 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3280a-8a29-490d-a04b-7bcb9eff15fd service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:28.303947 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1187/2392] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:35:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:35:29.920237 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f4aa9-8d33-4e27-84de-01747aeb9585 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:29.920788 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f4aa9-8d33-4e27-84de-01747aeb9585 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:29.920788 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f4aa9-8d33-4e27-84de-01747aeb9585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:29.957899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-e07f4aa9-8d33-4e27-84de-01747aeb9585 None None] MFA Rules not processed for user `4b75ce234a404ea49da10667c13aaa17`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:29.961096 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e07f4aa9-8d33-4e27-84de-01747aeb9585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:29.977728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1206/2393] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:35:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:35:35.163368 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36eaad6-6750-4cd6-b5a4-1c87d7ef425a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:35.163877 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36eaad6-6750-4cd6-b5a4-1c87d7ef425a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:35.163968 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36eaad6-6750-4cd6-b5a4-1c87d7ef425a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:35.243312 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c36eaad6-6750-4cd6-b5a4-1c87d7ef425a None None] MFA Rules not processed for user `ae2eb0d6d0954b058981eee070d33a02`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:35.253246 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c36eaad6-6750-4cd6-b5a4-1c87d7ef425a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:35.463434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1188/2394] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:35:35 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:35:35.480592 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f4aa9-8d33-4e27-84de-01747aeb9585 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:35.483682 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e07f4aa9-8d33-4e27-84de-01747aeb9585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:35.495039 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:35.645944 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f4aa9-8d33-4e27-84de-01747aeb9585 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:35.679642 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dfbf8-906b-4781-88f2-324dbeae53c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:35.681938 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dfbf8-906b-4781-88f2-324dbeae53c9 service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:35.682371 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dfbf8-906b-4781-88f2-324dbeae53c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:35.683226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dfbf8-906b-4781-88f2-324dbeae53c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:35.784300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454dfbf8-906b-4781-88f2-324dbeae53c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:35.786883 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454dfbf8-906b-4781-88f2-324dbeae53c9 service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:35.804078 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1207/2395] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:35:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:35:37.411494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929b1d3-15e4-4979-8968-c75d159e70b4 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:37.412071 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929b1d3-15e4-4979-8968-c75d159e70b4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:37.412177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929b1d3-15e4-4979-8968-c75d159e70b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:37.431440 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c929b1d3-15e4-4979-8968-c75d159e70b4 None None] MFA Rules not processed for user `bd289d366668499692e13eaf08aab9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:37.432822 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c929b1d3-15e4-4979-8968-c75d159e70b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:37.440207 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1189/2396] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:35:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:35:42.491405 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc613e71-fd26-4307-a610-fc1e4a04714b None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:42.491981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc613e71-fd26-4307-a610-fc1e4a04714b None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:42.492105 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc613e71-fd26-4307-a610-fc1e4a04714b None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:42.493556 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1208/2397] 10.222.0.25 () {54 vars in 921 bytes} [Mon May 23 12:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:42.500210 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99daf2-0ae2-4891-823d-314c355ba57a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:42.500660 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99daf2-0ae2-4891-823d-314c355ba57a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:42.500801 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99daf2-0ae2-4891-823d-314c355ba57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:42.541313 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3e99daf2-0ae2-4891-823d-314c355ba57a None None] MFA Rules not processed for user `d49997b9108145b78eb4db1d8823bf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:42.542645 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3e99daf2-0ae2-4891-823d-314c355ba57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:42.552181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1190/2398] 10.222.0.25 () {58 vars in 1018 bytes} [Mon May 23 12:35:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:35:42.564947 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc613e71-fd26-4307-a610-fc1e4a04714b None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:42.567185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-dc613e71-fd26-4307-a610-fc1e4a04714b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:42.655723 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc613e71-fd26-4307-a610-fc1e4a04714b None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:42.659254 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880423b-6bd7-44e7-9a09-240f7c944352 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ed824e419544b33a2c4413da4b45aaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:42.659905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880423b-6bd7-44e7-9a09-240f7c944352 service glance] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:42.660676 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880423b-6bd7-44e7-9a09-240f7c944352 service glance] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:42.660952 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880423b-6bd7-44e7-9a09-240f7c944352 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:42.670930 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880423b-6bd7-44e7-9a09-240f7c944352 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:42.672353 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880423b-6bd7-44e7-9a09-240f7c944352 service glance] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:42.684327 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1209/2399] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:35:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:35:42.754009 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafbf61-c2c1-40ee-801f-9e1b0c6dbc6b None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:42.754334 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafbf61-c2c1-40ee-801f-9e1b0c6dbc6b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:42.754647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafbf61-c2c1-40ee-801f-9e1b0c6dbc6b None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:42.756081 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1191/2400] 10.222.0.25 () {54 vars in 921 bytes} [Mon May 23 12:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:42.760975 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbb1b1-3dee-4875-bdef-20c385ba5ccf None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:42.761461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbb1b1-3dee-4875-bdef-20c385ba5ccf None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:42.761745 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbb1b1-3dee-4875-bdef-20c385ba5ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:42.776806 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:42.786385 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-70fbb1b1-3dee-4875-bdef-20c385ba5ccf None None] MFA Rules not processed for user `74674b52807742abb7e144bba3bb6e56`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:42.787682 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-70fbb1b1-3dee-4875-bdef-20c385ba5ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:42.840979 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1210/2401] 10.222.0.25 () {58 vars in 1018 bytes} [Mon May 23 12:35:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:35:42.853129 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafbf61-c2c1-40ee-801f-9e1b0c6dbc6b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:42.864004 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafbf61-c2c1-40ee-801f-9e1b0c6dbc6b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:42.867536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cced0e2-773b-405d-86aa-dfc9124c4a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:42.868165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cced0e2-773b-405d-86aa-dfc9124c4a53 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:42.868457 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cced0e2-773b-405d-86aa-dfc9124c4a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:42.868738 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cced0e2-773b-405d-86aa-dfc9124c4a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:42.875848 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cced0e2-773b-405d-86aa-dfc9124c4a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:42.877295 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cced0e2-773b-405d-86aa-dfc9124c4a53 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:42.885033 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1192/2402] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:35:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:35:42.973593 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cf0e4-f6cd-4637-8c74-c8918a5f4e00 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:42.973959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cf0e4-f6cd-4637-8c74-c8918a5f4e00 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:42.974248 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cf0e4-f6cd-4637-8c74-c8918a5f4e00 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:42.975863 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1211/2403] 10.222.0.25 () {54 vars in 921 bytes} [Mon May 23 12:35:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:35:42.981050 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ab86f-f02c-4173-8036-e0b105e50f14 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:42.981345 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ab86f-f02c-4173-8036-e0b105e50f14 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:42.981634 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ab86f-f02c-4173-8036-e0b105e50f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:43.000449 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f63ab86f-f02c-4173-8036-e0b105e50f14 None None] MFA Rules not processed for user `d49997b9108145b78eb4db1d8823bf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:43.001671 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f63ab86f-f02c-4173-8036-e0b105e50f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:43.011044 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1193/2404] 10.222.0.25 () {58 vars in 1018 bytes} [Mon May 23 12:35:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:35:43.021886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cf0e4-f6cd-4637-8c74-c8918a5f4e00 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:43.033372 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cf0e4-f6cd-4637-8c74-c8918a5f4e00 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:43.037079 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812086c9-8546-4578-8c99-d3474ad06396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:43.037738 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812086c9-8546-4578-8c99-d3474ad06396 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:43.038029 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812086c9-8546-4578-8c99-d3474ad06396 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:43.038309 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812086c9-8546-4578-8c99-d3474ad06396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:43.048854 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812086c9-8546-4578-8c99-d3474ad06396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:43.050322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812086c9-8546-4578-8c99-d3474ad06396 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:43.061322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1212/2405] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:35:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:35:47.373360 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac91f3-dedc-482e-9b63-2b464a6d1796 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:47.373815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac91f3-dedc-482e-9b63-2b464a6d1796 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:47.373949 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac91f3-dedc-482e-9b63-2b464a6d1796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:47.422713 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0cac91f3-dedc-482e-9b63-2b464a6d1796 None None] MFA Rules not processed for user `eb30fc9bc5a04139b2a364ff03f4ad60`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:47.423943 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0cac91f3-dedc-482e-9b63-2b464a6d1796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:47.457375 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:47.510716 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1194/2406] 10.222.0.25 () {58 vars in 1009 bytes} [Mon May 23 12:35:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:35:47.523363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812086c9-8546-4578-8c99-d3474ad06396 service neutron] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:35:47.525015 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-812086c9-8546-4578-8c99-d3474ad06396 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:47.647300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812086c9-8546-4578-8c99-d3474ad06396 service neutron] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:35:47.652424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bb785-422d-4f8b-b5f2-2e0f06b0b994 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03ca1edc22174d258ddeda25407ee6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:35:47.653141 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bb785-422d-4f8b-b5f2-2e0f06b0b994 service swift] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:47.653498 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bb785-422d-4f8b-b5f2-2e0f06b0b994 service swift] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:47.653864 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bb785-422d-4f8b-b5f2-2e0f06b0b994 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:47.662735 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bb785-422d-4f8b-b5f2-2e0f06b0b994 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:35:47.664406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bb785-422d-4f8b-b5f2-2e0f06b0b994 service swift] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:35:47.672721 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1213/2407] 10.222.0.25 () {60 vars in 1384 bytes} [Mon May 23 12:35:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:35:57.506796 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=14 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:57.669724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=67 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:35:59.212398 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66f0a5-a207-425f-a3df-27c2b927a5b3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:35:59.212928 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66f0a5-a207-425f-a3df-27c2b927a5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:35:59.212928 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66f0a5-a207-425f-a3df-27c2b927a5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:35:59.236555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2c66f0a5-a207-425f-a3df-27c2b927a5b3 None None] MFA Rules not processed for user `4b75ce234a404ea49da10667c13aaa17`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:35:59.239145 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2c66f0a5-a207-425f-a3df-27c2b927a5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:35:59.252395 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1195/2408] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:35:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:36:04.357798 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf1ec9-2ecd-4ca9-8a23-98dc22fc4d4c None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:04.358354 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf1ec9-2ecd-4ca9-8a23-98dc22fc4d4c None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:04.358354 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf1ec9-2ecd-4ca9-8a23-98dc22fc4d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:04.377569 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-4ecf1ec9-2ecd-4ca9-8a23-98dc22fc4d4c None None] MFA Rules not processed for user `eb30fc9bc5a04139b2a364ff03f4ad60`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:36:04.379259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-4ecf1ec9-2ecd-4ca9-8a23-98dc22fc4d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:36:04.386743 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1214/2409] 10.222.0.25 () {58 vars in 967 bytes} [Mon May 23 12:36:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:36:04.400094 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66f0a5-a207-425f-a3df-27c2b927a5b3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:36:04.412091 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66f0a5-a207-425f-a3df-27c2b927a5b3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:36:04.417002 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78169984-c122-43ef-adbf-a9eaa9bc5b3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03ca1edc22174d258ddeda25407ee6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:36:04.417640 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78169984-c122-43ef-adbf-a9eaa9bc5b3c service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:04.417931 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78169984-c122-43ef-adbf-a9eaa9bc5b3c service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:04.418214 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78169984-c122-43ef-adbf-a9eaa9bc5b3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:04.426172 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78169984-c122-43ef-adbf-a9eaa9bc5b3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:36:04.427819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78169984-c122-43ef-adbf-a9eaa9bc5b3c service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:36:04.437392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1196/2410] 10.222.0.25 () {60 vars in 1384 bytes} [Mon May 23 12:36:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:36:07.977454 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf1ec9-2ecd-4ca9-8a23-98dc22fc4d4c None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:36:07.978945 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-4ecf1ec9-2ecd-4ca9-8a23-98dc22fc4d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:36:08.074121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf1ec9-2ecd-4ca9-8a23-98dc22fc4d4c None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:36:08.079932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2352c-d713-4c2f-8dc3-a900f3e53355 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fde90ab1e0490ebb7cb514173d984e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:36:08.080637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2352c-d713-4c2f-8dc3-a900f3e53355 service placement] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:08.080955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2352c-d713-4c2f-8dc3-a900f3e53355 service placement] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:08.081263 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2352c-d713-4c2f-8dc3-a900f3e53355 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:08.085495 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-eff2352c-d713-4c2f-8dc3-a900f3e53355 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:36:08.100154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2352c-d713-4c2f-8dc3-a900f3e53355 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:36:08.101951 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2352c-d713-4c2f-8dc3-a900f3e53355 service placement] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:36:08.129241 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1215/2411] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:36:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:36:10.642195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78169984-c122-43ef-adbf-a9eaa9bc5b3c service swift] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:36:10.643203 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-78169984-c122-43ef-adbf-a9eaa9bc5b3c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:36:10.656805 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78169984-c122-43ef-adbf-a9eaa9bc5b3c service swift] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:36:10.662463 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3087a-7290-497d-a17f-22534f9f6bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:36:10.663988 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3087a-7290-497d-a17f-22534f9f6bbf service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:10.664464 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3087a-7290-497d-a17f-22534f9f6bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:10.666823 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3087a-7290-497d-a17f-22534f9f6bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:10.681361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3087a-7290-497d-a17f-22534f9f6bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:36:10.683580 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3087a-7290-497d-a17f-22534f9f6bbf service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:36:10.714017 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1197/2412] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:36:10 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:36:18.109648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=35 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:20.611497 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fd9ba-35c9-4d57-9d9c-bdb007a88e71 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:20.612078 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fd9ba-35c9-4d57-9d9c-bdb007a88e71 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:20.612078 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fd9ba-35c9-4d57-9d9c-bdb007a88e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:20.631604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-aa1fd9ba-35c9-4d57-9d9c-bdb007a88e71 None None] MFA Rules not processed for user `eb30fc9bc5a04139b2a364ff03f4ad60`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:36:20.632823 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-aa1fd9ba-35c9-4d57-9d9c-bdb007a88e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:36:20.640433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1216/2413] 10.222.0.25 () {58 vars in 1009 bytes} [Mon May 23 12:36:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:36:20.663497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3087a-7290-497d-a17f-22534f9f6bbf service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:36:20.675629 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3087a-7290-497d-a17f-22534f9f6bbf service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:36:20.681597 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba4f0f-8d8c-4704-8814-2fd1893070cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03ca1edc22174d258ddeda25407ee6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:36:20.682411 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba4f0f-8d8c-4704-8814-2fd1893070cb service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:20.682735 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba4f0f-8d8c-4704-8814-2fd1893070cb service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:20.683018 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba4f0f-8d8c-4704-8814-2fd1893070cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:20.694111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba4f0f-8d8c-4704-8814-2fd1893070cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:36:20.695952 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba4f0f-8d8c-4704-8814-2fd1893070cb service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:36:20.704799 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1198/2414] 10.222.0.25 () {60 vars in 1384 bytes} [Mon May 23 12:36:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:36:20.808506 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a579fb-3d88-4e15-9bd9-13d059769993 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:20.808924 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a579fb-3d88-4e15-9bd9-13d059769993 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:20.809162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a579fb-3d88-4e15-9bd9-13d059769993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:20.835098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-c2a579fb-3d88-4e15-9bd9-13d059769993 None None] MFA Rules not processed for user `ae9ed5cec9cb45f58203e41048d8e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:36:20.836670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-c2a579fb-3d88-4e15-9bd9-13d059769993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:36:20.905790 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1217/2415] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:36:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:36:30.701442 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=21 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:30.896642 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=28 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:36.329261 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05906f9f-2ae6-482b-9907-d6d4496ea1ba None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:36.329808 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05906f9f-2ae6-482b-9907-d6d4496ea1ba None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:36.329808 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05906f9f-2ae6-482b-9907-d6d4496ea1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:36.348500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-05906f9f-2ae6-482b-9907-d6d4496ea1ba None None] MFA Rules not processed for user `eb30fc9bc5a04139b2a364ff03f4ad60`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:36:36.349730 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-05906f9f-2ae6-482b-9907-d6d4496ea1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:36:36.357016 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1199/2416] 10.222.0.25 () {58 vars in 967 bytes} [Mon May 23 12:36:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:36:36.371157 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a579fb-3d88-4e15-9bd9-13d059769993 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:36:36.382734 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a579fb-3d88-4e15-9bd9-13d059769993 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:36:36.387642 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242ccc5-064c-407b-8689-4483e2885459 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03ca1edc22174d258ddeda25407ee6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:36:36.388281 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242ccc5-064c-407b-8689-4483e2885459 service swift] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:36.388565 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242ccc5-064c-407b-8689-4483e2885459 service swift] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:36.388842 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242ccc5-064c-407b-8689-4483e2885459 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:36.397894 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242ccc5-064c-407b-8689-4483e2885459 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:36:36.399549 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242ccc5-064c-407b-8689-4483e2885459 service swift] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:36:36.408012 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1218/2417] 10.222.0.25 () {60 vars in 1384 bytes} [Mon May 23 12:36:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:36:38.327844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05906f9f-2ae6-482b-9907-d6d4496ea1ba None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:36:38.394921 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05906f9f-2ae6-482b-9907-d6d4496ea1ba None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:36:38.399320 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260dc577-9db5-4bd4-9f0d-18a96d35f29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:36:38.400189 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dc577-9db5-4bd4-9f0d-18a96d35f29e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:38.400471 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dc577-9db5-4bd4-9f0d-18a96d35f29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:38.400749 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dc577-9db5-4bd4-9f0d-18a96d35f29e admin admin] PATH_INFO: `/v3/users/4b75ce234a404ea49da10667c13aaa17` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:38.401939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260dc577-9db5-4bd4-9f0d-18a96d35f29e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b75ce234a404ea49da10667c13aaa17)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:36:38.403906 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260dc577-9db5-4bd4-9f0d-18a96d35f29e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:36:38.451987 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-260dc577-9db5-4bd4-9f0d-18a96d35f29e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b75ce234a404ea49da10667c13aaa17'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:36:38.460671 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-260dc577-9db5-4bd4-9f0d-18a96d35f29e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b75ce234a404ea49da10667c13aaa17'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:36:38.461508 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-260dc577-9db5-4bd4-9f0d-18a96d35f29e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b75ce234a404ea49da10667c13aaa17'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:36:38.462171 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-260dc577-9db5-4bd4-9f0d-18a96d35f29e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b75ce234a404ea49da10667c13aaa17'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:36:38.475770 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-260dc577-9db5-4bd4-9f0d-18a96d35f29e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b75ce234a404ea49da10667c13aaa17'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:36:38.488760 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1200/2418] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:36:38 2022] DELETE /identity/v3/users/4b75ce234a404ea49da10667c13aaa17 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:36:38.665145 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242ccc5-064c-407b-8689-4483e2885459 service swift] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:36:38.691697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242ccc5-064c-407b-8689-4483e2885459 service swift] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:36:38.754880 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b562470-b176-4ead-8396-934f13ab6004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:36:38.755758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b562470-b176-4ead-8396-934f13ab6004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:38.756186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b562470-b176-4ead-8396-934f13ab6004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:38.756473 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b562470-b176-4ead-8396-934f13ab6004 admin admin] PATH_INFO: `/v3/projects/aee1c047f8c54d7cba710c2d88e5e21f` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:38.757658 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b562470-b176-4ead-8396-934f13ab6004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aee1c047f8c54d7cba710c2d88e5e21f)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:36:38.759640 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b562470-b176-4ead-8396-934f13ab6004 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:36:38.808726 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-2b562470-b176-4ead-8396-934f13ab6004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aee1c047f8c54d7cba710c2d88e5e21f', 'request_id': 'req-2b562470-b176-4ead-8396-934f13ab6004'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:36:38.815875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-2b562470-b176-4ead-8396-934f13ab6004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aee1c047f8c54d7cba710c2d88e5e21f', 'request_id': 'req-2b562470-b176-4ead-8396-934f13ab6004'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:36:38.823138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-2b562470-b176-4ead-8396-934f13ab6004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aee1c047f8c54d7cba710c2d88e5e21f', 'request_id': 'req-2b562470-b176-4ead-8396-934f13ab6004'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:36:38.833354 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-2b562470-b176-4ead-8396-934f13ab6004 admin admin] The token cache is being invalidate because project aee1c047f8c54d7cba710c2d88e5e21f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:36:38.833639 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-2b562470-b176-4ead-8396-934f13ab6004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:36:38.834248 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-2b562470-b176-4ead-8396-934f13ab6004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:36:38.835863 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1219/2419] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:36:38 2022] DELETE /identity/v3/projects/aee1c047f8c54d7cba710c2d88e5e21f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:36:38.840950 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d87d65-d36f-49bf-86ee-b1aa81e152a5 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:38.841256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d87d65-d36f-49bf-86ee-b1aa81e152a5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:38.841565 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d87d65-d36f-49bf-86ee-b1aa81e152a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:38.859496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-10d87d65-d36f-49bf-86ee-b1aa81e152a5 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:36:38.861223 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-10d87d65-d36f-49bf-86ee-b1aa81e152a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:36:38.919566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1201/2420] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:36:38.979558 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85002c-6382-4659-8acd-e88d20b0a8a0 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:38.979855 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85002c-6382-4659-8acd-e88d20b0a8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:38.980141 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85002c-6382-4659-8acd-e88d20b0a8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:38.998920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-5b85002c-6382-4659-8acd-e88d20b0a8a0 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:36:39.000132 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-5b85002c-6382-4659-8acd-e88d20b0a8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:36:39.008780 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1220/2421] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:36:39.012928 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d87d65-d36f-49bf-86ee-b1aa81e152a5 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:36:39.022700 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d87d65-d36f-49bf-86ee-b1aa81e152a5 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:36:39.027938 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe1869-f980-45a0-83d6-7398fe6d0b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:36:39.028614 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe1869-f980-45a0-83d6-7398fe6d0b40 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:39.028906 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe1869-f980-45a0-83d6-7398fe6d0b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:39.029187 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe1869-f980-45a0-83d6-7398fe6d0b40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:39.029956 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe1869-f980-45a0-83d6-7398fe6d0b40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:36:39.030274 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe1869-f980-45a0-83d6-7398fe6d0b40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:36:39.031976 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe1869-f980-45a0-83d6-7398fe6d0b40 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:36:39.041648 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:39.049185 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1202/2422] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:36:39.050334 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85002c-6382-4659-8acd-e88d20b0a8a0 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:36:39.059551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85002c-6382-4659-8acd-e88d20b0a8a0 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:36:39.064385 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614b27e-0fc5-44d8-a444-2da191fba4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:36:39.065027 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614b27e-0fc5-44d8-a444-2da191fba4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:39.065313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614b27e-0fc5-44d8-a444-2da191fba4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:39.065596 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614b27e-0fc5-44d8-a444-2da191fba4c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:39.066272 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614b27e-0fc5-44d8-a444-2da191fba4c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:36:39.068211 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614b27e-0fc5-44d8-a444-2da191fba4c4 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:36:39.092853 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1221/2423] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:36:39 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:36:39.097347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe1869-f980-45a0-83d6-7398fe6d0b40 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:36:39.108019 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe1869-f980-45a0-83d6-7398fe6d0b40 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:36:39.178448 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5eba3f-78a9-4150-b8a4-702a7a1c4c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:36:39.179917 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5eba3f-78a9-4150-b8a4-702a7a1c4c15 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:39.180200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5eba3f-78a9-4150-b8a4-702a7a1c4c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:39.180475 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5eba3f-78a9-4150-b8a4-702a7a1c4c15 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:39.181172 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5eba3f-78a9-4150-b8a4-702a7a1c4c15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:36:39.183172 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5eba3f-78a9-4150-b8a4-702a7a1c4c15 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:36:39.204650 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1203/2424] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:36:39 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:36:39.209389 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614b27e-0fc5-44d8-a444-2da191fba4c4 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:36:39.220176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614b27e-0fc5-44d8-a444-2da191fba4c4 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:36:39.224813 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ce361-9227-4a92-bd56-b73a374bd892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:36:39.225464 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ce361-9227-4a92-bd56-b73a374bd892 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:39.225755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ce361-9227-4a92-bd56-b73a374bd892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:39.226036 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ce361-9227-4a92-bd56-b73a374bd892 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:39.226791 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ce361-9227-4a92-bd56-b73a374bd892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:36:39.228392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ce361-9227-4a92-bd56-b73a374bd892 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:36:39.238733 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1222/2425] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:36:39.242891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5eba3f-78a9-4150-b8a4-702a7a1c4c15 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:36:39.253204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5eba3f-78a9-4150-b8a4-702a7a1c4c15 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:36:39.257777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7c5a3-b09d-4878-84c6-7912696f5eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:36:39.258429 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7c5a3-b09d-4878-84c6-7912696f5eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:39.258753 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7c5a3-b09d-4878-84c6-7912696f5eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:39.259036 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7c5a3-b09d-4878-84c6-7912696f5eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:39.259792 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7c5a3-b09d-4878-84c6-7912696f5eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:36:39.261403 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7c5a3-b09d-4878-84c6-7912696f5eb0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:36:39.271678 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1204/2426] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:36:39.275592 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ce361-9227-4a92-bd56-b73a374bd892 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:36:39.285311 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ce361-9227-4a92-bd56-b73a374bd892 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:36:39.289815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992350dc-eb1f-454f-b656-389031abd379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:36:39.290720 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992350dc-eb1f-454f-b656-389031abd379 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:39.291010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992350dc-eb1f-454f-b656-389031abd379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:39.291291 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992350dc-eb1f-454f-b656-389031abd379 admin admin] PATH_INFO: `/v3/projects/797b3861a8ab4f29ab0cd28e711aeb3e/users/776f8c38dc43442e9ec24d4e97c0152a/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:39.307995 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992350dc-eb1f-454f-b656-389031abd379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=797b3861a8ab4f29ab0cd28e711aeb3e, user_id=776f8c38dc43442e9ec24d4e97c0152a, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:36:39.310660 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992350dc-eb1f-454f-b656-389031abd379 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:36:39.324043 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1223/2427] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:36:39 2022] PUT /identity/v3/projects/797b3861a8ab4f29ab0cd28e711aeb3e/users/776f8c38dc43442e9ec24d4e97c0152a/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:36:39.329034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c1c30-4ed2-4792-b95f-ba07249828b0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:39.329516 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c1c30-4ed2-4792-b95f-ba07249828b0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:39.329631 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c1c30-4ed2-4792-b95f-ba07249828b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:39.347696 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-836c1c30-4ed2-4792-b95f-ba07249828b0 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:36:39.348886 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-836c1c30-4ed2-4792-b95f-ba07249828b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:36:39.410165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1205/2428] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:36:39.420633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992350dc-eb1f-454f-b656-389031abd379 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:36:39.422330 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-992350dc-eb1f-454f-b656-389031abd379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:36:39.437595 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:39.488079 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992350dc-eb1f-454f-b656-389031abd379 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:36:39.492228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8f60f-b716-4cdf-bff4-9863c8a5f144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:36:39.492875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8f60f-b716-4cdf-bff4-9863c8a5f144 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:39.493168 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8f60f-b716-4cdf-bff4-9863c8a5f144 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:39.493451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8f60f-b716-4cdf-bff4-9863c8a5f144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:39.503434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8f60f-b716-4cdf-bff4-9863c8a5f144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:36:39.504891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8f60f-b716-4cdf-bff4-9863c8a5f144 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:36:39.514470 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1224/2429] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:36:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:36:41.219745 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b370e9-3c7e-4a1a-9213-2377c3ec93f9 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:41.220366 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b370e9-3c7e-4a1a-9213-2377c3ec93f9 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:41.220569 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b370e9-3c7e-4a1a-9213-2377c3ec93f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:41.243742 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-85b370e9-3c7e-4a1a-9213-2377c3ec93f9 None None] MFA Rules not processed for user `261b8d67ef5847dc9117663de3f5c837`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:36:41.245113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-85b370e9-3c7e-4a1a-9213-2377c3ec93f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:36:41.356785 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1206/2430] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:36:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:36:44.334786 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532f29a-3cdb-41f4-9f85-4a431249ad7a None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:44.335223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532f29a-3cdb-41f4-9f85-4a431249ad7a None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:44.335691 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532f29a-3cdb-41f4-9f85-4a431249ad7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:44.369357 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-b532f29a-3cdb-41f4-9f85-4a431249ad7a None None] MFA Rules not processed for user `776f8c38dc43442e9ec24d4e97c0152a`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:36:44.371609 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-b532f29a-3cdb-41f4-9f85-4a431249ad7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:36:44.449833 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1225/2431] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:36:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:36:44.454340 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b370e9-3c7e-4a1a-9213-2377c3ec93f9 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:36:44.465945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b370e9-3c7e-4a1a-9213-2377c3ec93f9 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:36:44.470613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbef9e-4d6f-45bf-a3d6-4cee46a04626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:36:44.471341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbef9e-4d6f-45bf-a3d6-4cee46a04626 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:44.471649 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbef9e-4d6f-45bf-a3d6-4cee46a04626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:44.472110 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbef9e-4d6f-45bf-a3d6-4cee46a04626 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:44.472822 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbef9e-4d6f-45bf-a3d6-4cee46a04626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:36:44.474850 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbef9e-4d6f-45bf-a3d6-4cee46a04626 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:36:44.503853 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1207/2432] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:36:44 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:36:44.507932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532f29a-3cdb-41f4-9f85-4a431249ad7a None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:36:44.519843 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532f29a-3cdb-41f4-9f85-4a431249ad7a None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:36:44.582365 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca117883-5877-4008-829c-692fe674fb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:36:44.583169 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca117883-5877-4008-829c-692fe674fb5a admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:44.583460 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca117883-5877-4008-829c-692fe674fb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:44.583744 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca117883-5877-4008-829c-692fe674fb5a admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:44.584466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca117883-5877-4008-829c-692fe674fb5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:36:44.586413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca117883-5877-4008-829c-692fe674fb5a admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:36:44.606654 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1226/2433] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:36:44 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:36:44.610338 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbef9e-4d6f-45bf-a3d6-4cee46a04626 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:36:44.616362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:44.625097 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbef9e-4d6f-45bf-a3d6-4cee46a04626 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:36:44.631278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537904e8-52bc-4ba9-b0f7-7b863d208fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:36:44.632639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537904e8-52bc-4ba9-b0f7-7b863d208fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:44.632928 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537904e8-52bc-4ba9-b0f7-7b863d208fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:44.633264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537904e8-52bc-4ba9-b0f7-7b863d208fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:44.633996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537904e8-52bc-4ba9-b0f7-7b863d208fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:36:44.636342 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537904e8-52bc-4ba9-b0f7-7b863d208fa8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:36:44.647841 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1208/2434] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:36:44.651952 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca117883-5877-4008-829c-692fe674fb5a admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:36:44.661859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca117883-5877-4008-829c-692fe674fb5a admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:36:44.666384 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7a008-5ff3-4cf2-a57e-71e2981198f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:36:44.667287 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7a008-5ff3-4cf2-a57e-71e2981198f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:44.667571 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7a008-5ff3-4cf2-a57e-71e2981198f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:44.667847 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7a008-5ff3-4cf2-a57e-71e2981198f4 admin admin] PATH_INFO: `/v3/projects/565f8f5005ed4e84871b94ea9c91f97f/users/7cf232166d424ee0ae865129d6952fe9/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:44.684123 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7a008-5ff3-4cf2-a57e-71e2981198f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=565f8f5005ed4e84871b94ea9c91f97f, user_id=7cf232166d424ee0ae865129d6952fe9, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:36:44.687167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7a008-5ff3-4cf2-a57e-71e2981198f4 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:36:44.701025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1227/2435] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:36:44 2022] PUT /identity/v3/projects/565f8f5005ed4e84871b94ea9c91f97f/users/7cf232166d424ee0ae865129d6952fe9/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:36:44.704882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537904e8-52bc-4ba9-b0f7-7b863d208fa8 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:36:44.715681 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537904e8-52bc-4ba9-b0f7-7b863d208fa8 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:36:44.775014 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf5b22-22f5-4397-8363-792017bfd1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:36:44.775693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf5b22-22f5-4397-8363-792017bfd1bc admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:44.775986 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf5b22-22f5-4397-8363-792017bfd1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:44.776388 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf5b22-22f5-4397-8363-792017bfd1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:44.777283 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf5b22-22f5-4397-8363-792017bfd1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:36:44.779050 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf5b22-22f5-4397-8363-792017bfd1bc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:36:44.791379 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1209/2436] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:36:44.795298 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7a008-5ff3-4cf2-a57e-71e2981198f4 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:36:44.806764 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7a008-5ff3-4cf2-a57e-71e2981198f4 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:36:44.811497 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db0ee2-ac32-47f7-87fa-cf729f63f98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:36:44.812660 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db0ee2-ac32-47f7-87fa-cf729f63f98d admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:44.812980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db0ee2-ac32-47f7-87fa-cf729f63f98d admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:44.813261 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db0ee2-ac32-47f7-87fa-cf729f63f98d admin admin] PATH_INFO: `/v3/projects/565f8f5005ed4e84871b94ea9c91f97f/users/7cf232166d424ee0ae865129d6952fe9/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:44.816066 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db0ee2-ac32-47f7-87fa-cf729f63f98d admin admin] RBAC: Authorizing `identity:create_grant(project_id=565f8f5005ed4e84871b94ea9c91f97f, user_id=7cf232166d424ee0ae865129d6952fe9, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:36:44.818889 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db0ee2-ac32-47f7-87fa-cf729f63f98d admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:36:44.825429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:44.832206 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1228/2437] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:36:44 2022] PUT /identity/v3/projects/565f8f5005ed4e84871b94ea9c91f97f/users/7cf232166d424ee0ae865129d6952fe9/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:36:50.903813 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f19ab-38ef-4693-9716-84fc6bb4d82e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:50.904370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f19ab-38ef-4693-9716-84fc6bb4d82e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:50.904469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f19ab-38ef-4693-9716-84fc6bb4d82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:50.932456 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-248f19ab-38ef-4693-9716-84fc6bb4d82e None None] MFA Rules not processed for user `7cf232166d424ee0ae865129d6952fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:36:50.933640 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-248f19ab-38ef-4693-9716-84fc6bb4d82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:36:51.011022 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1210/2438] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:36:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:36:51.034969 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db0ee2-ac32-47f7-87fa-cf729f63f98d admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:36:51.040858 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-b2db0ee2-ac32-47f7-87fa-cf729f63f98d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:36:51.105821 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db0ee2-ac32-47f7-87fa-cf729f63f98d admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:36:51.109454 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f0855-a147-4e11-a545-cd4217f6fdff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ed824e419544b33a2c4413da4b45aaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:36:51.110116 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f0855-a147-4e11-a545-cd4217f6fdff service glance] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:51.110414 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f0855-a147-4e11-a545-cd4217f6fdff service glance] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:51.110727 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f0855-a147-4e11-a545-cd4217f6fdff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:51.177861 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f0855-a147-4e11-a545-cd4217f6fdff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:36:51.179369 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f0855-a147-4e11-a545-cd4217f6fdff service glance] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:36:51.194424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1229/2439] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:36:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:36:51.306613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc412d-dfed-4439-8619-d7bbfc02502a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:51.306886 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc412d-dfed-4439-8619-d7bbfc02502a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:51.307172 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc412d-dfed-4439-8619-d7bbfc02502a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:51.327471 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-93fc412d-dfed-4439-8619-d7bbfc02502a None None] MFA Rules not processed for user `eb30fc9bc5a04139b2a364ff03f4ad60`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:36:51.328921 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-93fc412d-dfed-4439-8619-d7bbfc02502a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:36:51.389718 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1211/2440] 10.222.0.25 () {58 vars in 1009 bytes} [Mon May 23 12:36:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:36:51.402479 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f0855-a147-4e11-a545-cd4217f6fdff service glance] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:36:51.404181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-446f0855-a147-4e11-a545-cd4217f6fdff service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:36:51.490015 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f0855-a147-4e11-a545-cd4217f6fdff service glance] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:36:51.500710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e4ce0-49db-4106-bb8b-72374074d276 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03ca1edc22174d258ddeda25407ee6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:36:51.501386 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e4ce0-49db-4106-bb8b-72374074d276 service swift] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:51.501681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e4ce0-49db-4106-bb8b-72374074d276 service swift] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:51.502789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e4ce0-49db-4106-bb8b-72374074d276 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:51.511940 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e4ce0-49db-4106-bb8b-72374074d276 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:36:51.513508 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e4ce0-49db-4106-bb8b-72374074d276 service swift] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:36:51.521404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1230/2441] 10.222.0.25 () {60 vars in 1384 bytes} [Mon May 23 12:36:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:36:57.054458 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62f2b1-4106-4f0d-8119-80b66032f8ba None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:36:57.056286 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62f2b1-4106-4f0d-8119-80b66032f8ba None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:36:57.056936 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62f2b1-4106-4f0d-8119-80b66032f8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:36:57.080752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-fa62f2b1-4106-4f0d-8119-80b66032f8ba None None] MFA Rules not processed for user `ce751e35d8184c809a942b4187e88cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:36:57.082437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fa62f2b1-4106-4f0d-8119-80b66032f8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:36:57.098316 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:36:57.158654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1212/2442] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:36:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:37:01.518194 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=81 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:01.898592 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de1121-58de-4466-8ca0-eee1bf262907 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:01.898983 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de1121-58de-4466-8ca0-eee1bf262907 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:01.899296 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de1121-58de-4466-8ca0-eee1bf262907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:01.917113 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-f4de1121-58de-4466-8ca0-eee1bf262907 None None] MFA Rules not processed for user `776f8c38dc43442e9ec24d4e97c0152a`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:37:01.918406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-f4de1121-58de-4466-8ca0-eee1bf262907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:37:01.926272 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1231/2443] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:37:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:37:03.694287 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a9cdb-5681-47a4-b347-a8a8be4c5d02 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:03.694868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a9cdb-5681-47a4-b347-a8a8be4c5d02 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:03.694997 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a9cdb-5681-47a4-b347-a8a8be4c5d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:03.712648 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-090a9cdb-5681-47a4-b347-a8a8be4c5d02 None None] MFA Rules not processed for user `eb30fc9bc5a04139b2a364ff03f4ad60`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:37:03.713862 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-090a9cdb-5681-47a4-b347-a8a8be4c5d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:37:03.722751 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1213/2444] 10.222.0.25 () {58 vars in 1009 bytes} [Mon May 23 12:37:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:37:03.734623 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de1121-58de-4466-8ca0-eee1bf262907 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:03.747152 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de1121-58de-4466-8ca0-eee1bf262907 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:03.752038 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42773fd-3c27-4952-921f-38eaeb2f0756 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03ca1edc22174d258ddeda25407ee6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:03.752682 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42773fd-3c27-4952-921f-38eaeb2f0756 service swift] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:03.752967 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42773fd-3c27-4952-921f-38eaeb2f0756 service swift] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:03.753245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42773fd-3c27-4952-921f-38eaeb2f0756 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:03.761715 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42773fd-3c27-4952-921f-38eaeb2f0756 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:03.763377 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42773fd-3c27-4952-921f-38eaeb2f0756 service swift] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:03.771693 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1232/2445] 10.222.0.25 () {60 vars in 1384 bytes} [Mon May 23 12:37:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 12:37:13.707319 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=20 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:13.768203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=9 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:28.209528 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a9cdb-5681-47a4-b347-a8a8be4c5d02 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:28.211355 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-090a9cdb-5681-47a4-b347-a8a8be4c5d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:37:28.294284 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a9cdb-5681-47a4-b347-a8a8be4c5d02 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:28.298876 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a2e17-31d4-4728-a9d3-6ba2cfd2ae83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:28.299525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a2e17-31d4-4728-a9d3-6ba2cfd2ae83 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:28.299971 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a2e17-31d4-4728-a9d3-6ba2cfd2ae83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:28.300293 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a2e17-31d4-4728-a9d3-6ba2cfd2ae83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:28.310691 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a2e17-31d4-4728-a9d3-6ba2cfd2ae83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:28.312160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a2e17-31d4-4728-a9d3-6ba2cfd2ae83 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:28.321901 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1214/2446] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:37:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:37:29.776430 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a3927-d46e-4b90-a0e5-76db7b64e18e None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:29.777278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a3927-d46e-4b90-a0e5-76db7b64e18e None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:29.777561 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a3927-d46e-4b90-a0e5-76db7b64e18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:29.798313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-212a3927-d46e-4b90-a0e5-76db7b64e18e None None] MFA Rules not processed for user `ae9ed5cec9cb45f58203e41048d8e09a`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:37:29.799562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-212a3927-d46e-4b90-a0e5-76db7b64e18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:37:29.856093 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1233/2447] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:37:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:37:38.317502 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=26 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:39.849390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=25 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:51.785556 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a2e17-31d4-4728-a9d3-6ba2cfd2ae83 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:51.787213 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-649a2e17-31d4-4728-a9d3-6ba2cfd2ae83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:37:51.856370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a2e17-31d4-4728-a9d3-6ba2cfd2ae83 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:51.862126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565798ee-dda2-4d19-bc40-ad5dfa61517f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:51.863033 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565798ee-dda2-4d19-bc40-ad5dfa61517f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:51.863324 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565798ee-dda2-4d19-bc40-ad5dfa61517f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:51.863597 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565798ee-dda2-4d19-bc40-ad5dfa61517f admin admin] PATH_INFO: `/v3/users/261b8d67ef5847dc9117663de3f5c837` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:51.864772 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565798ee-dda2-4d19-bc40-ad5dfa61517f admin admin] RBAC: Authorizing `identity:delete_user(user_id=261b8d67ef5847dc9117663de3f5c837)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:51.866730 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565798ee-dda2-4d19-bc40-ad5dfa61517f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:51.919120 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-565798ee-dda2-4d19-bc40-ad5dfa61517f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '261b8d67ef5847dc9117663de3f5c837'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:37:51.927195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-565798ee-dda2-4d19-bc40-ad5dfa61517f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '261b8d67ef5847dc9117663de3f5c837'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:37:51.927844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-565798ee-dda2-4d19-bc40-ad5dfa61517f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '261b8d67ef5847dc9117663de3f5c837'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:37:51.928465 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-565798ee-dda2-4d19-bc40-ad5dfa61517f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '261b8d67ef5847dc9117663de3f5c837'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:37:51.941007 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-565798ee-dda2-4d19-bc40-ad5dfa61517f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '261b8d67ef5847dc9117663de3f5c837'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:37:51.953439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1215/2448] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:37:51 2022] DELETE /identity/v3/users/261b8d67ef5847dc9117663de3f5c837 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:37:52.144044 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a3927-d46e-4b90-a0e5-76db7b64e18e None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:52.155979 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a3927-d46e-4b90-a0e5-76db7b64e18e None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:52.220169 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961326a-ab4a-4d92-b468-86628a7f7dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:52.221030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961326a-ab4a-4d92-b468-86628a7f7dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:52.221320 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961326a-ab4a-4d92-b468-86628a7f7dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:52.221603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961326a-ab4a-4d92-b468-86628a7f7dd3 admin admin] PATH_INFO: `/v3/projects/190b7fcba31e4f54bf934b874c90d1b1` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:52.222918 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961326a-ab4a-4d92-b468-86628a7f7dd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=190b7fcba31e4f54bf934b874c90d1b1)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:52.224881 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961326a-ab4a-4d92-b468-86628a7f7dd3 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:52.270008 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-1961326a-ab4a-4d92-b468-86628a7f7dd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '190b7fcba31e4f54bf934b874c90d1b1', 'request_id': 'req-1961326a-ab4a-4d92-b468-86628a7f7dd3'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:37:52.276115 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-1961326a-ab4a-4d92-b468-86628a7f7dd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '190b7fcba31e4f54bf934b874c90d1b1', 'request_id': 'req-1961326a-ab4a-4d92-b468-86628a7f7dd3'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:37:52.283559 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-1961326a-ab4a-4d92-b468-86628a7f7dd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '190b7fcba31e4f54bf934b874c90d1b1', 'request_id': 'req-1961326a-ab4a-4d92-b468-86628a7f7dd3'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:37:52.293718 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-1961326a-ab4a-4d92-b468-86628a7f7dd3 admin admin] The token cache is being invalidate because project 190b7fcba31e4f54bf934b874c90d1b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:37:52.294001 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-1961326a-ab4a-4d92-b468-86628a7f7dd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:37:52.294638 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-1961326a-ab4a-4d92-b468-86628a7f7dd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:37:52.296165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1234/2449] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:37:52 2022] DELETE /identity/v3/projects/190b7fcba31e4f54bf934b874c90d1b1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:37:52.301950 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896d09e-6703-46b6-a605-ba5e57b00f48 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:52.302180 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896d09e-6703-46b6-a605-ba5e57b00f48 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:52.302458 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896d09e-6703-46b6-a605-ba5e57b00f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:52.320433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c896d09e-6703-46b6-a605-ba5e57b00f48 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:37:52.321625 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c896d09e-6703-46b6-a605-ba5e57b00f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:37:52.379715 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1216/2450] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:37:52.387551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa441d8-c212-42af-9b9c-74465a92534c None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:52.387832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa441d8-c212-42af-9b9c-74465a92534c None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:52.388112 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa441d8-c212-42af-9b9c-74465a92534c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:52.407089 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-5aa441d8-c212-42af-9b9c-74465a92534c None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:37:52.408280 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-5aa441d8-c212-42af-9b9c-74465a92534c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:37:52.415960 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1235/2451] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:37:52.420005 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896d09e-6703-46b6-a605-ba5e57b00f48 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:52.429703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896d09e-6703-46b6-a605-ba5e57b00f48 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:52.434567 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3c20e-f34e-40e8-ba41-ebad4a0a9009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:52.435227 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3c20e-f34e-40e8-ba41-ebad4a0a9009 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:52.435514 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3c20e-f34e-40e8-ba41-ebad4a0a9009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:52.435792 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3c20e-f34e-40e8-ba41-ebad4a0a9009 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:52.436514 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3c20e-f34e-40e8-ba41-ebad4a0a9009 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:37:52.436825 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3c20e-f34e-40e8-ba41-ebad4a0a9009 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:52.438430 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3c20e-f34e-40e8-ba41-ebad4a0a9009 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:52.450140 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1217/2452] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:37:52.454664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa441d8-c212-42af-9b9c-74465a92534c None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:52.464406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa441d8-c212-42af-9b9c-74465a92534c None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:52.470021 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb94280-f526-44b3-ab91-6505a2895f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:52.470750 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb94280-f526-44b3-ab91-6505a2895f03 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:52.471059 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb94280-f526-44b3-ab91-6505a2895f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:52.471376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb94280-f526-44b3-ab91-6505a2895f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:52.472123 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb94280-f526-44b3-ab91-6505a2895f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:52.474273 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb94280-f526-44b3-ab91-6505a2895f03 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:52.500292 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1236/2453] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:37:52 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:37:52.504579 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3c20e-f34e-40e8-ba41-ebad4a0a9009 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:52.514995 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3c20e-f34e-40e8-ba41-ebad4a0a9009 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:52.518461 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:52.572160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f0c81-5bd6-49b4-ad3e-7a1e0cc6215d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:52.572744 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f0c81-5bd6-49b4-ad3e-7a1e0cc6215d admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:52.573027 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f0c81-5bd6-49b4-ad3e-7a1e0cc6215d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:52.573301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f0c81-5bd6-49b4-ad3e-7a1e0cc6215d admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:52.573992 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f0c81-5bd6-49b4-ad3e-7a1e0cc6215d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:52.575953 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f0c81-5bd6-49b4-ad3e-7a1e0cc6215d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:52.596636 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1218/2454] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:37:52 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:37:52.600635 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb94280-f526-44b3-ab91-6505a2895f03 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:52.611747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb94280-f526-44b3-ab91-6505a2895f03 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:52.616829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681af90-5c1a-4c71-a261-fa6714c7e1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:52.617542 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681af90-5c1a-4c71-a261-fa6714c7e1db admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:52.617854 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681af90-5c1a-4c71-a261-fa6714c7e1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:52.618159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681af90-5c1a-4c71-a261-fa6714c7e1db admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:52.618991 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681af90-5c1a-4c71-a261-fa6714c7e1db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:52.620772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681af90-5c1a-4c71-a261-fa6714c7e1db admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:52.632252 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1237/2455] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:37:52.636292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f0c81-5bd6-49b4-ad3e-7a1e0cc6215d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:52.646792 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f0c81-5bd6-49b4-ad3e-7a1e0cc6215d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:52.651374 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e12c24-23c4-4050-ba16-9e9a9707e7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:52.652025 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e12c24-23c4-4050-ba16-9e9a9707e7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:52.652320 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e12c24-23c4-4050-ba16-9e9a9707e7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:52.652662 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e12c24-23c4-4050-ba16-9e9a9707e7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:52.653394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e12c24-23c4-4050-ba16-9e9a9707e7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:52.655034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e12c24-23c4-4050-ba16-9e9a9707e7a8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:52.664691 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1219/2456] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:37:52.668655 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681af90-5c1a-4c71-a261-fa6714c7e1db admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:52.679258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681af90-5c1a-4c71-a261-fa6714c7e1db admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:52.684135 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67d8f9-b08d-4bac-b8cb-f5840d82fee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:52.685353 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67d8f9-b08d-4bac-b8cb-f5840d82fee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:52.685662 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67d8f9-b08d-4bac-b8cb-f5840d82fee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:52.686455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67d8f9-b08d-4bac-b8cb-f5840d82fee5 admin admin] PATH_INFO: `/v3/projects/712178a6d613429a85b8347dcae03916/users/b691b57ca26e4de4a47313a031fce203/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:52.701728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67d8f9-b08d-4bac-b8cb-f5840d82fee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=712178a6d613429a85b8347dcae03916, user_id=b691b57ca26e4de4a47313a031fce203, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:52.704791 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67d8f9-b08d-4bac-b8cb-f5840d82fee5 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:52.719153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1238/2457] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:37:52 2022] PUT /identity/v3/projects/712178a6d613429a85b8347dcae03916/users/b691b57ca26e4de4a47313a031fce203/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:37:52.724219 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9893a4-b3c4-415e-a675-dbc211e455ce None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:52.724517 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9893a4-b3c4-415e-a675-dbc211e455ce None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:52.724801 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9893a4-b3c4-415e-a675-dbc211e455ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:52.743180 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0b9893a4-b3c4-415e-a675-dbc211e455ce None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:37:52.744382 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0b9893a4-b3c4-415e-a675-dbc211e455ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:37:52.802615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1220/2458] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:37:52.812625 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67d8f9-b08d-4bac-b8cb-f5840d82fee5 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:52.814315 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-6e67d8f9-b08d-4bac-b8cb-f5840d82fee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:37:52.847257 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:37:52.875747 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67d8f9-b08d-4bac-b8cb-f5840d82fee5 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:52.879421 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c20524-b6f3-427d-a2bb-1468eb228ae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:52.880062 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c20524-b6f3-427d-a2bb-1468eb228ae3 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:52.880346 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c20524-b6f3-427d-a2bb-1468eb228ae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:52.880625 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c20524-b6f3-427d-a2bb-1468eb228ae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:52.890111 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c20524-b6f3-427d-a2bb-1468eb228ae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:52.891629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c20524-b6f3-427d-a2bb-1468eb228ae3 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:52.901229 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1239/2459] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:37:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:37:56.829536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4603aa-9fb7-4813-b945-f87c0ce60270 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:56.830083 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4603aa-9fb7-4813-b945-f87c0ce60270 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:56.830083 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4603aa-9fb7-4813-b945-f87c0ce60270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:56.866174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0d4603aa-9fb7-4813-b945-f87c0ce60270 None None] MFA Rules not processed for user `b691b57ca26e4de4a47313a031fce203`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:37:56.869360 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0d4603aa-9fb7-4813-b945-f87c0ce60270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:37:56.949251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1221/2460] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:37:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:37:56.968799 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c20524-b6f3-427d-a2bb-1468eb228ae3 service neutron] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:37:56.970910 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-29c20524-b6f3-427d-a2bb-1468eb228ae3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:37:57.054993 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c20524-b6f3-427d-a2bb-1468eb228ae3 service neutron] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:37:57.061289 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331e459-86c0-481d-b9a2-4d525dc14160 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:37:57.062153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331e459-86c0-481d-b9a2-4d525dc14160 service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:57.062441 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331e459-86c0-481d-b9a2-4d525dc14160 service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:57.062754 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331e459-86c0-481d-b9a2-4d525dc14160 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:57.071458 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331e459-86c0-481d-b9a2-4d525dc14160 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:37:57.073016 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331e459-86c0-481d-b9a2-4d525dc14160 service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:37:57.083884 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1240/2461] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:37:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:37:58.505190 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7540b-b60a-4e26-ad6a-c4cc451ea399 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:37:58.505731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7540b-b60a-4e26-ad6a-c4cc451ea399 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:37:58.505731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7540b-b60a-4e26-ad6a-c4cc451ea399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:37:58.523135 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-90e7540b-b60a-4e26-ad6a-c4cc451ea399 None None] MFA Rules not processed for user `b691b57ca26e4de4a47313a031fce203`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:37:58.524347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-90e7540b-b60a-4e26-ad6a-c4cc451ea399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:37:58.532220 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1222/2462] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:37:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:38:07.079115 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=48 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:08.518058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:13.265655 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331e459-86c0-481d-b9a2-4d525dc14160 service nova] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:38:13.267233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-2331e459-86c0-481d-b9a2-4d525dc14160 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:13.280087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331e459-86c0-481d-b9a2-4d525dc14160 service nova] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:38:13.284502 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d0b31-85f0-4265-8218-8a9a0ff8b887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:38:13.285145 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d0b31-85f0-4265-8218-8a9a0ff8b887 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:13.285434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d0b31-85f0-4265-8218-8a9a0ff8b887 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:13.285756 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d0b31-85f0-4265-8218-8a9a0ff8b887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:13.287490 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-f78d0b31-85f0-4265-8218-8a9a0ff8b887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:13.302829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d0b31-85f0-4265-8218-8a9a0ff8b887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:38:13.304276 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d0b31-85f0-4265-8218-8a9a0ff8b887 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:38:13.322832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1241/2463] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:38:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:38:13.683141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7540b-b60a-4e26-ad6a-c4cc451ea399 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:38:13.693631 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7540b-b60a-4e26-ad6a-c4cc451ea399 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:38:13.697168 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76d389-9109-4e8f-b275-1a9254fdc697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:38:13.697798 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76d389-9109-4e8f-b275-1a9254fdc697 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:13.698082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76d389-9109-4e8f-b275-1a9254fdc697 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:13.698358 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76d389-9109-4e8f-b275-1a9254fdc697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:13.700128 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3d76d389-9109-4e8f-b275-1a9254fdc697 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:13.713520 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76d389-9109-4e8f-b275-1a9254fdc697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:38:13.714995 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76d389-9109-4e8f-b275-1a9254fdc697 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:38:13.725529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1223/2464] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:38:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:38:20.360388 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c86478-72e3-46e8-a327-3736b1956a2c None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:20.360869 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c86478-72e3-46e8-a327-3736b1956a2c None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:20.361002 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c86478-72e3-46e8-a327-3736b1956a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:20.378671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-a8c86478-72e3-46e8-a327-3736b1956a2c None None] MFA Rules not processed for user `eb30fc9bc5a04139b2a364ff03f4ad60`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:38:20.379882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-a8c86478-72e3-46e8-a327-3736b1956a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:20.437078 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1242/2465] 10.222.0.25 () {58 vars in 1009 bytes} [Mon May 23 12:38:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:38:20.478037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76d389-9109-4e8f-b275-1a9254fdc697 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:38:20.479566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3d76d389-9109-4e8f-b275-1a9254fdc697 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:20.547866 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76d389-9109-4e8f-b275-1a9254fdc697 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:38:20.552781 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cc408-816c-4d85-8833-af68f6187dd3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03ca1edc22174d258ddeda25407ee6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:38:20.553414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cc408-816c-4d85-8833-af68f6187dd3 service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:20.553696 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cc408-816c-4d85-8833-af68f6187dd3 service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:20.553969 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cc408-816c-4d85-8833-af68f6187dd3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:20.562141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cc408-816c-4d85-8833-af68f6187dd3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:38:20.563773 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cc408-816c-4d85-8833-af68f6187dd3 service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:38:20.571714 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1224/2466] 10.222.0.25 () {60 vars in 1384 bytes} [Mon May 23 12:38:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:38:26.724518 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c86478-72e3-46e8-a327-3736b1956a2c None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:38:26.738725 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c86478-72e3-46e8-a327-3736b1956a2c None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:38:26.744783 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9bd62-ab95-4f07-bd31-860ccb5b51dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:38:26.745623 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9bd62-ab95-4f07-bd31-860ccb5b51dd service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:26.745912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9bd62-ab95-4f07-bd31-860ccb5b51dd service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:26.746195 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9bd62-ab95-4f07-bd31-860ccb5b51dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:26.748402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-3ff9bd62-ab95-4f07-bd31-860ccb5b51dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:26.818653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9bd62-ab95-4f07-bd31-860ccb5b51dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:38:26.820262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9bd62-ab95-4f07-bd31-860ccb5b51dd service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:38:26.830478 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1243/2467] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:38:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:38:28.859636 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cc408-816c-4d85-8833-af68f6187dd3 service swift] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:38:28.872686 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cc408-816c-4d85-8833-af68f6187dd3 service swift] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:38:28.877899 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c267e-8892-434e-8b0c-5e7421b331c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:38:28.878989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c267e-8892-434e-8b0c-5e7421b331c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:28.879282 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c267e-8892-434e-8b0c-5e7421b331c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:28.879563 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c267e-8892-434e-8b0c-5e7421b331c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:28.881444 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f63c267e-8892-434e-8b0c-5e7421b331c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:28.897297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c267e-8892-434e-8b0c-5e7421b331c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:38:28.898807 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c267e-8892-434e-8b0c-5e7421b331c8 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:38:28.913092 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1225/2468] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:38:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:38:31.271492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9bd62-ab95-4f07-bd31-860ccb5b51dd service nova] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:38:31.273084 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-3ff9bd62-ab95-4f07-bd31-860ccb5b51dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:31.338181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9bd62-ab95-4f07-bd31-860ccb5b51dd service nova] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:38:31.342748 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a2eed-1f6f-4f1e-8b14-8f787d1e8175 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:38:31.343570 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a2eed-1f6f-4f1e-8b14-8f787d1e8175 service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:31.343935 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a2eed-1f6f-4f1e-8b14-8f787d1e8175 service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:31.344290 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a2eed-1f6f-4f1e-8b14-8f787d1e8175 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:31.346315 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-567a2eed-1f6f-4f1e-8b14-8f787d1e8175 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:31.399771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:31.416903 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a2eed-1f6f-4f1e-8b14-8f787d1e8175 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:38:31.418522 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a2eed-1f6f-4f1e-8b14-8f787d1e8175 service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:38:31.428904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1244/2469] 10.222.0.25 () {60 vars in 1396 bytes} [Mon May 23 12:38:31 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:38:32.310486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c267e-8892-434e-8b0c-5e7421b331c8 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:38:32.311860 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f63c267e-8892-434e-8b0c-5e7421b331c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:32.380083 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c267e-8892-434e-8b0c-5e7421b331c8 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:38:32.385208 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f04ff5-3e2e-4864-8008-45c147c92187 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fde90ab1e0490ebb7cb514173d984e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:38:32.385843 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f04ff5-3e2e-4864-8008-45c147c92187 service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:32.386243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f04ff5-3e2e-4864-8008-45c147c92187 service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:32.386547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f04ff5-3e2e-4864-8008-45c147c92187 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:32.388296 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b9f04ff5-3e2e-4864-8008-45c147c92187 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:32.399953 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f04ff5-3e2e-4864-8008-45c147c92187 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:38:32.401534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f04ff5-3e2e-4864-8008-45c147c92187 service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:38:32.411882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1226/2470] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:38:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:38:36.161530 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254f0ce-b9de-479e-895a-87fd8657f001 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:36.162123 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254f0ce-b9de-479e-895a-87fd8657f001 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:36.162352 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254f0ce-b9de-479e-895a-87fd8657f001 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:36.164291 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1245/2471] 10.222.0.25 () {54 vars in 921 bytes} [Mon May 23 12:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:38:36.172735 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc9590-76ce-4518-af04-077c7f82e017 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:36.173234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc9590-76ce-4518-af04-077c7f82e017 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:36.173527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc9590-76ce-4518-af04-077c7f82e017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:36.196070 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-cdfc9590-76ce-4518-af04-077c7f82e017 None None] MFA Rules not processed for user `d49997b9108145b78eb4db1d8823bf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:38:36.197416 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cdfc9590-76ce-4518-af04-077c7f82e017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:36.208935 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1227/2472] 10.222.0.25 () {58 vars in 1018 bytes} [Mon May 23 12:38:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:38:36.224921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254f0ce-b9de-479e-895a-87fd8657f001 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:38:36.226963 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-8254f0ce-b9de-479e-895a-87fd8657f001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:36.307236 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254f0ce-b9de-479e-895a-87fd8657f001 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:38:36.313363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74732a0-b0be-41ab-8e89-59f846ce99f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ed824e419544b33a2c4413da4b45aaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:38:36.314026 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74732a0-b0be-41ab-8e89-59f846ce99f4 service glance] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:36.314312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74732a0-b0be-41ab-8e89-59f846ce99f4 service glance] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:36.314623 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74732a0-b0be-41ab-8e89-59f846ce99f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:36.326701 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74732a0-b0be-41ab-8e89-59f846ce99f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:38:36.328229 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74732a0-b0be-41ab-8e89-59f846ce99f4 service glance] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:38:36.340020 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1246/2473] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:38:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:38:36.414921 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4678d-fb87-4fef-871f-125e99f85315 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:36.415434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4678d-fb87-4fef-871f-125e99f85315 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:36.415950 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4678d-fb87-4fef-871f-125e99f85315 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:36.417955 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1228/2474] 10.222.0.25 () {54 vars in 921 bytes} [Mon May 23 12:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:38:36.423029 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a32da-3fa2-4b22-b4de-9c11787908a5 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:36.423304 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a32da-3fa2-4b22-b4de-9c11787908a5 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:36.423579 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a32da-3fa2-4b22-b4de-9c11787908a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:36.443762 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-999a32da-3fa2-4b22-b4de-9c11787908a5 None None] MFA Rules not processed for user `74674b52807742abb7e144bba3bb6e56`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:38:36.445274 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-999a32da-3fa2-4b22-b4de-9c11787908a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:36.453196 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1247/2475] 10.222.0.25 () {58 vars in 1018 bytes} [Mon May 23 12:38:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:38:36.468478 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4678d-fb87-4fef-871f-125e99f85315 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:38:36.480796 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4678d-fb87-4fef-871f-125e99f85315 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:38:36.485851 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b82233-4509-4623-91bb-853c3ba721c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:38:36.486549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b82233-4509-4623-91bb-853c3ba721c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:36.486839 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b82233-4509-4623-91bb-853c3ba721c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:36.487157 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b82233-4509-4623-91bb-853c3ba721c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:36.496349 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b82233-4509-4623-91bb-853c3ba721c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:38:36.498650 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b82233-4509-4623-91bb-853c3ba721c6 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:38:36.507372 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1229/2476] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:38:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:38:36.630471 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31078db4-d184-43fb-a437-8e09f320c339 None None] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:36.630810 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31078db4-d184-43fb-a437-8e09f320c339 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:36.631116 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31078db4-d184-43fb-a437-8e09f320c339 None None] PATH_INFO: `/` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:36.632640 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1248/2477] 10.222.0.25 () {54 vars in 921 bytes} [Mon May 23 12:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 12:38:36.637596 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d568f44-a556-4074-8c18-2448a458c031 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:36.637959 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d568f44-a556-4074-8c18-2448a458c031 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:36.638372 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d568f44-a556-4074-8c18-2448a458c031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:36.660746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9d568f44-a556-4074-8c18-2448a458c031 None None] MFA Rules not processed for user `d49997b9108145b78eb4db1d8823bf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:38:36.662162 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9d568f44-a556-4074-8c18-2448a458c031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:36.672747 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1230/2478] 10.222.0.25 () {58 vars in 1018 bytes} [Mon May 23 12:38:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:38:36.683988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31078db4-d184-43fb-a437-8e09f320c339 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:38:36.695868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31078db4-d184-43fb-a437-8e09f320c339 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:38:36.699491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924878f-19d6-4b5e-9cd8-8e06af1aef1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:38:36.700162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924878f-19d6-4b5e-9cd8-8e06af1aef1a service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:36.700450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924878f-19d6-4b5e-9cd8-8e06af1aef1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:36.700732 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924878f-19d6-4b5e-9cd8-8e06af1aef1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:36.711223 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924878f-19d6-4b5e-9cd8-8e06af1aef1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:38:36.712665 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924878f-19d6-4b5e-9cd8-8e06af1aef1a service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:38:36.724171 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1249/2479] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:38:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:38:40.939786 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d568f44-a556-4074-8c18-2448a458c031 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:38:40.941773 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9d568f44-a556-4074-8c18-2448a458c031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:40.952931 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:40.961097 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d568f44-a556-4074-8c18-2448a458c031 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:38:40.968955 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5a9f4-ff6c-4607-b03b-55204d2ec212 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:38:40.970713 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5a9f4-ff6c-4607-b03b-55204d2ec212 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:40.971276 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5a9f4-ff6c-4607-b03b-55204d2ec212 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:40.971830 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5a9f4-ff6c-4607-b03b-55204d2ec212 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:40.974459 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-edb5a9f4-ff6c-4607-b03b-55204d2ec212 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:40.992810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5a9f4-ff6c-4607-b03b-55204d2ec212 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:38:40.998279 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5a9f4-ff6c-4607-b03b-55204d2ec212 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:38:41.014278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1231/2480] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:38:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:38:41.127720 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3540c34-909d-44d8-add2-56af37250f3d None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:41.129014 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3540c34-909d-44d8-add2-56af37250f3d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:41.129583 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3540c34-909d-44d8-add2-56af37250f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:41.158182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-d3540c34-909d-44d8-add2-56af37250f3d None None] MFA Rules not processed for user `eb30fc9bc5a04139b2a364ff03f4ad60`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:38:41.160568 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-d3540c34-909d-44d8-add2-56af37250f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:41.167961 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1250/2481] 10.222.0.25 () {58 vars in 1009 bytes} [Mon May 23 12:38:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:38:41.181040 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5a9f4-ff6c-4607-b03b-55204d2ec212 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:38:41.193867 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5a9f4-ff6c-4607-b03b-55204d2ec212 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:38:41.199222 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fcd17-615c-46f4-9059-28abe2dfe8da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03ca1edc22174d258ddeda25407ee6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:38:41.200165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fcd17-615c-46f4-9059-28abe2dfe8da service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:41.200165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fcd17-615c-46f4-9059-28abe2dfe8da service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:41.200459 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fcd17-615c-46f4-9059-28abe2dfe8da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:41.209711 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fcd17-615c-46f4-9059-28abe2dfe8da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:38:41.211314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fcd17-615c-46f4-9059-28abe2dfe8da service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:38:41.220033 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1232/2482] 10.222.0.25 () {60 vars in 1384 bytes} [Mon May 23 12:38:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:38:51.150714 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=45 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:51.216143 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=11 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:38:54.903596 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3540c34-909d-44d8-add2-56af37250f3d None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:38:54.920878 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3540c34-909d-44d8-add2-56af37250f3d None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:38:54.925943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc87438-7a0b-4be3-9374-b0df5428335c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:38:54.926642 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc87438-7a0b-4be3-9374-b0df5428335c service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:54.926932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc87438-7a0b-4be3-9374-b0df5428335c service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:54.927212 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc87438-7a0b-4be3-9374-b0df5428335c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:54.929017 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-0bc87438-7a0b-4be3-9374-b0df5428335c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:54.943892 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc87438-7a0b-4be3-9374-b0df5428335c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:38:54.945502 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc87438-7a0b-4be3-9374-b0df5428335c service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:38:54.957121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1251/2483] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:38:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:38:55.927571 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fcd17-615c-46f4-9059-28abe2dfe8da service swift] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:38:55.937440 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fcd17-615c-46f4-9059-28abe2dfe8da service swift] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:38:55.941009 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a282fa-e3a3-40da-8a36-cd9c5e6676b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:38:55.941638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a282fa-e3a3-40da-8a36-cd9c5e6676b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:55.941922 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a282fa-e3a3-40da-8a36-cd9c5e6676b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:55.942200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a282fa-e3a3-40da-8a36-cd9c5e6676b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:55.943984 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c4a282fa-e3a3-40da-8a36-cd9c5e6676b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:55.956204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a282fa-e3a3-40da-8a36-cd9c5e6676b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:38:55.957636 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a282fa-e3a3-40da-8a36-cd9c5e6676b2 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:38:55.967247 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1233/2484] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:38:57.053815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b76e81-41b7-4b5e-b51f-414e68ab8a0f None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:57.054249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b76e81-41b7-4b5e-b51f-414e68ab8a0f None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:57.054345 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b76e81-41b7-4b5e-b51f-414e68ab8a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:57.073529 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-57b76e81-41b7-4b5e-b51f-414e68ab8a0f None None] MFA Rules not processed for user `eb30fc9bc5a04139b2a364ff03f4ad60`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:38:57.074843 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-57b76e81-41b7-4b5e-b51f-414e68ab8a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:57.084217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1252/2485] 10.222.0.25 () {58 vars in 967 bytes} [Mon May 23 12:38:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:38:57.098702 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a282fa-e3a3-40da-8a36-cd9c5e6676b2 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:38:57.113028 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a282fa-e3a3-40da-8a36-cd9c5e6676b2 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:38:57.120631 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aebe3d-6ea5-404f-9019-529458af59ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03ca1edc22174d258ddeda25407ee6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:38:57.121694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aebe3d-6ea5-404f-9019-529458af59ad service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:57.122175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aebe3d-6ea5-404f-9019-529458af59ad service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:57.122720 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aebe3d-6ea5-404f-9019-529458af59ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:57.132212 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aebe3d-6ea5-404f-9019-529458af59ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:38:57.133833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aebe3d-6ea5-404f-9019-529458af59ad service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:38:57.145091 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1234/2486] 10.222.0.25 () {60 vars in 1384 bytes} [Mon May 23 12:38:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:38:59.511597 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b76e81-41b7-4b5e-b51f-414e68ab8a0f None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:38:59.513660 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-57b76e81-41b7-4b5e-b51f-414e68ab8a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:38:59.531669 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b76e81-41b7-4b5e-b51f-414e68ab8a0f None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:38:59.536511 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a75a78-63c2-4018-9526-5452e0e3cf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:38:59.537405 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a75a78-63c2-4018-9526-5452e0e3cf94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:59.537694 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a75a78-63c2-4018-9526-5452e0e3cf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:59.537991 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a75a78-63c2-4018-9526-5452e0e3cf94 admin admin] PATH_INFO: `/v3/users/ae9ed5cec9cb45f58203e41048d8e09a` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:59.539417 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a75a78-63c2-4018-9526-5452e0e3cf94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae9ed5cec9cb45f58203e41048d8e09a)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:38:59.541571 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a75a78-63c2-4018-9526-5452e0e3cf94 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:38:59.598717 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-f0a75a78-63c2-4018-9526-5452e0e3cf94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae9ed5cec9cb45f58203e41048d8e09a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:38:59.606449 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-f0a75a78-63c2-4018-9526-5452e0e3cf94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae9ed5cec9cb45f58203e41048d8e09a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:38:59.618523 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-f0a75a78-63c2-4018-9526-5452e0e3cf94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae9ed5cec9cb45f58203e41048d8e09a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:38:59.626072 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-f0a75a78-63c2-4018-9526-5452e0e3cf94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae9ed5cec9cb45f58203e41048d8e09a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:38:59.626803 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-f0a75a78-63c2-4018-9526-5452e0e3cf94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae9ed5cec9cb45f58203e41048d8e09a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:38:59.633957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1253/2487] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:38:59 2022] DELETE /identity/v3/users/ae9ed5cec9cb45f58203e41048d8e09a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:38:59.814616 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aebe3d-6ea5-404f-9019-529458af59ad service swift] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:38:59.827204 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aebe3d-6ea5-404f-9019-529458af59ad service swift] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:38:59.883175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d33110-9dd3-4e2b-aaac-bfb5617b626b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:38:59.884031 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d33110-9dd3-4e2b-aaac-bfb5617b626b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:59.884312 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d33110-9dd3-4e2b-aaac-bfb5617b626b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:59.884585 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d33110-9dd3-4e2b-aaac-bfb5617b626b admin admin] PATH_INFO: `/v3/projects/cc4c35e61aa244e78dbb0c254b77fda6` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:59.885752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d33110-9dd3-4e2b-aaac-bfb5617b626b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc4c35e61aa244e78dbb0c254b77fda6)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:38:59.887813 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d33110-9dd3-4e2b-aaac-bfb5617b626b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:38:59.933339 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c0d33110-9dd3-4e2b-aaac-bfb5617b626b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc4c35e61aa244e78dbb0c254b77fda6', 'request_id': 'req-c0d33110-9dd3-4e2b-aaac-bfb5617b626b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:38:59.940900 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c0d33110-9dd3-4e2b-aaac-bfb5617b626b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc4c35e61aa244e78dbb0c254b77fda6', 'request_id': 'req-c0d33110-9dd3-4e2b-aaac-bfb5617b626b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:38:59.946398 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c0d33110-9dd3-4e2b-aaac-bfb5617b626b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc4c35e61aa244e78dbb0c254b77fda6', 'request_id': 'req-c0d33110-9dd3-4e2b-aaac-bfb5617b626b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:38:59.958611 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c0d33110-9dd3-4e2b-aaac-bfb5617b626b admin admin] The token cache is being invalidate because project cc4c35e61aa244e78dbb0c254b77fda6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:38:59.958903 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c0d33110-9dd3-4e2b-aaac-bfb5617b626b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:38:59.959522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c0d33110-9dd3-4e2b-aaac-bfb5617b626b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:38:59.961058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1235/2488] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:38:59 2022] DELETE /identity/v3/projects/cc4c35e61aa244e78dbb0c254b77fda6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:38:59.966309 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534dd502-e102-4f8e-af0c-5751a15432ac None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:38:59.966635 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534dd502-e102-4f8e-af0c-5751a15432ac None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:38:59.966917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534dd502-e102-4f8e-af0c-5751a15432ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:38:59.985313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-534dd502-e102-4f8e-af0c-5751a15432ac None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:38:59.986546 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-534dd502-e102-4f8e-af0c-5751a15432ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:00.045210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1254/2489] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:00.053439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2408c3-8a72-46b8-b43e-2e7b3f9a72b3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:00.053806 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2408c3-8a72-46b8-b43e-2e7b3f9a72b3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:00.054188 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2408c3-8a72-46b8-b43e-2e7b3f9a72b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:00.073252 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-bd2408c3-8a72-46b8-b43e-2e7b3f9a72b3 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:00.074452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bd2408c3-8a72-46b8-b43e-2e7b3f9a72b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:00.082760 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1236/2490] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:00.086693 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534dd502-e102-4f8e-af0c-5751a15432ac None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:00.096736 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534dd502-e102-4f8e-af0c-5751a15432ac None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:00.101165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4170acc-0f97-40c0-9f42-1960bb597aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:00.101804 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4170acc-0f97-40c0-9f42-1960bb597aec admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:00.102089 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4170acc-0f97-40c0-9f42-1960bb597aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:00.102365 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4170acc-0f97-40c0-9f42-1960bb597aec admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:00.103128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4170acc-0f97-40c0-9f42-1960bb597aec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:39:00.103434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4170acc-0f97-40c0-9f42-1960bb597aec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:00.105018 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4170acc-0f97-40c0-9f42-1960bb597aec admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:00.116369 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1255/2491] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:39:00.120531 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2408c3-8a72-46b8-b43e-2e7b3f9a72b3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:00.129833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2408c3-8a72-46b8-b43e-2e7b3f9a72b3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:00.134755 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e057c-1791-43a8-8fd0-87cd58ab2fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:00.135399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e057c-1791-43a8-8fd0-87cd58ab2fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:00.135687 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e057c-1791-43a8-8fd0-87cd58ab2fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:00.135967 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e057c-1791-43a8-8fd0-87cd58ab2fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:00.136661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e057c-1791-43a8-8fd0-87cd58ab2fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:00.139151 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e057c-1791-43a8-8fd0-87cd58ab2fc6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:00.174225 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1237/2492] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:39:00 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:39:00.178390 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4170acc-0f97-40c0-9f42-1960bb597aec admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:00.188730 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4170acc-0f97-40c0-9f42-1960bb597aec admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:00.228379 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:00.248396 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadb935-e4fe-4082-ab94-6e719277ab1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:00.249065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadb935-e4fe-4082-ab94-6e719277ab1f admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:00.249357 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadb935-e4fe-4082-ab94-6e719277ab1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:00.249643 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadb935-e4fe-4082-ab94-6e719277ab1f admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:00.250326 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aadb935-e4fe-4082-ab94-6e719277ab1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:00.252289 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aadb935-e4fe-4082-ab94-6e719277ab1f admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:00.271551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1256/2493] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:39:00 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:39:00.275609 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e057c-1791-43a8-8fd0-87cd58ab2fc6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:00.285961 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e057c-1791-43a8-8fd0-87cd58ab2fc6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:00.290607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362d455-0fa4-4af6-bed7-6b0a5a3158f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:00.291273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362d455-0fa4-4af6-bed7-6b0a5a3158f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:00.291557 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362d455-0fa4-4af6-bed7-6b0a5a3158f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:00.291834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362d455-0fa4-4af6-bed7-6b0a5a3158f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:00.292736 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362d455-0fa4-4af6-bed7-6b0a5a3158f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:00.294942 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362d455-0fa4-4af6-bed7-6b0a5a3158f7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:00.306030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1238/2494] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:00.310859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadb935-e4fe-4082-ab94-6e719277ab1f admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:00.320912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadb935-e4fe-4082-ab94-6e719277ab1f admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:00.326129 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daad8e1-bf08-42fc-8966-d5241449a5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:00.326827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daad8e1-bf08-42fc-8966-d5241449a5bb admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:00.327117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daad8e1-bf08-42fc-8966-d5241449a5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:00.327397 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daad8e1-bf08-42fc-8966-d5241449a5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:00.328119 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daad8e1-bf08-42fc-8966-d5241449a5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:00.329713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daad8e1-bf08-42fc-8966-d5241449a5bb admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:00.339432 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1257/2495] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:00.343419 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362d455-0fa4-4af6-bed7-6b0a5a3158f7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:00.353203 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362d455-0fa4-4af6-bed7-6b0a5a3158f7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:00.358751 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d85f95-c57b-4a4b-a86a-b1f147e9fe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:00.359631 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d85f95-c57b-4a4b-a86a-b1f147e9fe11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:00.359919 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d85f95-c57b-4a4b-a86a-b1f147e9fe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:00.360198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d85f95-c57b-4a4b-a86a-b1f147e9fe11 admin admin] PATH_INFO: `/v3/projects/04b27d18e63e47f5b674bd548d81f5ca/users/68c653a579cc4409b5006582feec8906/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:00.375128 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d85f95-c57b-4a4b-a86a-b1f147e9fe11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b27d18e63e47f5b674bd548d81f5ca, user_id=68c653a579cc4409b5006582feec8906, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:00.377796 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d85f95-c57b-4a4b-a86a-b1f147e9fe11 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:00.386459 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:00.392000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1239/2496] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:39:00 2022] PUT /identity/v3/projects/04b27d18e63e47f5b674bd548d81f5ca/users/68c653a579cc4409b5006582feec8906/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:00.402440 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d539006-244d-4c3d-80c8-81ac6d72bb61 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:00.403362 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d539006-244d-4c3d-80c8-81ac6d72bb61 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:00.403643 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d539006-244d-4c3d-80c8-81ac6d72bb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:00.430999 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-4d539006-244d-4c3d-80c8-81ac6d72bb61 None None] MFA Rules not processed for user `68c653a579cc4409b5006582feec8906`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:00.432455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-4d539006-244d-4c3d-80c8-81ac6d72bb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:00.498890 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1258/2497] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:00.504142 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d85f95-c57b-4a4b-a86a-b1f147e9fe11 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:00.566737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d85f95-c57b-4a4b-a86a-b1f147e9fe11 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:00.571438 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad9f4b-394f-4637-be70-a0ac5791767c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:00.572100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad9f4b-394f-4637-be70-a0ac5791767c admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:00.572390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad9f4b-394f-4637-be70-a0ac5791767c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:00.572670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad9f4b-394f-4637-be70-a0ac5791767c admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:00.573373 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad9f4b-394f-4637-be70-a0ac5791767c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:00.575947 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad9f4b-394f-4637-be70-a0ac5791767c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:00.603094 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1240/2498] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:39:00 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:39:00.606917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d539006-244d-4c3d-80c8-81ac6d72bb61 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:00.618121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d539006-244d-4c3d-80c8-81ac6d72bb61 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:00.678677 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef5aa2-ccf0-43ef-b07e-87af9108d6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:00.679449 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef5aa2-ccf0-43ef-b07e-87af9108d6d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:00.679739 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef5aa2-ccf0-43ef-b07e-87af9108d6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:00.680023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef5aa2-ccf0-43ef-b07e-87af9108d6d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:00.680723 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef5aa2-ccf0-43ef-b07e-87af9108d6d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:00.683011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef5aa2-ccf0-43ef-b07e-87af9108d6d7 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:00.703147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1259/2499] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:39:00 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:39:00.706738 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad9f4b-394f-4637-be70-a0ac5791767c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:00.719147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad9f4b-394f-4637-be70-a0ac5791767c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:00.724058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb51536-5a25-45a0-96b9-662934c96c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:00.724789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb51536-5a25-45a0-96b9-662934c96c81 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:00.725171 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb51536-5a25-45a0-96b9-662934c96c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:00.725534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb51536-5a25-45a0-96b9-662934c96c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:00.726103 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb51536-5a25-45a0-96b9-662934c96c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:00.727775 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb51536-5a25-45a0-96b9-662934c96c81 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:00.739617 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1241/2500] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:00.743476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef5aa2-ccf0-43ef-b07e-87af9108d6d7 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:00.753731 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef5aa2-ccf0-43ef-b07e-87af9108d6d7 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:00.758311 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed6eee-0fa4-407c-b43e-5d374b41d097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:00.759620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed6eee-0fa4-407c-b43e-5d374b41d097 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:00.759910 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed6eee-0fa4-407c-b43e-5d374b41d097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:00.760190 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed6eee-0fa4-407c-b43e-5d374b41d097 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:00.760917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed6eee-0fa4-407c-b43e-5d374b41d097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:00.763078 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed6eee-0fa4-407c-b43e-5d374b41d097 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:00.773148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1260/2501] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:00.777258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb51536-5a25-45a0-96b9-662934c96c81 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:00.788046 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb51536-5a25-45a0-96b9-662934c96c81 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:00.800126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbabea-00e9-4601-b60a-2341536b1fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:00.801028 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbabea-00e9-4601-b60a-2341536b1fae admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:00.801315 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbabea-00e9-4601-b60a-2341536b1fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:00.801596 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbabea-00e9-4601-b60a-2341536b1fae admin admin] PATH_INFO: `/v3/projects/71176677d6ac4aa2a5dc6939a8d543ef/users/ef5fed936d95430eaac9f526a3b2cd56/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:00.817680 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfbabea-00e9-4601-b60a-2341536b1fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=71176677d6ac4aa2a5dc6939a8d543ef, user_id=ef5fed936d95430eaac9f526a3b2cd56, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:00.820352 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfbabea-00e9-4601-b60a-2341536b1fae admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:00.833278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1242/2502] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:39:00 2022] PUT /identity/v3/projects/71176677d6ac4aa2a5dc6939a8d543ef/users/ef5fed936d95430eaac9f526a3b2cd56/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:00.844085 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4df59-8881-47ab-930b-6afc00e4a341 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:00.844385 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4df59-8881-47ab-930b-6afc00e4a341 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:00.844671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4df59-8881-47ab-930b-6afc00e4a341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:00.870476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-5cc4df59-8881-47ab-930b-6afc00e4a341 None None] MFA Rules not processed for user `ef5fed936d95430eaac9f526a3b2cd56`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:00.871752 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-5cc4df59-8881-47ab-930b-6afc00e4a341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:00.884304 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:00.936736 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1261/2503] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:00.941196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbabea-00e9-4601-b60a-2341536b1fae admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:01.001365 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbabea-00e9-4601-b60a-2341536b1fae admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:01.005952 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac8a9a-9361-4b88-9595-7e89182bed2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:01.006621 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac8a9a-9361-4b88-9595-7e89182bed2e admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:01.006909 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac8a9a-9361-4b88-9595-7e89182bed2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:01.007193 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac8a9a-9361-4b88-9595-7e89182bed2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:01.007878 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac8a9a-9361-4b88-9595-7e89182bed2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:01.009789 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac8a9a-9361-4b88-9595-7e89182bed2e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:01.033870 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1243/2504] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:39:00 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:39:01.037985 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4df59-8881-47ab-930b-6afc00e4a341 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:01.049229 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4df59-8881-47ab-930b-6afc00e4a341 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:01.104496 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e210a09-8769-4479-b619-1e44b5f6216c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:01.105154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e210a09-8769-4479-b619-1e44b5f6216c admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:01.105441 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e210a09-8769-4479-b619-1e44b5f6216c admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:01.106244 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e210a09-8769-4479-b619-1e44b5f6216c admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:01.106966 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e210a09-8769-4479-b619-1e44b5f6216c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:01.108894 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e210a09-8769-4479-b619-1e44b5f6216c admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:01.129948 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1262/2505] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:39:01 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:39:01.133900 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac8a9a-9361-4b88-9595-7e89182bed2e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:01.144214 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac8a9a-9361-4b88-9595-7e89182bed2e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:01.148873 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387a082-3345-4053-bc3e-073ac43b46c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:01.149527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387a082-3345-4053-bc3e-073ac43b46c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:01.149818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387a082-3345-4053-bc3e-073ac43b46c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:01.150098 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387a082-3345-4053-bc3e-073ac43b46c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:01.150862 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387a082-3345-4053-bc3e-073ac43b46c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:01.152480 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387a082-3345-4053-bc3e-073ac43b46c5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:01.163781 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1244/2506] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:01.167616 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e210a09-8769-4479-b619-1e44b5f6216c admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:01.178079 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e210a09-8769-4479-b619-1e44b5f6216c admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:01.182984 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68c56a-55e5-4d83-ab08-b034daa9552e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:01.183872 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68c56a-55e5-4d83-ab08-b034daa9552e admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:01.184159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68c56a-55e5-4d83-ab08-b034daa9552e admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:01.184440 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68c56a-55e5-4d83-ab08-b034daa9552e admin admin] PATH_INFO: `/v3/projects/985b9d3ad26b41a6a17b4e208b540fe6/users/b0d170fbafdd4bbdbadd0a14a4b8a58a/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:01.199221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68c56a-55e5-4d83-ab08-b034daa9552e admin admin] RBAC: Authorizing `identity:create_grant(project_id=985b9d3ad26b41a6a17b4e208b540fe6, user_id=b0d170fbafdd4bbdbadd0a14a4b8a58a, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:01.201988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68c56a-55e5-4d83-ab08-b034daa9552e admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:01.214393 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1263/2507] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:39:01 2022] PUT /identity/v3/projects/985b9d3ad26b41a6a17b4e208b540fe6/users/b0d170fbafdd4bbdbadd0a14a4b8a58a/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:01.219098 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387a082-3345-4053-bc3e-073ac43b46c5 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:01.228780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387a082-3345-4053-bc3e-073ac43b46c5 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:01.248274 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:01.285622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df8025-ea97-4fdf-a26a-bd8dcd4dd8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:01.286219 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df8025-ea97-4fdf-a26a-bd8dcd4dd8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:01.286530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df8025-ea97-4fdf-a26a-bd8dcd4dd8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:01.286824 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df8025-ea97-4fdf-a26a-bd8dcd4dd8a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:01.287555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df8025-ea97-4fdf-a26a-bd8dcd4dd8a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:01.289172 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df8025-ea97-4fdf-a26a-bd8dcd4dd8a6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:01.299662 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1245/2508] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:01.303777 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68c56a-55e5-4d83-ab08-b034daa9552e admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:01.314376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68c56a-55e5-4d83-ab08-b034daa9552e admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:01.318984 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cca26-6cc1-431d-a281-0f59cb43d512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:01.319887 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cca26-6cc1-431d-a281-0f59cb43d512 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:01.320174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cca26-6cc1-431d-a281-0f59cb43d512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:01.320455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cca26-6cc1-431d-a281-0f59cb43d512 admin admin] PATH_INFO: `/v3/projects/985b9d3ad26b41a6a17b4e208b540fe6/users/b0d170fbafdd4bbdbadd0a14a4b8a58a/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:01.322434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72cca26-6cc1-431d-a281-0f59cb43d512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=985b9d3ad26b41a6a17b4e208b540fe6, user_id=b0d170fbafdd4bbdbadd0a14a4b8a58a, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:01.325115 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72cca26-6cc1-431d-a281-0f59cb43d512 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:01.335348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1264/2509] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:39:01 2022] PUT /identity/v3/projects/985b9d3ad26b41a6a17b4e208b540fe6/users/b0d170fbafdd4bbdbadd0a14a4b8a58a/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:01.347181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a9fd8-5ce7-4ac1-a743-5f1bba544d2a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:01.347479 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a9fd8-5ce7-4ac1-a743-5f1bba544d2a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:01.347763 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a9fd8-5ce7-4ac1-a743-5f1bba544d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:01.374182 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-172a9fd8-5ce7-4ac1-a743-5f1bba544d2a None None] MFA Rules not processed for user `b0d170fbafdd4bbdbadd0a14a4b8a58a`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:01.375447 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-172a9fd8-5ce7-4ac1-a743-5f1bba544d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:01.445006 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1246/2510] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:01.456249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cca26-6cc1-431d-a281-0f59cb43d512 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:01.457959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e72cca26-6cc1-431d-a281-0f59cb43d512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:01.515854 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cca26-6cc1-431d-a281-0f59cb43d512 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:01.519518 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f2a33-daa1-44e5-b0bb-481a6197a611 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:01.520153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f2a33-daa1-44e5-b0bb-481a6197a611 service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:01.520438 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f2a33-daa1-44e5-b0bb-481a6197a611 service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:01.520715 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f2a33-daa1-44e5-b0bb-481a6197a611 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:01.530059 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f2a33-daa1-44e5-b0bb-481a6197a611 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:01.531518 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f2a33-daa1-44e5-b0bb-481a6197a611 service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:01.540779 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1265/2511] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:39:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:01.584544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a9fd8-5ce7-4ac1-a743-5f1bba544d2a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:01.585927 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-172a9fd8-5ce7-4ac1-a743-5f1bba544d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:01.598259 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a9fd8-5ce7-4ac1-a743-5f1bba544d2a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:01.601847 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35291e80-2bb4-4fdd-9283-b189b383775f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:01.602482 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35291e80-2bb4-4fdd-9283-b189b383775f service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:01.602797 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35291e80-2bb4-4fdd-9283-b189b383775f service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:01.603076 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35291e80-2bb4-4fdd-9283-b189b383775f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:01.660645 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35291e80-2bb4-4fdd-9283-b189b383775f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:01.662099 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35291e80-2bb4-4fdd-9283-b189b383775f service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:01.671055 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1247/2512] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:39:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:04.528416 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f2a33-daa1-44e5-b0bb-481a6197a611 service cinder] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:04.542084 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:04.593648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f2a33-daa1-44e5-b0bb-481a6197a611 service cinder] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:04.598210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5296b-46e2-4540-9a6b-25044738ddc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:04.599108 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5296b-46e2-4540-9a6b-25044738ddc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:04.599400 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5296b-46e2-4540-9a6b-25044738ddc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:04.599679 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5296b-46e2-4540-9a6b-25044738ddc0 admin admin] PATH_INFO: `/v3/users/68c653a579cc4409b5006582feec8906` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:04.600850 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5296b-46e2-4540-9a6b-25044738ddc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68c653a579cc4409b5006582feec8906)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:04.602796 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5296b-46e2-4540-9a6b-25044738ddc0 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:04.648462 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-68d5296b-46e2-4540-9a6b-25044738ddc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68c653a579cc4409b5006582feec8906'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:04.655520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-68d5296b-46e2-4540-9a6b-25044738ddc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68c653a579cc4409b5006582feec8906'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:04.667444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-68d5296b-46e2-4540-9a6b-25044738ddc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68c653a579cc4409b5006582feec8906'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:04.674942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-68d5296b-46e2-4540-9a6b-25044738ddc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68c653a579cc4409b5006582feec8906'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:04.675563 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-68d5296b-46e2-4540-9a6b-25044738ddc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68c653a579cc4409b5006582feec8906'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:04.682060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1266/2513] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:39:04 2022] DELETE /identity/v3/users/68c653a579cc4409b5006582feec8906 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:04.687071 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620bacb-206b-47f5-9468-c4ee232045f7 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:04.687566 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620bacb-206b-47f5-9468-c4ee232045f7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:04.687684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620bacb-206b-47f5-9468-c4ee232045f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:04.704750 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3620bacb-206b-47f5-9468-c4ee232045f7 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:04.705896 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3620bacb-206b-47f5-9468-c4ee232045f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:04.745657 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:04.764980 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1248/2514] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:04.774437 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5296b-46e2-4540-9a6b-25044738ddc0 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:04.775873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-68d5296b-46e2-4540-9a6b-25044738ddc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:04.832837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5296b-46e2-4540-9a6b-25044738ddc0 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:04.836401 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758a82b-0f03-4626-ba23-7352e3d0cd17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:04.837035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758a82b-0f03-4626-ba23-7352e3d0cd17 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:04.837322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758a82b-0f03-4626-ba23-7352e3d0cd17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:04.837601 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758a82b-0f03-4626-ba23-7352e3d0cd17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:04.846418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758a82b-0f03-4626-ba23-7352e3d0cd17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:04.847881 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758a82b-0f03-4626-ba23-7352e3d0cd17 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:04.857990 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1267/2515] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:05.118266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620bacb-206b-47f5-9468-c4ee232045f7 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:05.120096 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3620bacb-206b-47f5-9468-c4ee232045f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:05.134299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620bacb-206b-47f5-9468-c4ee232045f7 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:05.139915 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae519837-83bb-4db7-b3b9-5f6ee345356c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:05.140775 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae519837-83bb-4db7-b3b9-5f6ee345356c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:05.141094 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae519837-83bb-4db7-b3b9-5f6ee345356c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:05.141372 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae519837-83bb-4db7-b3b9-5f6ee345356c admin admin] PATH_INFO: `/v3/projects/04b27d18e63e47f5b674bd548d81f5ca` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:05.142610 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae519837-83bb-4db7-b3b9-5f6ee345356c admin admin] RBAC: Authorizing `identity:delete_project(project_id=04b27d18e63e47f5b674bd548d81f5ca)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:05.144536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae519837-83bb-4db7-b3b9-5f6ee345356c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:05.194186 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ae519837-83bb-4db7-b3b9-5f6ee345356c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04b27d18e63e47f5b674bd548d81f5ca', 'request_id': 'req-ae519837-83bb-4db7-b3b9-5f6ee345356c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:05.200418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ae519837-83bb-4db7-b3b9-5f6ee345356c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04b27d18e63e47f5b674bd548d81f5ca', 'request_id': 'req-ae519837-83bb-4db7-b3b9-5f6ee345356c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:05.205938 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ae519837-83bb-4db7-b3b9-5f6ee345356c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04b27d18e63e47f5b674bd548d81f5ca', 'request_id': 'req-ae519837-83bb-4db7-b3b9-5f6ee345356c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:05.218574 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ae519837-83bb-4db7-b3b9-5f6ee345356c admin admin] The token cache is being invalidate because project 04b27d18e63e47f5b674bd548d81f5ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:39:05.218864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ae519837-83bb-4db7-b3b9-5f6ee345356c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:05.219500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ae519837-83bb-4db7-b3b9-5f6ee345356c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:05.221020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1249/2516] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:39:05 2022] DELETE /identity/v3/projects/04b27d18e63e47f5b674bd548d81f5ca => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:05.225005 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758a82b-0f03-4626-ba23-7352e3d0cd17 service neutron] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:05.235072 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758a82b-0f03-4626-ba23-7352e3d0cd17 service neutron] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:05.265614 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:05.293392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273868d-62ee-4b71-b4aa-4b708f47014a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:05.294273 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273868d-62ee-4b71-b4aa-4b708f47014a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:05.294595 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273868d-62ee-4b71-b4aa-4b708f47014a admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:05.294885 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273868d-62ee-4b71-b4aa-4b708f47014a admin admin] PATH_INFO: `/v3/users/ef5fed936d95430eaac9f526a3b2cd56` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:05.296166 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273868d-62ee-4b71-b4aa-4b708f47014a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef5fed936d95430eaac9f526a3b2cd56)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:05.298073 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273868d-62ee-4b71-b4aa-4b708f47014a admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:05.348528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-5273868d-62ee-4b71-b4aa-4b708f47014a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef5fed936d95430eaac9f526a3b2cd56'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:05.356831 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-5273868d-62ee-4b71-b4aa-4b708f47014a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef5fed936d95430eaac9f526a3b2cd56'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:05.369876 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-5273868d-62ee-4b71-b4aa-4b708f47014a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef5fed936d95430eaac9f526a3b2cd56'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:05.379297 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-5273868d-62ee-4b71-b4aa-4b708f47014a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef5fed936d95430eaac9f526a3b2cd56'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:05.380035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-5273868d-62ee-4b71-b4aa-4b708f47014a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef5fed936d95430eaac9f526a3b2cd56'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:05.386039 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1268/2517] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:39:05 2022] DELETE /identity/v3/users/ef5fed936d95430eaac9f526a3b2cd56 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:05.650440 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae519837-83bb-4db7-b3b9-5f6ee345356c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:05.651919 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ae519837-83bb-4db7-b3b9-5f6ee345356c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:05.666915 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae519837-83bb-4db7-b3b9-5f6ee345356c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:05.726111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83094f3e-00ce-4528-920a-08e1b09821f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:05.727004 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83094f3e-00ce-4528-920a-08e1b09821f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:05.727294 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83094f3e-00ce-4528-920a-08e1b09821f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:05.727577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83094f3e-00ce-4528-920a-08e1b09821f8 admin admin] PATH_INFO: `/v3/projects/71176677d6ac4aa2a5dc6939a8d543ef` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:05.728780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83094f3e-00ce-4528-920a-08e1b09821f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71176677d6ac4aa2a5dc6939a8d543ef)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:05.730805 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83094f3e-00ce-4528-920a-08e1b09821f8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:05.776704 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-83094f3e-00ce-4528-920a-08e1b09821f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71176677d6ac4aa2a5dc6939a8d543ef', 'request_id': 'req-83094f3e-00ce-4528-920a-08e1b09821f8'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:05.783236 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-83094f3e-00ce-4528-920a-08e1b09821f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71176677d6ac4aa2a5dc6939a8d543ef', 'request_id': 'req-83094f3e-00ce-4528-920a-08e1b09821f8'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:05.788779 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-83094f3e-00ce-4528-920a-08e1b09821f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71176677d6ac4aa2a5dc6939a8d543ef', 'request_id': 'req-83094f3e-00ce-4528-920a-08e1b09821f8'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:05.796943 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:05.801679 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-83094f3e-00ce-4528-920a-08e1b09821f8 admin admin] The token cache is being invalidate because project 71176677d6ac4aa2a5dc6939a8d543ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:39:05.802315 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-83094f3e-00ce-4528-920a-08e1b09821f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:05.803068 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-83094f3e-00ce-4528-920a-08e1b09821f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:05.804597 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1250/2518] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:39:05 2022] DELETE /identity/v3/projects/71176677d6ac4aa2a5dc6939a8d543ef => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:05.809345 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273868d-62ee-4b71-b4aa-4b708f47014a admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:05.810788 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-5273868d-62ee-4b71-b4aa-4b708f47014a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:05.823558 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273868d-62ee-4b71-b4aa-4b708f47014a admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:05.879313 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07cff3-3505-4517-8a48-3eb15b3b8bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:05.880176 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07cff3-3505-4517-8a48-3eb15b3b8bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:05.880461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07cff3-3505-4517-8a48-3eb15b3b8bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:05.880739 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07cff3-3505-4517-8a48-3eb15b3b8bcc admin admin] PATH_INFO: `/v3/users/b0d170fbafdd4bbdbadd0a14a4b8a58a` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:05.881890 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e07cff3-3505-4517-8a48-3eb15b3b8bcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d170fbafdd4bbdbadd0a14a4b8a58a)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:05.883872 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e07cff3-3505-4517-8a48-3eb15b3b8bcc admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:05.930020 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-8e07cff3-3505-4517-8a48-3eb15b3b8bcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d170fbafdd4bbdbadd0a14a4b8a58a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:05.938075 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-8e07cff3-3505-4517-8a48-3eb15b3b8bcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d170fbafdd4bbdbadd0a14a4b8a58a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:05.939242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:05.952553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-8e07cff3-3505-4517-8a48-3eb15b3b8bcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d170fbafdd4bbdbadd0a14a4b8a58a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:05.959472 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-8e07cff3-3505-4517-8a48-3eb15b3b8bcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d170fbafdd4bbdbadd0a14a4b8a58a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:05.960119 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-8e07cff3-3505-4517-8a48-3eb15b3b8bcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d170fbafdd4bbdbadd0a14a4b8a58a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:05.966545 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1269/2519] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:39:05 2022] DELETE /identity/v3/users/b0d170fbafdd4bbdbadd0a14a4b8a58a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:06.237537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83094f3e-00ce-4528-920a-08e1b09821f8 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:06.239079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-83094f3e-00ce-4528-920a-08e1b09821f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:06.253943 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83094f3e-00ce-4528-920a-08e1b09821f8 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:06.311253 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d6b8d-ffd8-4ad9-b04a-d4ab9d903fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:06.312040 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d6b8d-ffd8-4ad9-b04a-d4ab9d903fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:06.312326 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d6b8d-ffd8-4ad9-b04a-d4ab9d903fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:06.312600 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d6b8d-ffd8-4ad9-b04a-d4ab9d903fc2 admin admin] PATH_INFO: `/v3/projects/985b9d3ad26b41a6a17b4e208b540fe6` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:06.313763 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d6b8d-ffd8-4ad9-b04a-d4ab9d903fc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=985b9d3ad26b41a6a17b4e208b540fe6)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:06.315739 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d6b8d-ffd8-4ad9-b04a-d4ab9d903fc2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:06.361362 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-316d6b8d-ffd8-4ad9-b04a-d4ab9d903fc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '985b9d3ad26b41a6a17b4e208b540fe6', 'request_id': 'req-316d6b8d-ffd8-4ad9-b04a-d4ab9d903fc2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:06.367258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-316d6b8d-ffd8-4ad9-b04a-d4ab9d903fc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '985b9d3ad26b41a6a17b4e208b540fe6', 'request_id': 'req-316d6b8d-ffd8-4ad9-b04a-d4ab9d903fc2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:06.373422 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-316d6b8d-ffd8-4ad9-b04a-d4ab9d903fc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '985b9d3ad26b41a6a17b4e208b540fe6', 'request_id': 'req-316d6b8d-ffd8-4ad9-b04a-d4ab9d903fc2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:06.386399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-316d6b8d-ffd8-4ad9-b04a-d4ab9d903fc2 admin admin] The token cache is being invalidate because project 985b9d3ad26b41a6a17b4e208b540fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:39:06.386812 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-316d6b8d-ffd8-4ad9-b04a-d4ab9d903fc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:06.387431 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-316d6b8d-ffd8-4ad9-b04a-d4ab9d903fc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:06.388930 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1251/2520] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:39:06 2022] DELETE /identity/v3/projects/985b9d3ad26b41a6a17b4e208b540fe6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:06.394762 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f31b2-8b60-4d12-98b7-529326db0075 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:06.395053 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f31b2-8b60-4d12-98b7-529326db0075 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:06.395328 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f31b2-8b60-4d12-98b7-529326db0075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:06.412988 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-f48f31b2-8b60-4d12-98b7-529326db0075 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:06.414174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-f48f31b2-8b60-4d12-98b7-529326db0075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:06.472212 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1270/2521] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:06.480349 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3fbae-6350-464a-abeb-5c98885a2753 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:06.481181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3fbae-6350-464a-abeb-5c98885a2753 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:06.481491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3fbae-6350-464a-abeb-5c98885a2753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:06.500146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-96a3fbae-6350-464a-abeb-5c98885a2753 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:06.501378 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-96a3fbae-6350-464a-abeb-5c98885a2753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:06.509580 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1252/2522] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:06.513793 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f31b2-8b60-4d12-98b7-529326db0075 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:06.523459 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f31b2-8b60-4d12-98b7-529326db0075 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:06.529493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d8274-ba4a-4a08-a4df-87018fc408ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:06.530157 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d8274-ba4a-4a08-a4df-87018fc408ca admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:06.530592 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d8274-ba4a-4a08-a4df-87018fc408ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:06.530877 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d8274-ba4a-4a08-a4df-87018fc408ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:06.531602 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d8274-ba4a-4a08-a4df-87018fc408ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:39:06.531913 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d8274-ba4a-4a08-a4df-87018fc408ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:06.533571 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d8274-ba4a-4a08-a4df-87018fc408ca admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:06.546363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1271/2523] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:39:06.551776 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3fbae-6350-464a-abeb-5c98885a2753 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:06.561518 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3fbae-6350-464a-abeb-5c98885a2753 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:06.566154 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16182bcc-8d85-4f99-bda3-7229c9e4a2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:06.566854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16182bcc-8d85-4f99-bda3-7229c9e4a2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:06.567144 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16182bcc-8d85-4f99-bda3-7229c9e4a2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:06.567428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16182bcc-8d85-4f99-bda3-7229c9e4a2c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:06.568129 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16182bcc-8d85-4f99-bda3-7229c9e4a2c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:06.570173 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16182bcc-8d85-4f99-bda3-7229c9e4a2c1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:06.599283 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1253/2524] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:39:06 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:39:06.600948 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d8274-ba4a-4a08-a4df-87018fc408ca admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:06.612770 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d8274-ba4a-4a08-a4df-87018fc408ca admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:06.674019 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31bd8a-9c08-4190-b85d-65b03ae041ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:06.674719 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31bd8a-9c08-4190-b85d-65b03ae041ea admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:06.675008 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31bd8a-9c08-4190-b85d-65b03ae041ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:06.675290 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31bd8a-9c08-4190-b85d-65b03ae041ea admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:06.675965 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31bd8a-9c08-4190-b85d-65b03ae041ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:06.677885 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31bd8a-9c08-4190-b85d-65b03ae041ea admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:06.701895 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1272/2525] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:39:06 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:39:06.703145 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16182bcc-8d85-4f99-bda3-7229c9e4a2c1 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:06.713370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16182bcc-8d85-4f99-bda3-7229c9e4a2c1 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:06.717924 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a673c-6c74-4e13-83fc-c40279ff827e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:06.718610 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a673c-6c74-4e13-83fc-c40279ff827e admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:06.718900 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a673c-6c74-4e13-83fc-c40279ff827e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:06.719181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a673c-6c74-4e13-83fc-c40279ff827e admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:06.719908 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a673c-6c74-4e13-83fc-c40279ff827e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:06.721522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a673c-6c74-4e13-83fc-c40279ff827e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:06.731881 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1254/2526] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:06.735731 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31bd8a-9c08-4190-b85d-65b03ae041ea admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:06.745588 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31bd8a-9c08-4190-b85d-65b03ae041ea admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:06.750722 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1addc12-a16b-4e33-b898-be45b4f8c75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:06.751372 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1addc12-a16b-4e33-b898-be45b4f8c75b admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:06.751663 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1addc12-a16b-4e33-b898-be45b4f8c75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:06.751946 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1addc12-a16b-4e33-b898-be45b4f8c75b admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:06.752663 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1addc12-a16b-4e33-b898-be45b4f8c75b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:06.754266 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1addc12-a16b-4e33-b898-be45b4f8c75b admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:06.764865 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1273/2527] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:06.768781 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a673c-6c74-4e13-83fc-c40279ff827e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:06.778718 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a673c-6c74-4e13-83fc-c40279ff827e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:06.784188 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4182d-49e0-4e96-9d49-196d0753a881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:06.785071 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4182d-49e0-4e96-9d49-196d0753a881 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:06.785390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4182d-49e0-4e96-9d49-196d0753a881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:06.785676 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4182d-49e0-4e96-9d49-196d0753a881 admin admin] PATH_INFO: `/v3/projects/ee400bec568a419e9a72b1d149bdbbc2/users/73da9a25236e425f99fcde477dd366b1/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:06.803491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4182d-49e0-4e96-9d49-196d0753a881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee400bec568a419e9a72b1d149bdbbc2, user_id=73da9a25236e425f99fcde477dd366b1, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:06.806182 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4182d-49e0-4e96-9d49-196d0753a881 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:06.819171 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1255/2528] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:39:06 2022] PUT /identity/v3/projects/ee400bec568a419e9a72b1d149bdbbc2/users/73da9a25236e425f99fcde477dd366b1/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:06.831474 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdec6b2-a7a0-4af4-af36-61f86f500db7 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:06.831985 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdec6b2-a7a0-4af4-af36-61f86f500db7 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:06.832083 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdec6b2-a7a0-4af4-af36-61f86f500db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:06.858348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-bfdec6b2-a7a0-4af4-af36-61f86f500db7 None None] MFA Rules not processed for user `73da9a25236e425f99fcde477dd366b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:06.859584 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-bfdec6b2-a7a0-4af4-af36-61f86f500db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:06.885227 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:06.923265 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1274/2529] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:06.935391 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4182d-49e0-4e96-9d49-196d0753a881 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:06.937094 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b0e4182d-49e0-4e96-9d49-196d0753a881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:06.964200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:06.993791 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4182d-49e0-4e96-9d49-196d0753a881 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:06.998219 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca97f8a-a676-4fd8-9079-35347f0e59d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:06.998889 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca97f8a-a676-4fd8-9079-35347f0e59d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:06.999179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca97f8a-a676-4fd8-9079-35347f0e59d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:06.999458 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca97f8a-a676-4fd8-9079-35347f0e59d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:07.007820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca97f8a-a676-4fd8-9079-35347f0e59d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:07.009271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca97f8a-a676-4fd8-9079-35347f0e59d3 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:07.018281 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1256/2530] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:39:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:07.037079 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdec6b2-a7a0-4af4-af36-61f86f500db7 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:07.101123 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdec6b2-a7a0-4af4-af36-61f86f500db7 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:07.105668 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e317759-85ba-4d72-a303-79b9251bd8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:07.106546 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e317759-85ba-4d72-a303-79b9251bd8f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:07.106834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e317759-85ba-4d72-a303-79b9251bd8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:07.107108 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e317759-85ba-4d72-a303-79b9251bd8f0 admin admin] PATH_INFO: `/v3/users/73da9a25236e425f99fcde477dd366b1` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:07.108288 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e317759-85ba-4d72-a303-79b9251bd8f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73da9a25236e425f99fcde477dd366b1)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:07.110249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e317759-85ba-4d72-a303-79b9251bd8f0 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:07.156638 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-1e317759-85ba-4d72-a303-79b9251bd8f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73da9a25236e425f99fcde477dd366b1'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:07.163671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-1e317759-85ba-4d72-a303-79b9251bd8f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73da9a25236e425f99fcde477dd366b1'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:07.175389 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-1e317759-85ba-4d72-a303-79b9251bd8f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73da9a25236e425f99fcde477dd366b1'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:07.182318 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-1e317759-85ba-4d72-a303-79b9251bd8f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73da9a25236e425f99fcde477dd366b1'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:07.183013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-1e317759-85ba-4d72-a303-79b9251bd8f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73da9a25236e425f99fcde477dd366b1'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:07.189802 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1275/2531] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:39:07 2022] DELETE /identity/v3/users/73da9a25236e425f99fcde477dd366b1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:07.194000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a4176-453d-4eba-a37c-a632b936f03a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:07.194293 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a4176-453d-4eba-a37c-a632b936f03a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:07.194606 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a4176-453d-4eba-a37c-a632b936f03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:07.211466 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-281a4176-453d-4eba-a37c-a632b936f03a None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:07.212667 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-281a4176-453d-4eba-a37c-a632b936f03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:07.271815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1257/2532] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:07.281830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e317759-85ba-4d72-a303-79b9251bd8f0 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:07.283262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-1e317759-85ba-4d72-a303-79b9251bd8f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:07.335134 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:07.341881 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e317759-85ba-4d72-a303-79b9251bd8f0 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:07.346363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7929b6-645d-408e-9424-ad6d3d271d8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:07.347058 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7929b6-645d-408e-9424-ad6d3d271d8c service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:07.347344 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7929b6-645d-408e-9424-ad6d3d271d8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:07.347625 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7929b6-645d-408e-9424-ad6d3d271d8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:07.357155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7929b6-645d-408e-9424-ad6d3d271d8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:07.358566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7929b6-645d-408e-9424-ad6d3d271d8c service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:07.367794 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1276/2533] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:39:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:07.632251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a4176-453d-4eba-a37c-a632b936f03a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:07.633917 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-281a4176-453d-4eba-a37c-a632b936f03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:07.646613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a4176-453d-4eba-a37c-a632b936f03a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:07.651203 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb63778-fe5b-40c1-997d-479122045973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:07.652067 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb63778-fe5b-40c1-997d-479122045973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:07.652438 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb63778-fe5b-40c1-997d-479122045973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:07.653260 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb63778-fe5b-40c1-997d-479122045973 admin admin] PATH_INFO: `/v3/projects/ee400bec568a419e9a72b1d149bdbbc2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:07.654474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb63778-fe5b-40c1-997d-479122045973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee400bec568a419e9a72b1d149bdbbc2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:07.656415 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb63778-fe5b-40c1-997d-479122045973 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:07.704190 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bfb63778-fe5b-40c1-997d-479122045973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee400bec568a419e9a72b1d149bdbbc2', 'request_id': 'req-bfb63778-fe5b-40c1-997d-479122045973'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:07.710359 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bfb63778-fe5b-40c1-997d-479122045973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee400bec568a419e9a72b1d149bdbbc2', 'request_id': 'req-bfb63778-fe5b-40c1-997d-479122045973'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:07.716873 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bfb63778-fe5b-40c1-997d-479122045973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee400bec568a419e9a72b1d149bdbbc2', 'request_id': 'req-bfb63778-fe5b-40c1-997d-479122045973'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:07.730361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bfb63778-fe5b-40c1-997d-479122045973 admin admin] The token cache is being invalidate because project ee400bec568a419e9a72b1d149bdbbc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:39:07.730684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bfb63778-fe5b-40c1-997d-479122045973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:07.731296 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bfb63778-fe5b-40c1-997d-479122045973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:07.732834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1258/2534] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:39:07 2022] DELETE /identity/v3/projects/ee400bec568a419e9a72b1d149bdbbc2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:07.737798 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e9171-8782-46c5-892e-5ba513f7c920 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:07.738091 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e9171-8782-46c5-892e-5ba513f7c920 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:07.738371 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e9171-8782-46c5-892e-5ba513f7c920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:07.755816 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-bb1e9171-8782-46c5-892e-5ba513f7c920 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:07.756928 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-bb1e9171-8782-46c5-892e-5ba513f7c920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:07.818555 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1277/2535] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:07.826890 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092cdea-a36e-46ae-9da6-df3f982080ba None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:07.827183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092cdea-a36e-46ae-9da6-df3f982080ba None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:07.827467 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092cdea-a36e-46ae-9da6-df3f982080ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:07.845820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-e092cdea-a36e-46ae-9da6-df3f982080ba None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:07.847046 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e092cdea-a36e-46ae-9da6-df3f982080ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:07.854774 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1259/2536] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:39:07.858863 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e9171-8782-46c5-892e-5ba513f7c920 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:07.868217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e9171-8782-46c5-892e-5ba513f7c920 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:07.873418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dddc920-7480-468a-9ed7-bc61bb112ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:07.874059 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddc920-7480-468a-9ed7-bc61bb112ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:07.874345 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddc920-7480-468a-9ed7-bc61bb112ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:07.874657 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddc920-7480-468a-9ed7-bc61bb112ef2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:07.875423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dddc920-7480-468a-9ed7-bc61bb112ef2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:39:07.875682 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dddc920-7480-468a-9ed7-bc61bb112ef2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:07.877275 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dddc920-7480-468a-9ed7-bc61bb112ef2 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:07.889194 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1278/2537] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:39:07.893347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092cdea-a36e-46ae-9da6-df3f982080ba None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:07.902521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092cdea-a36e-46ae-9da6-df3f982080ba None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:07.907104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955bed9-d14a-4b09-a993-79ca6540ff91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:07.907743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955bed9-d14a-4b09-a993-79ca6540ff91 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:07.908029 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955bed9-d14a-4b09-a993-79ca6540ff91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:07.908308 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955bed9-d14a-4b09-a993-79ca6540ff91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:07.909000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955bed9-d14a-4b09-a993-79ca6540ff91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:07.910972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955bed9-d14a-4b09-a993-79ca6540ff91 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:07.936550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1260/2538] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:39:07 2022] POST /identity/v3/projects => generated 359 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:39:07.940520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dddc920-7480-468a-9ed7-bc61bb112ef2 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:07.951219 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dddc920-7480-468a-9ed7-bc61bb112ef2 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:08.007893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed43508-1fab-4ca5-ac37-fc4edd840c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:08.008553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed43508-1fab-4ca5-ac37-fc4edd840c1d admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:08.008844 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed43508-1fab-4ca5-ac37-fc4edd840c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:08.009126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed43508-1fab-4ca5-ac37-fc4edd840c1d admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:08.009808 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed43508-1fab-4ca5-ac37-fc4edd840c1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:08.011838 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed43508-1fab-4ca5-ac37-fc4edd840c1d admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:08.032010 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1279/2539] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:39:07 2022] POST /identity/v3/users => generated 280 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:39:08.036029 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955bed9-d14a-4b09-a993-79ca6540ff91 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:08.046850 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955bed9-d14a-4b09-a993-79ca6540ff91 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:08.051473 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eac2ba-e4c3-489b-8d11-6a3b5e5c489c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:08.052124 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eac2ba-e4c3-489b-8d11-6a3b5e5c489c admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:08.052410 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eac2ba-e4c3-489b-8d11-6a3b5e5c489c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:08.052691 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eac2ba-e4c3-489b-8d11-6a3b5e5c489c admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:08.053411 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eac2ba-e4c3-489b-8d11-6a3b5e5c489c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:08.055055 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eac2ba-e4c3-489b-8d11-6a3b5e5c489c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:08.065422 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1261/2540] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:08.069066 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed43508-1fab-4ca5-ac37-fc4edd840c1d admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:08.078612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed43508-1fab-4ca5-ac37-fc4edd840c1d admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:08.083154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678ab58-892f-414f-b622-bb865740f736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:08.083789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678ab58-892f-414f-b622-bb865740f736 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:08.084071 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678ab58-892f-414f-b622-bb865740f736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:08.084346 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678ab58-892f-414f-b622-bb865740f736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:08.085052 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678ab58-892f-414f-b622-bb865740f736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:08.086650 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678ab58-892f-414f-b622-bb865740f736 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:08.096944 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1280/2541] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:08.101114 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eac2ba-e4c3-489b-8d11-6a3b5e5c489c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:08.111616 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eac2ba-e4c3-489b-8d11-6a3b5e5c489c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:08.116220 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97f0f8-9a7a-429d-8649-d8709e5434cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:08.117101 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97f0f8-9a7a-429d-8649-d8709e5434cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:08.117386 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97f0f8-9a7a-429d-8649-d8709e5434cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:08.117664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97f0f8-9a7a-429d-8649-d8709e5434cc admin admin] PATH_INFO: `/v3/projects/fe80fceaf468477d9e1f663e5e804bff/users/559de014fb674eae8ac4e18b100d383b/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:08.125892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:08.133525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97f0f8-9a7a-429d-8649-d8709e5434cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe80fceaf468477d9e1f663e5e804bff, user_id=559de014fb674eae8ac4e18b100d383b, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:08.136676 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97f0f8-9a7a-429d-8649-d8709e5434cc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:08.149748 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1262/2542] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:39:08 2022] PUT /identity/v3/projects/fe80fceaf468477d9e1f663e5e804bff/users/559de014fb674eae8ac4e18b100d383b/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:08.160319 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda6ad1-cf03-4db6-b4f0-f3cbd022ea5a None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:08.160612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda6ad1-cf03-4db6-b4f0-f3cbd022ea5a None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:08.160892 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda6ad1-cf03-4db6-b4f0-f3cbd022ea5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:08.187660 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-8fda6ad1-cf03-4db6-b4f0-f3cbd022ea5a None None] MFA Rules not processed for user `559de014fb674eae8ac4e18b100d383b`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:08.188936 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-8fda6ad1-cf03-4db6-b4f0-f3cbd022ea5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:08.231633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:08.253465 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1281/2543] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:08 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:08.285864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97f0f8-9a7a-429d-8649-d8709e5434cc admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:08.288012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9a97f0f8-9a7a-429d-8649-d8709e5434cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:08.349193 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97f0f8-9a7a-429d-8649-d8709e5434cc admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:08.352845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfebbc-7aec-41dd-9697-7a623ca3b34e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:08.353489 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfebbc-7aec-41dd-9697-7a623ca3b34e service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:08.353775 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfebbc-7aec-41dd-9697-7a623ca3b34e service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:08.354052 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfebbc-7aec-41dd-9697-7a623ca3b34e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:08.363777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bfebbc-7aec-41dd-9697-7a623ca3b34e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:08.365404 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bfebbc-7aec-41dd-9697-7a623ca3b34e service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:08.376535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1263/2544] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:39:08 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:08.390978 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda6ad1-cf03-4db6-b4f0-f3cbd022ea5a None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:08.456763 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda6ad1-cf03-4db6-b4f0-f3cbd022ea5a None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:08.461426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce1232-e531-4acb-bc0c-b14192824462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:08.462299 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce1232-e531-4acb-bc0c-b14192824462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:08.462612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce1232-e531-4acb-bc0c-b14192824462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:08.462895 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce1232-e531-4acb-bc0c-b14192824462 admin admin] PATH_INFO: `/v3/users/559de014fb674eae8ac4e18b100d383b` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:08.464090 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce1232-e531-4acb-bc0c-b14192824462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=559de014fb674eae8ac4e18b100d383b)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:08.466098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce1232-e531-4acb-bc0c-b14192824462 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:08.516356 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-03ce1232-e531-4acb-bc0c-b14192824462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '559de014fb674eae8ac4e18b100d383b'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:08.529929 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-03ce1232-e531-4acb-bc0c-b14192824462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '559de014fb674eae8ac4e18b100d383b'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:08.544783 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-03ce1232-e531-4acb-bc0c-b14192824462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '559de014fb674eae8ac4e18b100d383b'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:08.552066 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-03ce1232-e531-4acb-bc0c-b14192824462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '559de014fb674eae8ac4e18b100d383b'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:08.552794 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-03ce1232-e531-4acb-bc0c-b14192824462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '559de014fb674eae8ac4e18b100d383b'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:08.559097 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1282/2545] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:39:08 2022] DELETE /identity/v3/users/559de014fb674eae8ac4e18b100d383b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:08.563507 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec452436-40d4-4010-b100-3b18fc1aa1a1 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:08.563800 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec452436-40d4-4010-b100-3b18fc1aa1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:08.564077 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec452436-40d4-4010-b100-3b18fc1aa1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:08.581465 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ec452436-40d4-4010-b100-3b18fc1aa1a1 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:08.582702 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ec452436-40d4-4010-b100-3b18fc1aa1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:08.648193 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1264/2546] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:39:08.658236 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce1232-e531-4acb-bc0c-b14192824462 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:08.659667 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-03ce1232-e531-4acb-bc0c-b14192824462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:08.718917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce1232-e531-4acb-bc0c-b14192824462 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:08.722943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27664e9-ba1c-42f7-a004-1a7aee9ecdcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:08.723631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27664e9-ba1c-42f7-a004-1a7aee9ecdcc service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:08.723915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27664e9-ba1c-42f7-a004-1a7aee9ecdcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:08.724193 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27664e9-ba1c-42f7-a004-1a7aee9ecdcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:08.734003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27664e9-ba1c-42f7-a004-1a7aee9ecdcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:08.735496 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27664e9-ba1c-42f7-a004-1a7aee9ecdcc service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:08.745396 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1283/2547] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:09.038684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec452436-40d4-4010-b100-3b18fc1aa1a1 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:09.040239 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ec452436-40d4-4010-b100-3b18fc1aa1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:09.053190 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec452436-40d4-4010-b100-3b18fc1aa1a1 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:09.058065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abaad6e-94b4-4abb-bf22-f6616d035c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:09.059548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abaad6e-94b4-4abb-bf22-f6616d035c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:09.059977 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abaad6e-94b4-4abb-bf22-f6616d035c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:09.060265 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abaad6e-94b4-4abb-bf22-f6616d035c43 admin admin] PATH_INFO: `/v3/projects/fe80fceaf468477d9e1f663e5e804bff` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:09.061475 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abaad6e-94b4-4abb-bf22-f6616d035c43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe80fceaf468477d9e1f663e5e804bff)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:09.063521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abaad6e-94b4-4abb-bf22-f6616d035c43 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:09.112668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5abaad6e-94b4-4abb-bf22-f6616d035c43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe80fceaf468477d9e1f663e5e804bff', 'request_id': 'req-5abaad6e-94b4-4abb-bf22-f6616d035c43'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:09.119798 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5abaad6e-94b4-4abb-bf22-f6616d035c43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe80fceaf468477d9e1f663e5e804bff', 'request_id': 'req-5abaad6e-94b4-4abb-bf22-f6616d035c43'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:09.127060 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5abaad6e-94b4-4abb-bf22-f6616d035c43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe80fceaf468477d9e1f663e5e804bff', 'request_id': 'req-5abaad6e-94b4-4abb-bf22-f6616d035c43'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:09.139632 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5abaad6e-94b4-4abb-bf22-f6616d035c43 admin admin] The token cache is being invalidate because project fe80fceaf468477d9e1f663e5e804bff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:39:09.139919 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5abaad6e-94b4-4abb-bf22-f6616d035c43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:09.140570 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5abaad6e-94b4-4abb-bf22-f6616d035c43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:09.142315 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1265/2548] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:39:09 2022] DELETE /identity/v3/projects/fe80fceaf468477d9e1f663e5e804bff => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:09.147155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb9776-6a28-495a-a0f2-ec6d92fdcde3 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:09.147620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb9776-6a28-495a-a0f2-ec6d92fdcde3 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:09.147716 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb9776-6a28-495a-a0f2-ec6d92fdcde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:09.160156 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:09.166421 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-07cb9776-6a28-495a-a0f2-ec6d92fdcde3 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:09.168660 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-07cb9776-6a28-495a-a0f2-ec6d92fdcde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:09.226725 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1284/2549] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:09.235971 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1193466-8140-4c2d-8dda-c1cfc32c8483 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:09.236264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1193466-8140-4c2d-8dda-c1cfc32c8483 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:09.236540 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1193466-8140-4c2d-8dda-c1cfc32c8483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:09.254606 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a1193466-8140-4c2d-8dda-c1cfc32c8483 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:09.255804 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a1193466-8140-4c2d-8dda-c1cfc32c8483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:09.264176 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1266/2550] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:09.268270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb9776-6a28-495a-a0f2-ec6d92fdcde3 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:09.278660 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb9776-6a28-495a-a0f2-ec6d92fdcde3 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:09.283210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e61465-b103-4fbd-8fdf-e72266a02952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:09.283854 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e61465-b103-4fbd-8fdf-e72266a02952 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:09.284142 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e61465-b103-4fbd-8fdf-e72266a02952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:09.284420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e61465-b103-4fbd-8fdf-e72266a02952 admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:09.285136 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e61465-b103-4fbd-8fdf-e72266a02952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:39:09.285448 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e61465-b103-4fbd-8fdf-e72266a02952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:09.287080 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e61465-b103-4fbd-8fdf-e72266a02952 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:09.299567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1285/2551] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:39:09.303732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1193466-8140-4c2d-8dda-c1cfc32c8483 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:09.313855 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1193466-8140-4c2d-8dda-c1cfc32c8483 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:09.318822 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a2b68-9229-46cb-9fad-bece9760c615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:09.319481 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a2b68-9229-46cb-9fad-bece9760c615 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:09.319799 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a2b68-9229-46cb-9fad-bece9760c615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:09.320086 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a2b68-9229-46cb-9fad-bece9760c615 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:09.320794 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a2b68-9229-46cb-9fad-bece9760c615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:09.322835 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a2b68-9229-46cb-9fad-bece9760c615 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:09.325845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:09.359461 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1267/2552] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:39:09 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:39:09.363596 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e61465-b103-4fbd-8fdf-e72266a02952 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:09.374037 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e61465-b103-4fbd-8fdf-e72266a02952 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:09.429024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac348b2-10f5-4969-891b-d3c9e92cbdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:09.429611 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac348b2-10f5-4969-891b-d3c9e92cbdf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:09.430611 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac348b2-10f5-4969-891b-d3c9e92cbdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:09.430611 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac348b2-10f5-4969-891b-d3c9e92cbdf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:09.430925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac348b2-10f5-4969-891b-d3c9e92cbdf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:09.433035 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac348b2-10f5-4969-891b-d3c9e92cbdf6 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:09.451905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1286/2553] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:39:09 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:39:09.455916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a2b68-9229-46cb-9fad-bece9760c615 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:09.466692 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a2b68-9229-46cb-9fad-bece9760c615 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:09.471331 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432c81e-9c9e-441d-8b33-958678dd1ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:09.471988 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432c81e-9c9e-441d-8b33-958678dd1ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:09.472279 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432c81e-9c9e-441d-8b33-958678dd1ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:09.472561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432c81e-9c9e-441d-8b33-958678dd1ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:09.473295 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432c81e-9c9e-441d-8b33-958678dd1ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:09.474965 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432c81e-9c9e-441d-8b33-958678dd1ad9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:09.486300 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1268/2554] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:09.490102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac348b2-10f5-4969-891b-d3c9e92cbdf6 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:09.500102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac348b2-10f5-4969-891b-d3c9e92cbdf6 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:09.504538 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5eb13f-1cd8-427b-b11e-3312f5bf1132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:09.505183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5eb13f-1cd8-427b-b11e-3312f5bf1132 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:09.505466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5eb13f-1cd8-427b-b11e-3312f5bf1132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:09.505742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5eb13f-1cd8-427b-b11e-3312f5bf1132 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:09.506454 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5eb13f-1cd8-427b-b11e-3312f5bf1132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:09.508065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5eb13f-1cd8-427b-b11e-3312f5bf1132 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:09.517962 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1287/2555] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:09.521701 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432c81e-9c9e-441d-8b33-958678dd1ad9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:09.532000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432c81e-9c9e-441d-8b33-958678dd1ad9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:09.536620 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5af70-4775-4d80-9535-c162d291053d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:09.537491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5af70-4775-4d80-9535-c162d291053d admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:09.537778 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5af70-4775-4d80-9535-c162d291053d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:09.538115 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5af70-4775-4d80-9535-c162d291053d admin admin] PATH_INFO: `/v3/projects/abafe4f087e64826b08404bf59d11a2d/users/68d36ac4af2a41559fb3360aa42637b4/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:09.553270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5af70-4775-4d80-9535-c162d291053d admin admin] RBAC: Authorizing `identity:create_grant(project_id=abafe4f087e64826b08404bf59d11a2d, user_id=68d36ac4af2a41559fb3360aa42637b4, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:09.555983 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5af70-4775-4d80-9535-c162d291053d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:09.569407 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1269/2556] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:39:09 2022] PUT /identity/v3/projects/abafe4f087e64826b08404bf59d11a2d/users/68d36ac4af2a41559fb3360aa42637b4/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:09.579526 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3b361-01fb-4ea3-9ece-8ec02c718605 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:09.579819 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3b361-01fb-4ea3-9ece-8ec02c718605 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:09.580132 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3b361-01fb-4ea3-9ece-8ec02c718605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:09.606789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-7ad3b361-01fb-4ea3-9ece-8ec02c718605 None None] MFA Rules not processed for user `68d36ac4af2a41559fb3360aa42637b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:09.607978 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-7ad3b361-01fb-4ea3-9ece-8ec02c718605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:09.670991 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1288/2557] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:09.675385 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5af70-4775-4d80-9535-c162d291053d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:09.736302 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5af70-4775-4d80-9535-c162d291053d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:09.740861 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84f991-886c-4457-a959-b409f8bc4dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:09.741537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84f991-886c-4457-a959-b409f8bc4dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:09.741827 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84f991-886c-4457-a959-b409f8bc4dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:09.742135 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84f991-886c-4457-a959-b409f8bc4dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:09.742849 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84f991-886c-4457-a959-b409f8bc4dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:09.744768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84f991-886c-4457-a959-b409f8bc4dc3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:09.769903 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1270/2558] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:39:09 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:39:09.773960 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3b361-01fb-4ea3-9ece-8ec02c718605 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:09.779427 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:09.786192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3b361-01fb-4ea3-9ece-8ec02c718605 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:09.846409 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639b14e-38d8-4339-8468-50251d78760f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:09.847101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639b14e-38d8-4339-8468-50251d78760f admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:09.847403 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639b14e-38d8-4339-8468-50251d78760f admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:09.847665 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639b14e-38d8-4339-8468-50251d78760f admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:09.848346 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639b14e-38d8-4339-8468-50251d78760f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:09.850255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639b14e-38d8-4339-8468-50251d78760f admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:09.868761 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1289/2559] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:39:09 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:39:09.872716 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84f991-886c-4457-a959-b409f8bc4dc3 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:09.883010 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84f991-886c-4457-a959-b409f8bc4dc3 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:09.888072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8926335-e846-4d35-87ce-4c1d44eae145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:09.888720 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8926335-e846-4d35-87ce-4c1d44eae145 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:09.889010 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8926335-e846-4d35-87ce-4c1d44eae145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:09.889284 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8926335-e846-4d35-87ce-4c1d44eae145 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:09.890009 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8926335-e846-4d35-87ce-4c1d44eae145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:09.891726 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8926335-e846-4d35-87ce-4c1d44eae145 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:09.904153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1271/2560] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:09.914341 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639b14e-38d8-4339-8468-50251d78760f admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:09.924410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639b14e-38d8-4339-8468-50251d78760f admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:09.929046 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b459667-a9f6-47d4-b105-559787b48825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:09.929978 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b459667-a9f6-47d4-b105-559787b48825 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:09.930322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b459667-a9f6-47d4-b105-559787b48825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:09.930481 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b459667-a9f6-47d4-b105-559787b48825 admin admin] PATH_INFO: `/v3/projects/02953f590f044fc3b522b23b561dd472/users/516bf244cac247928cc6b252433f07ea/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:09.948810 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b459667-a9f6-47d4-b105-559787b48825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02953f590f044fc3b522b23b561dd472, user_id=516bf244cac247928cc6b252433f07ea, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:09.952162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b459667-a9f6-47d4-b105-559787b48825 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:09.966547 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1290/2561] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:39:09 2022] PUT /identity/v3/projects/02953f590f044fc3b522b23b561dd472/users/516bf244cac247928cc6b252433f07ea/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:09.970636 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8926335-e846-4d35-87ce-4c1d44eae145 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:09.980463 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8926335-e846-4d35-87ce-4c1d44eae145 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:10.037874 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2e33c-d9aa-455d-aa44-2cc2779de02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:10.038583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2e33c-d9aa-455d-aa44-2cc2779de02d admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:10.038881 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2e33c-d9aa-455d-aa44-2cc2779de02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:10.039366 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2e33c-d9aa-455d-aa44-2cc2779de02d admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:10.039898 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2e33c-d9aa-455d-aa44-2cc2779de02d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:10.041504 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2e33c-d9aa-455d-aa44-2cc2779de02d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:10.054920 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1272/2562] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:10.056047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b459667-a9f6-47d4-b105-559787b48825 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:10.066461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b459667-a9f6-47d4-b105-559787b48825 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:10.071152 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf24ba-a9db-4f6c-8ebe-ef37cd7d3c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:10.072040 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf24ba-a9db-4f6c-8ebe-ef37cd7d3c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:10.072329 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf24ba-a9db-4f6c-8ebe-ef37cd7d3c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:10.072640 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf24ba-a9db-4f6c-8ebe-ef37cd7d3c0d admin admin] PATH_INFO: `/v3/projects/02953f590f044fc3b522b23b561dd472/users/516bf244cac247928cc6b252433f07ea/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:10.075141 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf24ba-a9db-4f6c-8ebe-ef37cd7d3c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=02953f590f044fc3b522b23b561dd472, user_id=516bf244cac247928cc6b252433f07ea, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:10.077775 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf24ba-a9db-4f6c-8ebe-ef37cd7d3c0d admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:10.088611 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1291/2563] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:39:10 2022] PUT /identity/v3/projects/02953f590f044fc3b522b23b561dd472/users/516bf244cac247928cc6b252433f07ea/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:39:10.099291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c971e-d744-45c7-85fe-9d8b237b7ad2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:10.099589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c971e-d744-45c7-85fe-9d8b237b7ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:10.099898 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c971e-d744-45c7-85fe-9d8b237b7ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:10.120405 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:10.129373 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-014c971e-d744-45c7-85fe-9d8b237b7ad2 None None] MFA Rules not processed for user `516bf244cac247928cc6b252433f07ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:10.131554 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-014c971e-d744-45c7-85fe-9d8b237b7ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:10.214347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1273/2564] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:10.225392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf24ba-a9db-4f6c-8ebe-ef37cd7d3c0d admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:10.227219 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-3fbf24ba-a9db-4f6c-8ebe-ef37cd7d3c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:10.293154 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf24ba-a9db-4f6c-8ebe-ef37cd7d3c0d admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:10.296686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89139552-1e49-4c76-8d97-2fd6b36b744e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:10.297330 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89139552-1e49-4c76-8d97-2fd6b36b744e service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:10.297661 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89139552-1e49-4c76-8d97-2fd6b36b744e service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:10.297966 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89139552-1e49-4c76-8d97-2fd6b36b744e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:10.356137 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89139552-1e49-4c76-8d97-2fd6b36b744e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:10.357604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89139552-1e49-4c76-8d97-2fd6b36b744e service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:10.366488 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1292/2565] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:39:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:39:12.898044 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c971e-d744-45c7-85fe-9d8b237b7ad2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:12.959335 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c971e-d744-45c7-85fe-9d8b237b7ad2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:12.963827 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0fc9a-7086-4a39-8092-be434d99e252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:12.964717 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0fc9a-7086-4a39-8092-be434d99e252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:12.965006 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0fc9a-7086-4a39-8092-be434d99e252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:12.965293 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0fc9a-7086-4a39-8092-be434d99e252 admin admin] PATH_INFO: `/v3/users/68d36ac4af2a41559fb3360aa42637b4` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:12.966466 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0fc9a-7086-4a39-8092-be434d99e252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d36ac4af2a41559fb3360aa42637b4)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:12.968435 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0fc9a-7086-4a39-8092-be434d99e252 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:13.014094 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e5d0fc9a-7086-4a39-8092-be434d99e252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d36ac4af2a41559fb3360aa42637b4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:13.022482 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e5d0fc9a-7086-4a39-8092-be434d99e252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d36ac4af2a41559fb3360aa42637b4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:13.023141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e5d0fc9a-7086-4a39-8092-be434d99e252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d36ac4af2a41559fb3360aa42637b4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:13.023913 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e5d0fc9a-7086-4a39-8092-be434d99e252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d36ac4af2a41559fb3360aa42637b4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:13.036816 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e5d0fc9a-7086-4a39-8092-be434d99e252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d36ac4af2a41559fb3360aa42637b4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:13.049310 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1274/2566] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:39:12 2022] DELETE /identity/v3/users/68d36ac4af2a41559fb3360aa42637b4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:13.053778 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc9e19-ccb7-4650-83c7-bcf11d7e5c2a None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:13.054265 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc9e19-ccb7-4650-83c7-bcf11d7e5c2a None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:13.054370 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc9e19-ccb7-4650-83c7-bcf11d7e5c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:13.071955 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-c2cc9e19-ccb7-4650-83c7-bcf11d7e5c2a None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:13.073160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-c2cc9e19-ccb7-4650-83c7-bcf11d7e5c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:13.077018 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:13.135101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1293/2567] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:13.144506 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0fc9a-7086-4a39-8092-be434d99e252 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:13.145925 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e5d0fc9a-7086-4a39-8092-be434d99e252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:13.165535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:13.205620 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0fc9a-7086-4a39-8092-be434d99e252 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:13.209248 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511b7bf-3996-4890-8472-87449835e295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:13.209883 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511b7bf-3996-4890-8472-87449835e295 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:13.210165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511b7bf-3996-4890-8472-87449835e295 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:13.210442 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511b7bf-3996-4890-8472-87449835e295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:13.219904 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511b7bf-3996-4890-8472-87449835e295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:13.221348 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511b7bf-3996-4890-8472-87449835e295 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:13.231222 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1275/2568] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:13.488447 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc9e19-ccb7-4650-83c7-bcf11d7e5c2a None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:13.490078 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-c2cc9e19-ccb7-4650-83c7-bcf11d7e5c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:13.502982 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc9e19-ccb7-4650-83c7-bcf11d7e5c2a None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:13.507903 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306ed1c-6671-4a23-9805-4446650758c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:13.508765 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306ed1c-6671-4a23-9805-4446650758c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:13.509046 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306ed1c-6671-4a23-9805-4446650758c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:13.509332 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306ed1c-6671-4a23-9805-4446650758c9 admin admin] PATH_INFO: `/v3/projects/abafe4f087e64826b08404bf59d11a2d` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:13.510616 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306ed1c-6671-4a23-9805-4446650758c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abafe4f087e64826b08404bf59d11a2d)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:13.512990 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306ed1c-6671-4a23-9805-4446650758c9 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:13.562382 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-3306ed1c-6671-4a23-9805-4446650758c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abafe4f087e64826b08404bf59d11a2d', 'request_id': 'req-3306ed1c-6671-4a23-9805-4446650758c9'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:13.568679 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-3306ed1c-6671-4a23-9805-4446650758c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abafe4f087e64826b08404bf59d11a2d', 'request_id': 'req-3306ed1c-6671-4a23-9805-4446650758c9'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:13.577242 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-3306ed1c-6671-4a23-9805-4446650758c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abafe4f087e64826b08404bf59d11a2d', 'request_id': 'req-3306ed1c-6671-4a23-9805-4446650758c9'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:13.588044 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-3306ed1c-6671-4a23-9805-4446650758c9 admin admin] The token cache is being invalidate because project abafe4f087e64826b08404bf59d11a2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:39:13.588340 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-3306ed1c-6671-4a23-9805-4446650758c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:13.588971 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-3306ed1c-6671-4a23-9805-4446650758c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:13.591433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1294/2569] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:39:13 2022] DELETE /identity/v3/projects/abafe4f087e64826b08404bf59d11a2d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:13.595233 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511b7bf-3996-4890-8472-87449835e295 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:13.605120 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511b7bf-3996-4890-8472-87449835e295 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:13.669187 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e893a9-a2b4-4931-aa69-37720f7d9d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:13.670003 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e893a9-a2b4-4931-aa69-37720f7d9d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:13.670292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e893a9-a2b4-4931-aa69-37720f7d9d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:13.670614 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e893a9-a2b4-4931-aa69-37720f7d9d95 admin admin] PATH_INFO: `/v3/users/516bf244cac247928cc6b252433f07ea` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:13.671814 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e893a9-a2b4-4931-aa69-37720f7d9d95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=516bf244cac247928cc6b252433f07ea)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:13.673779 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e893a9-a2b4-4931-aa69-37720f7d9d95 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:13.720617 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f4e893a9-a2b4-4931-aa69-37720f7d9d95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '516bf244cac247928cc6b252433f07ea'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:13.727812 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f4e893a9-a2b4-4931-aa69-37720f7d9d95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '516bf244cac247928cc6b252433f07ea'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:13.728454 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f4e893a9-a2b4-4931-aa69-37720f7d9d95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '516bf244cac247928cc6b252433f07ea'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:13.729111 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f4e893a9-a2b4-4931-aa69-37720f7d9d95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '516bf244cac247928cc6b252433f07ea'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:13.741613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f4e893a9-a2b4-4931-aa69-37720f7d9d95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '516bf244cac247928cc6b252433f07ea'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:13.754178 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1276/2570] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:39:13 2022] DELETE /identity/v3/users/516bf244cac247928cc6b252433f07ea => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:14.019255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306ed1c-6671-4a23-9805-4446650758c9 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:14.020707 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-3306ed1c-6671-4a23-9805-4446650758c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:14.034263 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306ed1c-6671-4a23-9805-4446650758c9 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:14.091723 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f054b14-b350-4f30-846d-aa92ee6031e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:14.092585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f054b14-b350-4f30-846d-aa92ee6031e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:14.092871 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f054b14-b350-4f30-846d-aa92ee6031e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:14.093151 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f054b14-b350-4f30-846d-aa92ee6031e4 admin admin] PATH_INFO: `/v3/projects/02953f590f044fc3b522b23b561dd472` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:14.094338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f054b14-b350-4f30-846d-aa92ee6031e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02953f590f044fc3b522b23b561dd472)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:14.096273 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f054b14-b350-4f30-846d-aa92ee6031e4 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:14.133098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:14.145114 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9f054b14-b350-4f30-846d-aa92ee6031e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02953f590f044fc3b522b23b561dd472', 'request_id': 'req-9f054b14-b350-4f30-846d-aa92ee6031e4'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:14.151376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9f054b14-b350-4f30-846d-aa92ee6031e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02953f590f044fc3b522b23b561dd472', 'request_id': 'req-9f054b14-b350-4f30-846d-aa92ee6031e4'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:14.158181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9f054b14-b350-4f30-846d-aa92ee6031e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02953f590f044fc3b522b23b561dd472', 'request_id': 'req-9f054b14-b350-4f30-846d-aa92ee6031e4'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:14.169047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9f054b14-b350-4f30-846d-aa92ee6031e4 admin admin] The token cache is being invalidate because project 02953f590f044fc3b522b23b561dd472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:39:14.169338 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9f054b14-b350-4f30-846d-aa92ee6031e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:14.169971 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9f054b14-b350-4f30-846d-aa92ee6031e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:14.171561 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1295/2571] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:39:14 2022] DELETE /identity/v3/projects/02953f590f044fc3b522b23b561dd472 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:14.176787 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb68377-17d0-4b4c-b06c-5474e9435a65 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:14.177305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb68377-17d0-4b4c-b06c-5474e9435a65 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:14.177506 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb68377-17d0-4b4c-b06c-5474e9435a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:14.196201 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4cb68377-17d0-4b4c-b06c-5474e9435a65 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:14.197353 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4cb68377-17d0-4b4c-b06c-5474e9435a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:14.232765 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:14.273510 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1277/2572] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:14.284286 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2855c4d-8909-4731-b019-67460f842ecf None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:14.284575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2855c4d-8909-4731-b019-67460f842ecf None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:14.284855 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2855c4d-8909-4731-b019-67460f842ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:14.305983 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-a2855c4d-8909-4731-b019-67460f842ecf None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:14.307497 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-a2855c4d-8909-4731-b019-67460f842ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:14.316066 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1296/2573] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:14.320398 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb68377-17d0-4b4c-b06c-5474e9435a65 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:14.330032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb68377-17d0-4b4c-b06c-5474e9435a65 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:14.334633 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f469018-1802-46ed-b0ac-7d22ce72f006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:14.335294 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f469018-1802-46ed-b0ac-7d22ce72f006 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:14.335584 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f469018-1802-46ed-b0ac-7d22ce72f006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:14.335863 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f469018-1802-46ed-b0ac-7d22ce72f006 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:14.336591 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f469018-1802-46ed-b0ac-7d22ce72f006 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:39:14.336904 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f469018-1802-46ed-b0ac-7d22ce72f006 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:14.338546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f469018-1802-46ed-b0ac-7d22ce72f006 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:14.349805 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1278/2574] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:39:14.353861 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2855c4d-8909-4731-b019-67460f842ecf None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:14.363548 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2855c4d-8909-4731-b019-67460f842ecf None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:14.368164 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d966df-9dc8-400b-bcb4-4d3789ce975f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:14.368834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d966df-9dc8-400b-bcb4-4d3789ce975f admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:14.369121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d966df-9dc8-400b-bcb4-4d3789ce975f admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:14.369399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d966df-9dc8-400b-bcb4-4d3789ce975f admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:14.370115 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d966df-9dc8-400b-bcb4-4d3789ce975f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:14.372762 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d966df-9dc8-400b-bcb4-4d3789ce975f admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:14.397464 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1297/2575] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:39:14 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:39:14.401638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f469018-1802-46ed-b0ac-7d22ce72f006 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:14.412134 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f469018-1802-46ed-b0ac-7d22ce72f006 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:14.469435 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f20257-3b38-4eb5-a20c-d28696d650c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:14.470058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f20257-3b38-4eb5-a20c-d28696d650c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:14.470344 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f20257-3b38-4eb5-a20c-d28696d650c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:14.470658 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f20257-3b38-4eb5-a20c-d28696d650c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:14.471343 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f20257-3b38-4eb5-a20c-d28696d650c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:14.473280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f20257-3b38-4eb5-a20c-d28696d650c5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:14.496679 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1279/2576] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:39:14 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:39:14.497856 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d966df-9dc8-400b-bcb4-4d3789ce975f admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:14.508224 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d966df-9dc8-400b-bcb4-4d3789ce975f admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:14.512881 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d1f11-681d-44ba-88a6-b9e194525344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:14.513533 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d1f11-681d-44ba-88a6-b9e194525344 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:14.513825 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d1f11-681d-44ba-88a6-b9e194525344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:14.514282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d1f11-681d-44ba-88a6-b9e194525344 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:14.515056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d1f11-681d-44ba-88a6-b9e194525344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:14.516672 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d1f11-681d-44ba-88a6-b9e194525344 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:14.527032 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1298/2577] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:14.530558 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f20257-3b38-4eb5-a20c-d28696d650c5 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:14.540616 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f20257-3b38-4eb5-a20c-d28696d650c5 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:14.545672 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7b0df-4d05-4599-90aa-b6fc5009c98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:14.546351 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7b0df-4d05-4599-90aa-b6fc5009c98e admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:14.546673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7b0df-4d05-4599-90aa-b6fc5009c98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:14.546956 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7b0df-4d05-4599-90aa-b6fc5009c98e admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:14.547689 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7b0df-4d05-4599-90aa-b6fc5009c98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:14.549295 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7b0df-4d05-4599-90aa-b6fc5009c98e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:14.559994 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1280/2578] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:14.564167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d1f11-681d-44ba-88a6-b9e194525344 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:14.574112 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d1f11-681d-44ba-88a6-b9e194525344 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:14.578754 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0ac0b-7b2b-442a-9ded-6e5be1f741f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:14.579636 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0ac0b-7b2b-442a-9ded-6e5be1f741f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:14.579927 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0ac0b-7b2b-442a-9ded-6e5be1f741f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:14.580208 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0ac0b-7b2b-442a-9ded-6e5be1f741f3 admin admin] PATH_INFO: `/v3/projects/b5f2186be5c64d3eb1d58220f794e121/users/53828c2066b549178529db0e53baedb2/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:14.598095 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0ac0b-7b2b-442a-9ded-6e5be1f741f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f2186be5c64d3eb1d58220f794e121, user_id=53828c2066b549178529db0e53baedb2, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:14.600798 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0ac0b-7b2b-442a-9ded-6e5be1f741f3 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:14.615064 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1299/2579] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:39:14 2022] PUT /identity/v3/projects/b5f2186be5c64d3eb1d58220f794e121/users/53828c2066b549178529db0e53baedb2/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:39:14.626342 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ead53-1f85-4ba6-a10f-22093b6ce02e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:14.626681 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ead53-1f85-4ba6-a10f-22093b6ce02e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:14.626966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ead53-1f85-4ba6-a10f-22093b6ce02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:14.653752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-058ead53-1f85-4ba6-a10f-22093b6ce02e None None] MFA Rules not processed for user `53828c2066b549178529db0e53baedb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:14.655010 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-058ead53-1f85-4ba6-a10f-22093b6ce02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:14.717942 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1281/2580] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:14.729009 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0ac0b-7b2b-442a-9ded-6e5be1f741f3 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:14.731339 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-60d0ac0b-7b2b-442a-9ded-6e5be1f741f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:14.787214 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0ac0b-7b2b-442a-9ded-6e5be1f741f3 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:14.791884 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bbb6b-feaf-4891-bf5f-4c9decdcb3c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:14.792729 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bbb6b-feaf-4891-bf5f-4c9decdcb3c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:14.793123 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bbb6b-feaf-4891-bf5f-4c9decdcb3c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:14.793433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bbb6b-feaf-4891-bf5f-4c9decdcb3c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:14.803279 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9bbb6b-feaf-4891-bf5f-4c9decdcb3c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:14.804734 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9bbb6b-feaf-4891-bf5f-4c9decdcb3c4 service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:14.814017 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1300/2581] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:39:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:24.714433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:24.809854 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:DELETE=5,keystone:SELECT=64,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:26.236345 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ead53-1f85-4ba6-a10f-22093b6ce02e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:26.311749 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ead53-1f85-4ba6-a10f-22093b6ce02e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:26.317522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e31221-9cd7-4bb2-9901-f3fb6ce0da31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:26.318771 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e31221-9cd7-4bb2-9901-f3fb6ce0da31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:26.319169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e31221-9cd7-4bb2-9901-f3fb6ce0da31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:26.319699 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e31221-9cd7-4bb2-9901-f3fb6ce0da31 admin admin] PATH_INFO: `/v3/users/53828c2066b549178529db0e53baedb2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:26.321030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e31221-9cd7-4bb2-9901-f3fb6ce0da31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53828c2066b549178529db0e53baedb2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:26.323463 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e31221-9cd7-4bb2-9901-f3fb6ce0da31 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:26.373439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-74e31221-9cd7-4bb2-9901-f3fb6ce0da31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53828c2066b549178529db0e53baedb2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:26.381401 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-74e31221-9cd7-4bb2-9901-f3fb6ce0da31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53828c2066b549178529db0e53baedb2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:26.382148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-74e31221-9cd7-4bb2-9901-f3fb6ce0da31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53828c2066b549178529db0e53baedb2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:26.382898 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-74e31221-9cd7-4bb2-9901-f3fb6ce0da31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53828c2066b549178529db0e53baedb2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:26.400727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-74e31221-9cd7-4bb2-9901-f3fb6ce0da31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53828c2066b549178529db0e53baedb2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:26.418927 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1282/2582] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:39:26 2022] DELETE /identity/v3/users/53828c2066b549178529db0e53baedb2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:26.426212 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01a6cb-ffcd-493c-81f1-8fa5c0bbdbbb None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:26.426829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01a6cb-ffcd-493c-81f1-8fa5c0bbdbbb None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:26.426829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01a6cb-ffcd-493c-81f1-8fa5c0bbdbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:26.446386 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-6d01a6cb-ffcd-493c-81f1-8fa5c0bbdbbb None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:26.447795 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-6d01a6cb-ffcd-493c-81f1-8fa5c0bbdbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:26.517850 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1301/2583] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:26.528128 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e31221-9cd7-4bb2-9901-f3fb6ce0da31 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:26.529542 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-74e31221-9cd7-4bb2-9901-f3fb6ce0da31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:26.588169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e31221-9cd7-4bb2-9901-f3fb6ce0da31 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:26.592487 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806d890-31d9-445b-bf8f-43febafe889b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:26.593139 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806d890-31d9-445b-bf8f-43febafe889b service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:26.593433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806d890-31d9-445b-bf8f-43febafe889b service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:26.593715 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806d890-31d9-445b-bf8f-43febafe889b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:26.603455 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806d890-31d9-445b-bf8f-43febafe889b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:26.604522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806d890-31d9-445b-bf8f-43febafe889b service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:26.614421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1283/2584] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:39:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:26.906820 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01a6cb-ffcd-493c-81f1-8fa5c0bbdbbb None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:26.908298 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-6d01a6cb-ffcd-493c-81f1-8fa5c0bbdbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:26.923876 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01a6cb-ffcd-493c-81f1-8fa5c0bbdbbb None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:26.929303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d8d8d-a409-48a2-b7ab-3e42446d7197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:26.930179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d8d8d-a409-48a2-b7ab-3e42446d7197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:26.930471 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d8d8d-a409-48a2-b7ab-3e42446d7197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:26.931681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d8d8d-a409-48a2-b7ab-3e42446d7197 admin admin] PATH_INFO: `/v3/projects/b5f2186be5c64d3eb1d58220f794e121` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:26.933095 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d8d8d-a409-48a2-b7ab-3e42446d7197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5f2186be5c64d3eb1d58220f794e121)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:26.935118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d8d8d-a409-48a2-b7ab-3e42446d7197 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:26.986378 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-847d8d8d-a409-48a2-b7ab-3e42446d7197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f2186be5c64d3eb1d58220f794e121', 'request_id': 'req-847d8d8d-a409-48a2-b7ab-3e42446d7197'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:26.992673 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-847d8d8d-a409-48a2-b7ab-3e42446d7197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f2186be5c64d3eb1d58220f794e121', 'request_id': 'req-847d8d8d-a409-48a2-b7ab-3e42446d7197'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:27.000767 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-847d8d8d-a409-48a2-b7ab-3e42446d7197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f2186be5c64d3eb1d58220f794e121', 'request_id': 'req-847d8d8d-a409-48a2-b7ab-3e42446d7197'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:27.012421 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-847d8d8d-a409-48a2-b7ab-3e42446d7197 admin admin] The token cache is being invalidate because project b5f2186be5c64d3eb1d58220f794e121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:39:27.012709 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-847d8d8d-a409-48a2-b7ab-3e42446d7197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:27.013330 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-847d8d8d-a409-48a2-b7ab-3e42446d7197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:27.014892 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1302/2585] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:39:26 2022] DELETE /identity/v3/projects/b5f2186be5c64d3eb1d58220f794e121 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:27.021019 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a7ef3-9bf2-43ae-9594-f27094b05e6e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:27.021552 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a7ef3-9bf2-43ae-9594-f27094b05e6e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:27.021911 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a7ef3-9bf2-43ae-9594-f27094b05e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:27.040425 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-e47a7ef3-9bf2-43ae-9594-f27094b05e6e None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:27.041889 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e47a7ef3-9bf2-43ae-9594-f27094b05e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:27.061951 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:27.124286 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d8d8d-a409-48a2-b7ab-3e42446d7197 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:27.124482 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1284/2586] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:27.125939 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-847d8d8d-a409-48a2-b7ab-3e42446d7197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:27.132697 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3b80e-01f6-4e2c-b530-708a56319a51 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:27.133002 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3b80e-01f6-4e2c-b530-708a56319a51 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:27.133283 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3b80e-01f6-4e2c-b530-708a56319a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:27.152537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d0d3b80e-01f6-4e2c-b530-708a56319a51 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:27.153863 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d0d3b80e-01f6-4e2c-b530-708a56319a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:27.165897 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1285/2587] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:39:27.167480 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3b80e-01f6-4e2c-b530-708a56319a51 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:27.177287 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3b80e-01f6-4e2c-b530-708a56319a51 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:27.189917 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6afb1a0-a902-4d7a-acf5-5db8a1882198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:27.190602 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afb1a0-a902-4d7a-acf5-5db8a1882198 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:27.190898 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afb1a0-a902-4d7a-acf5-5db8a1882198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:27.191389 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afb1a0-a902-4d7a-acf5-5db8a1882198 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:27.192668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6afb1a0-a902-4d7a-acf5-5db8a1882198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:39:27.192993 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6afb1a0-a902-4d7a-acf5-5db8a1882198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:27.196131 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6afb1a0-a902-4d7a-acf5-5db8a1882198 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:27.211856 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1286/2588] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:39:27.214484 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d8d8d-a409-48a2-b7ab-3e42446d7197 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:27.216326 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6afb1a0-a902-4d7a-acf5-5db8a1882198 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:27.222374 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26a1af-d2bf-41bb-8083-69f6c13354ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:27.223394 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26a1af-d2bf-41bb-8083-69f6c13354ea service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:27.224127 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26a1af-d2bf-41bb-8083-69f6c13354ea service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:27.224634 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26a1af-d2bf-41bb-8083-69f6c13354ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:27.226750 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-8a26a1af-d2bf-41bb-8083-69f6c13354ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:27.229166 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6afb1a0-a902-4d7a-acf5-5db8a1882198 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:27.235993 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd2bc1-4b66-4f47-b4ce-cd8d91fe6fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:27.236725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd2bc1-4b66-4f47-b4ce-cd8d91fe6fbc admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:27.237309 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd2bc1-4b66-4f47-b4ce-cd8d91fe6fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:27.237456 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd2bc1-4b66-4f47-b4ce-cd8d91fe6fbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:27.238162 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd2bc1-4b66-4f47-b4ce-cd8d91fe6fbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:27.240271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd2bc1-4b66-4f47-b4ce-cd8d91fe6fbc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:27.242224 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26a1af-d2bf-41bb-8083-69f6c13354ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:27.244306 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26a1af-d2bf-41bb-8083-69f6c13354ea service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:27.258273 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1303/2589] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:39:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:39:27.270903 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1287/2590] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:39:27 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:39:27.275182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26a1af-d2bf-41bb-8083-69f6c13354ea service nova] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:27.287923 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26a1af-d2bf-41bb-8083-69f6c13354ea service nova] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:27.294378 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:27.387824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88d25f-fbc9-4328-a800-5a88e5622309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:27.389141 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88d25f-fbc9-4328-a800-5a88e5622309 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:27.389443 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88d25f-fbc9-4328-a800-5a88e5622309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:27.389732 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88d25f-fbc9-4328-a800-5a88e5622309 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:27.390456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88d25f-fbc9-4328-a800-5a88e5622309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:27.393227 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88d25f-fbc9-4328-a800-5a88e5622309 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:27.416019 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1304/2591] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:39:27 2022] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:39:27.421098 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd2bc1-4b66-4f47-b4ce-cd8d91fe6fbc admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:27.433416 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd2bc1-4b66-4f47-b4ce-cd8d91fe6fbc admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:27.440371 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3e313-462f-4495-afae-2bab5e6a67f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:27.441454 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e313-462f-4495-afae-2bab5e6a67f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:27.441854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e313-462f-4495-afae-2bab5e6a67f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:27.442411 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e313-462f-4495-afae-2bab5e6a67f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:27.444334 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3e313-462f-4495-afae-2bab5e6a67f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:27.449315 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3e313-462f-4495-afae-2bab5e6a67f0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:27.462553 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1288/2592] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:27.467300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88d25f-fbc9-4328-a800-5a88e5622309 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:27.480039 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88d25f-fbc9-4328-a800-5a88e5622309 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:27.485619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3cccbd-e914-4a74-aee7-1c9e5f2301bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:27.486300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cccbd-e914-4a74-aee7-1c9e5f2301bd admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:27.486753 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cccbd-e914-4a74-aee7-1c9e5f2301bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:27.487043 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cccbd-e914-4a74-aee7-1c9e5f2301bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:27.487919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3cccbd-e914-4a74-aee7-1c9e5f2301bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:27.489795 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3cccbd-e914-4a74-aee7-1c9e5f2301bd admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:27.502874 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1305/2593] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:27.507171 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3e313-462f-4495-afae-2bab5e6a67f0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:27.517955 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3e313-462f-4495-afae-2bab5e6a67f0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:27.522866 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9610362-96d3-4ad4-ac02-dda3e3263167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:27.523833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9610362-96d3-4ad4-ac02-dda3e3263167 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:27.524072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9610362-96d3-4ad4-ac02-dda3e3263167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:27.524351 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9610362-96d3-4ad4-ac02-dda3e3263167 admin admin] PATH_INFO: `/v3/projects/5fc5bc6fc05c499abc35964fe65dcdf7/users/47eb60158ccc440eb62f7f38f5513f99/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:27.543732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9610362-96d3-4ad4-ac02-dda3e3263167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc5bc6fc05c499abc35964fe65dcdf7, user_id=47eb60158ccc440eb62f7f38f5513f99, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:27.546480 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9610362-96d3-4ad4-ac02-dda3e3263167 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:27.562043 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1289/2594] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:39:27 2022] PUT /identity/v3/projects/5fc5bc6fc05c499abc35964fe65dcdf7/users/47eb60158ccc440eb62f7f38f5513f99/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:39:27.573060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2924f-1b16-4bcf-8225-accaccd80f69 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:27.573964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2924f-1b16-4bcf-8225-accaccd80f69 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:27.574259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2924f-1b16-4bcf-8225-accaccd80f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:27.600985 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-e6a2924f-1b16-4bcf-8225-accaccd80f69 None None] MFA Rules not processed for user `47eb60158ccc440eb62f7f38f5513f99`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:27.602300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e6a2924f-1b16-4bcf-8225-accaccd80f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:27.668317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1306/2595] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:27.679296 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9610362-96d3-4ad4-ac02-dda3e3263167 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:27.681330 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b9610362-96d3-4ad4-ac02-dda3e3263167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:27.749594 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9610362-96d3-4ad4-ac02-dda3e3263167 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:27.753499 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd702ab3-3fb0-4af1-8e16-d663fecfd334 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:27.754169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd702ab3-3fb0-4af1-8e16-d663fecfd334 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:27.754461 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd702ab3-3fb0-4af1-8e16-d663fecfd334 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:27.754779 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd702ab3-3fb0-4af1-8e16-d663fecfd334 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:27.765287 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd702ab3-3fb0-4af1-8e16-d663fecfd334 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:27.767081 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd702ab3-3fb0-4af1-8e16-d663fecfd334 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:27.778245 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1290/2596] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:39:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:29.227208 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10bbf0-554f-43b0-a226-ea20dca6421b None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:29.227706 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10bbf0-554f-43b0-a226-ea20dca6421b None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:29.227819 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10bbf0-554f-43b0-a226-ea20dca6421b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:29.245655 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-9a10bbf0-554f-43b0-a226-ea20dca6421b None None] MFA Rules not processed for user `47eb60158ccc440eb62f7f38f5513f99`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:29.246911 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-9a10bbf0-554f-43b0-a226-ea20dca6421b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:29.253622 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1307/2597] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:34.661155 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af118149-e43d-4403-b8e1-76609625e03d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:34.661650 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af118149-e43d-4403-b8e1-76609625e03d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:34.661768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af118149-e43d-4403-b8e1-76609625e03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:34.680607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-af118149-e43d-4403-b8e1-76609625e03d None None] MFA Rules not processed for user `eb30fc9bc5a04139b2a364ff03f4ad60`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:34.682619 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-af118149-e43d-4403-b8e1-76609625e03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:34.734280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:34.752069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1291/2598] 10.222.0.25 () {58 vars in 967 bytes} [Mon May 23 12:39:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:34.788601 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10bbf0-554f-43b0-a226-ea20dca6421b None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:34.790170 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-9a10bbf0-554f-43b0-a226-ea20dca6421b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:34.877812 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10bbf0-554f-43b0-a226-ea20dca6421b None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:34.884323 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931ef0e-2e11-40ad-8ce6-1b1c681ed94e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03ca1edc22174d258ddeda25407ee6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:34.884999 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931ef0e-2e11-40ad-8ce6-1b1c681ed94e service swift] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:34.885335 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931ef0e-2e11-40ad-8ce6-1b1c681ed94e service swift] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:34.885620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931ef0e-2e11-40ad-8ce6-1b1c681ed94e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:34.895271 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931ef0e-2e11-40ad-8ce6-1b1c681ed94e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:34.897161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931ef0e-2e11-40ad-8ce6-1b1c681ed94e service swift] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:34.904065 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:34.909462 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1308/2599] 10.222.0.25 () {60 vars in 1384 bytes} [Mon May 23 12:39:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:39:38.956314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af118149-e43d-4403-b8e1-76609625e03d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:38.957974 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-af118149-e43d-4403-b8e1-76609625e03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:39.075420 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af118149-e43d-4403-b8e1-76609625e03d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:39.080972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168ca9a-61ae-4dc7-9535-428a911eb955 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fde90ab1e0490ebb7cb514173d984e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:39.081644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168ca9a-61ae-4dc7-9535-428a911eb955 service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:39.081933 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168ca9a-61ae-4dc7-9535-428a911eb955 service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:39.082361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168ca9a-61ae-4dc7-9535-428a911eb955 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:39.084615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f168ca9a-61ae-4dc7-9535-428a911eb955 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:39.102907 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168ca9a-61ae-4dc7-9535-428a911eb955 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:39.104800 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168ca9a-61ae-4dc7-9535-428a911eb955 service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:39.117222 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1292/2600] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:39:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:43.392550 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931ef0e-2e11-40ad-8ce6-1b1c681ed94e service swift] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:43.393981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-d931ef0e-2e11-40ad-8ce6-1b1c681ed94e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:43.501604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931ef0e-2e11-40ad-8ce6-1b1c681ed94e service swift] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:43.508875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9ed3b-cb1c-494c-b738-5d591b562a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:43.510564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9ed3b-cb1c-494c-b738-5d591b562a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:43.511553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9ed3b-cb1c-494c-b738-5d591b562a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:43.512121 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9ed3b-cb1c-494c-b738-5d591b562a2a admin admin] PATH_INFO: `/v3/users/776f8c38dc43442e9ec24d4e97c0152a` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:43.513974 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9ed3b-cb1c-494c-b738-5d591b562a2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=776f8c38dc43442e9ec24d4e97c0152a)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:43.516822 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9ed3b-cb1c-494c-b738-5d591b562a2a admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:43.579676 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-faa9ed3b-cb1c-494c-b738-5d591b562a2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '776f8c38dc43442e9ec24d4e97c0152a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:43.590413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-faa9ed3b-cb1c-494c-b738-5d591b562a2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '776f8c38dc43442e9ec24d4e97c0152a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:43.605450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-faa9ed3b-cb1c-494c-b738-5d591b562a2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '776f8c38dc43442e9ec24d4e97c0152a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:43.613683 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-faa9ed3b-cb1c-494c-b738-5d591b562a2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '776f8c38dc43442e9ec24d4e97c0152a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:43.614410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-faa9ed3b-cb1c-494c-b738-5d591b562a2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '776f8c38dc43442e9ec24d4e97c0152a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:43.624446 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1309/2601] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:39:43 2022] DELETE /identity/v3/users/776f8c38dc43442e9ec24d4e97c0152a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:43.925342 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168ca9a-61ae-4dc7-9535-428a911eb955 service placement] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:43.938626 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168ca9a-61ae-4dc7-9535-428a911eb955 service placement] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:44.026432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196862d-adfb-488b-b3d1-dc07f61adb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:44.027273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196862d-adfb-488b-b3d1-dc07f61adb0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:44.027564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196862d-adfb-488b-b3d1-dc07f61adb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:44.027844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196862d-adfb-488b-b3d1-dc07f61adb0b admin admin] PATH_INFO: `/v3/projects/797b3861a8ab4f29ab0cd28e711aeb3e` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:44.029063 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196862d-adfb-488b-b3d1-dc07f61adb0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=797b3861a8ab4f29ab0cd28e711aeb3e)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:44.031225 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196862d-adfb-488b-b3d1-dc07f61adb0b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:44.090038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f196862d-adfb-488b-b3d1-dc07f61adb0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '797b3861a8ab4f29ab0cd28e711aeb3e', 'request_id': 'req-f196862d-adfb-488b-b3d1-dc07f61adb0b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:44.096601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f196862d-adfb-488b-b3d1-dc07f61adb0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '797b3861a8ab4f29ab0cd28e711aeb3e', 'request_id': 'req-f196862d-adfb-488b-b3d1-dc07f61adb0b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:44.102377 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f196862d-adfb-488b-b3d1-dc07f61adb0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '797b3861a8ab4f29ab0cd28e711aeb3e', 'request_id': 'req-f196862d-adfb-488b-b3d1-dc07f61adb0b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:44.115134 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f196862d-adfb-488b-b3d1-dc07f61adb0b admin admin] The token cache is being invalidate because project 797b3861a8ab4f29ab0cd28e711aeb3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:39:44.115428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f196862d-adfb-488b-b3d1-dc07f61adb0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:44.116060 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f196862d-adfb-488b-b3d1-dc07f61adb0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:44.117603 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1293/2602] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:39:43 2022] DELETE /identity/v3/projects/797b3861a8ab4f29ab0cd28e711aeb3e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:44.123293 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9ed3b-cb1c-494c-b738-5d591b562a2a admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:44.125366 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-faa9ed3b-cb1c-494c-b738-5d591b562a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:44.140336 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9ed3b-cb1c-494c-b738-5d591b562a2a admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:44.202064 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b156a-e2a7-4391-97ec-72ba37f25194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:44.202979 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b156a-e2a7-4391-97ec-72ba37f25194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:44.203267 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b156a-e2a7-4391-97ec-72ba37f25194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:44.203543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b156a-e2a7-4391-97ec-72ba37f25194 admin admin] PATH_INFO: `/v3/users/7cf232166d424ee0ae865129d6952fe9` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:44.204722 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b156a-e2a7-4391-97ec-72ba37f25194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cf232166d424ee0ae865129d6952fe9)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:44.206684 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b156a-e2a7-4391-97ec-72ba37f25194 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:44.230597 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:44.257133 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-370b156a-e2a7-4391-97ec-72ba37f25194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cf232166d424ee0ae865129d6952fe9'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:44.265978 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-370b156a-e2a7-4391-97ec-72ba37f25194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cf232166d424ee0ae865129d6952fe9'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:44.278876 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-370b156a-e2a7-4391-97ec-72ba37f25194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cf232166d424ee0ae865129d6952fe9'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:44.285574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-370b156a-e2a7-4391-97ec-72ba37f25194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cf232166d424ee0ae865129d6952fe9'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:44.286328 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-370b156a-e2a7-4391-97ec-72ba37f25194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cf232166d424ee0ae865129d6952fe9'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:44.292219 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1310/2603] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:39:44 2022] DELETE /identity/v3/users/7cf232166d424ee0ae865129d6952fe9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:39:44.465694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196862d-adfb-488b-b3d1-dc07f61adb0b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:44.467371 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f196862d-adfb-488b-b3d1-dc07f61adb0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:44.487149 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196862d-adfb-488b-b3d1-dc07f61adb0b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:44.497284 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:44.544897 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2eb6f8-5121-4172-a006-ba8163473e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:44.545686 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2eb6f8-5121-4172-a006-ba8163473e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:44.545972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2eb6f8-5121-4172-a006-ba8163473e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:44.546246 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2eb6f8-5121-4172-a006-ba8163473e15 admin admin] PATH_INFO: `/v3/projects/565f8f5005ed4e84871b94ea9c91f97f` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:44.547492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2eb6f8-5121-4172-a006-ba8163473e15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=565f8f5005ed4e84871b94ea9c91f97f)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:44.549414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2eb6f8-5121-4172-a006-ba8163473e15 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:44.597253 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2e2eb6f8-5121-4172-a006-ba8163473e15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '565f8f5005ed4e84871b94ea9c91f97f', 'request_id': 'req-2e2eb6f8-5121-4172-a006-ba8163473e15'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:44.603778 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2e2eb6f8-5121-4172-a006-ba8163473e15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '565f8f5005ed4e84871b94ea9c91f97f', 'request_id': 'req-2e2eb6f8-5121-4172-a006-ba8163473e15'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:44.609392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2e2eb6f8-5121-4172-a006-ba8163473e15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '565f8f5005ed4e84871b94ea9c91f97f', 'request_id': 'req-2e2eb6f8-5121-4172-a006-ba8163473e15'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:44.621860 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2e2eb6f8-5121-4172-a006-ba8163473e15 admin admin] The token cache is being invalidate because project 565f8f5005ed4e84871b94ea9c91f97f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:39:44.622162 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2e2eb6f8-5121-4172-a006-ba8163473e15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:44.622793 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2e2eb6f8-5121-4172-a006-ba8163473e15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:44.624535 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1294/2604] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:39:44 2022] DELETE /identity/v3/projects/565f8f5005ed4e84871b94ea9c91f97f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:46.315986 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b156a-e2a7-4391-97ec-72ba37f25194 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:46.317400 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-370b156a-e2a7-4391-97ec-72ba37f25194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:46.375392 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b156a-e2a7-4391-97ec-72ba37f25194 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:46.426486 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed1f99-86a0-401c-b4e8-da23627f93e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:46.427189 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed1f99-86a0-401c-b4e8-da23627f93e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:46.427482 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed1f99-86a0-401c-b4e8-da23627f93e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:46.427765 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed1f99-86a0-401c-b4e8-da23627f93e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:46.429573 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-f6ed1f99-86a0-401c-b4e8-da23627f93e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:46.492687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed1f99-86a0-401c-b4e8-da23627f93e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:46.494599 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed1f99-86a0-401c-b4e8-da23627f93e2 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:46.504249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1311/2605] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:39:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:47.131466 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327eea88-715e-4533-86ee-4f2b5871b5ec None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:47.131950 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327eea88-715e-4533-86ee-4f2b5871b5ec None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:47.132048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327eea88-715e-4533-86ee-4f2b5871b5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:47.149959 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-327eea88-715e-4533-86ee-4f2b5871b5ec None None] MFA Rules not processed for user `eb30fc9bc5a04139b2a364ff03f4ad60`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:47.151733 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-327eea88-715e-4533-86ee-4f2b5871b5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:47.209496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1295/2606] 10.222.0.25 () {58 vars in 1009 bytes} [Mon May 23 12:39:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:47.223489 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed1f99-86a0-401c-b4e8-da23627f93e2 service neutron] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:47.224874 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-f6ed1f99-86a0-401c-b4e8-da23627f93e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:47.231057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:47.297522 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed1f99-86a0-401c-b4e8-da23627f93e2 service neutron] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:47.302424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54450296-2333-4329-8fa7-c7bd4b2ef854 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03ca1edc22174d258ddeda25407ee6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:47.303097 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54450296-2333-4329-8fa7-c7bd4b2ef854 service swift] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:47.303381 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54450296-2333-4329-8fa7-c7bd4b2ef854 service swift] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:47.303655 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54450296-2333-4329-8fa7-c7bd4b2ef854 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:47.312342 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54450296-2333-4329-8fa7-c7bd4b2ef854 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:47.313933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54450296-2333-4329-8fa7-c7bd4b2ef854 service swift] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:47.323155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1312/2607] 10.222.0.25 () {60 vars in 1384 bytes} [Mon May 23 12:39:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:39:47.876562 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407efbd-3e82-4b12-8365-e776fb3796c5 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:47.876862 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407efbd-3e82-4b12-8365-e776fb3796c5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:47.877142 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407efbd-3e82-4b12-8365-e776fb3796c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:47.894994 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d407efbd-3e82-4b12-8365-e776fb3796c5 None None] MFA Rules not processed for user `eb30fc9bc5a04139b2a364ff03f4ad60`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:47.896211 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d407efbd-3e82-4b12-8365-e776fb3796c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:47.904177 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1296/2608] 10.222.0.25 () {58 vars in 967 bytes} [Mon May 23 12:39:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:47.916820 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54450296-2333-4329-8fa7-c7bd4b2ef854 service swift] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:47.927163 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54450296-2333-4329-8fa7-c7bd4b2ef854 service swift] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:47.932935 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd301318-c7d7-4540-939e-676390dd86ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03ca1edc22174d258ddeda25407ee6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:47.933567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd301318-c7d7-4540-939e-676390dd86ae service swift] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:47.933849 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd301318-c7d7-4540-939e-676390dd86ae service swift] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:47.934126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd301318-c7d7-4540-939e-676390dd86ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:47.942464 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd301318-c7d7-4540-939e-676390dd86ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:47.944092 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd301318-c7d7-4540-939e-676390dd86ae service swift] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:47.952557 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1313/2609] 10.222.0.25 () {60 vars in 1384 bytes} [Mon May 23 12:39:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:39:48.162185 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57458e9c-2150-4468-9c21-24cf387e9019 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:48.162734 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57458e9c-2150-4468-9c21-24cf387e9019 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:48.162853 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57458e9c-2150-4468-9c21-24cf387e9019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:48.183433 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-57458e9c-2150-4468-9c21-24cf387e9019 None None] MFA Rules not processed for user `eb30fc9bc5a04139b2a364ff03f4ad60`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:48.184785 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-57458e9c-2150-4468-9c21-24cf387e9019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:48.192748 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1297/2610] 10.222.0.25 () {58 vars in 1009 bytes} [Mon May 23 12:39:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:48.205795 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd301318-c7d7-4540-939e-676390dd86ae service swift] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:48.217994 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd301318-c7d7-4540-939e-676390dd86ae service swift] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:48.225216 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af93878-743b-4408-bb03-3f352398532f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03ca1edc22174d258ddeda25407ee6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:48.226020 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af93878-743b-4408-bb03-3f352398532f service swift] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:48.226518 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af93878-743b-4408-bb03-3f352398532f service swift] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:48.226809 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af93878-743b-4408-bb03-3f352398532f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:48.236710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af93878-743b-4408-bb03-3f352398532f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:48.238386 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af93878-743b-4408-bb03-3f352398532f service swift] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:48.247524 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1314/2611] 10.222.0.25 () {60 vars in 1384 bytes} [Mon May 23 12:39:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:39:48.632080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13a42d-92a4-4ad2-b94c-fb982ff45de6 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:48.632377 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13a42d-92a4-4ad2-b94c-fb982ff45de6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:48.632663 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13a42d-92a4-4ad2-b94c-fb982ff45de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:48.659083 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ac13a42d-92a4-4ad2-b94c-fb982ff45de6 None None] MFA Rules not processed for user `eb30fc9bc5a04139b2a364ff03f4ad60`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:48.660383 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ac13a42d-92a4-4ad2-b94c-fb982ff45de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:48.671658 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1298/2612] 10.222.0.25 () {58 vars in 967 bytes} [Mon May 23 12:39:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:48.685142 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af93878-743b-4408-bb03-3f352398532f service swift] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:48.695941 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af93878-743b-4408-bb03-3f352398532f service swift] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:48.702153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9935704-6def-4399-9e3d-bf323d7c11aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03ca1edc22174d258ddeda25407ee6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:48.702938 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9935704-6def-4399-9e3d-bf323d7c11aa service swift] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:48.703116 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9935704-6def-4399-9e3d-bf323d7c11aa service swift] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:48.703566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9935704-6def-4399-9e3d-bf323d7c11aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:48.712978 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9935704-6def-4399-9e3d-bf323d7c11aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:48.714596 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9935704-6def-4399-9e3d-bf323d7c11aa service swift] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:48.722638 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1315/2613] 10.222.0.25 () {60 vars in 1384 bytes} [Mon May 23 12:39:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 12:39:49.927518 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13a42d-92a4-4ad2-b94c-fb982ff45de6 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:49.929044 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ac13a42d-92a4-4ad2-b94c-fb982ff45de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:49.958526 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13a42d-92a4-4ad2-b94c-fb982ff45de6 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:49.963693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc38ba-2a3f-43e2-ae3d-baa3a0926b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:49.964557 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc38ba-2a3f-43e2-ae3d-baa3a0926b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:49.964841 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc38ba-2a3f-43e2-ae3d-baa3a0926b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:49.965118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc38ba-2a3f-43e2-ae3d-baa3a0926b50 admin admin] PATH_INFO: `/v3/users/ce751e35d8184c809a942b4187e88cb0` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:49.966360 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc38ba-2a3f-43e2-ae3d-baa3a0926b50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce751e35d8184c809a942b4187e88cb0)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:49.968357 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc38ba-2a3f-43e2-ae3d-baa3a0926b50 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:49.993087 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:50.017171 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-25fc38ba-2a3f-43e2-ae3d-baa3a0926b50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce751e35d8184c809a942b4187e88cb0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:50.024698 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-25fc38ba-2a3f-43e2-ae3d-baa3a0926b50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce751e35d8184c809a942b4187e88cb0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:50.025768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-25fc38ba-2a3f-43e2-ae3d-baa3a0926b50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce751e35d8184c809a942b4187e88cb0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:50.026380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-25fc38ba-2a3f-43e2-ae3d-baa3a0926b50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce751e35d8184c809a942b4187e88cb0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:50.043824 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-25fc38ba-2a3f-43e2-ae3d-baa3a0926b50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce751e35d8184c809a942b4187e88cb0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:50.056608 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1299/2614] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:39:49 2022] DELETE /identity/v3/users/ce751e35d8184c809a942b4187e88cb0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:50.233863 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9935704-6def-4399-9e3d-bf323d7c11aa service swift] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:50.245303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9935704-6def-4399-9e3d-bf323d7c11aa service swift] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:50.302723 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3deedb-a8ae-4c83-af88-63dc11733fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:50.303589 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3deedb-a8ae-4c83-af88-63dc11733fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:50.303878 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3deedb-a8ae-4c83-af88-63dc11733fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:50.304162 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3deedb-a8ae-4c83-af88-63dc11733fbb admin admin] PATH_INFO: `/v3/projects/b3c2260d6d3a4d1eaf61991cf0567887` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:50.305590 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3deedb-a8ae-4c83-af88-63dc11733fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c2260d6d3a4d1eaf61991cf0567887)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:50.308225 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3deedb-a8ae-4c83-af88-63dc11733fbb admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:50.354883 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0a3deedb-a8ae-4c83-af88-63dc11733fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c2260d6d3a4d1eaf61991cf0567887', 'request_id': 'req-0a3deedb-a8ae-4c83-af88-63dc11733fbb'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:50.360882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0a3deedb-a8ae-4c83-af88-63dc11733fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c2260d6d3a4d1eaf61991cf0567887', 'request_id': 'req-0a3deedb-a8ae-4c83-af88-63dc11733fbb'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:50.363370 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:50.368735 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0a3deedb-a8ae-4c83-af88-63dc11733fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c2260d6d3a4d1eaf61991cf0567887', 'request_id': 'req-0a3deedb-a8ae-4c83-af88-63dc11733fbb'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:50.381021 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0a3deedb-a8ae-4c83-af88-63dc11733fbb admin admin] The token cache is being invalidate because project b3c2260d6d3a4d1eaf61991cf0567887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:39:50.381311 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0a3deedb-a8ae-4c83-af88-63dc11733fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:50.381952 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0a3deedb-a8ae-4c83-af88-63dc11733fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:50.383511 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1316/2615] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:39:50 2022] DELETE /identity/v3/projects/b3c2260d6d3a4d1eaf61991cf0567887 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:50.388620 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c56ec-ce11-44cb-8007-dfe6cef1ee70 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:50.388912 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c56ec-ce11-44cb-8007-dfe6cef1ee70 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:50.389191 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c56ec-ce11-44cb-8007-dfe6cef1ee70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:50.406740 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-528c56ec-ce11-44cb-8007-dfe6cef1ee70 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:50.407979 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-528c56ec-ce11-44cb-8007-dfe6cef1ee70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:50.470317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1300/2616] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:50.478165 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd05fb-fc40-4f5d-87f9-068a6a81ab8e None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:50.478579 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd05fb-fc40-4f5d-87f9-068a6a81ab8e None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:50.478874 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd05fb-fc40-4f5d-87f9-068a6a81ab8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:50.508715 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-3fbd05fb-fc40-4f5d-87f9-068a6a81ab8e None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:50.510439 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-3fbd05fb-fc40-4f5d-87f9-068a6a81ab8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:50.518393 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1317/2617] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:50.522783 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c56ec-ce11-44cb-8007-dfe6cef1ee70 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:50.533119 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c56ec-ce11-44cb-8007-dfe6cef1ee70 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:50.537694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016418ca-bedb-4e54-8c7a-ac6ca4c3d2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:50.538349 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016418ca-bedb-4e54-8c7a-ac6ca4c3d2ad admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:50.538674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016418ca-bedb-4e54-8c7a-ac6ca4c3d2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:50.538970 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016418ca-bedb-4e54-8c7a-ac6ca4c3d2ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:50.539683 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016418ca-bedb-4e54-8c7a-ac6ca4c3d2ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:39:50.539992 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016418ca-bedb-4e54-8c7a-ac6ca4c3d2ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:50.542118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016418ca-bedb-4e54-8c7a-ac6ca4c3d2ad admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:50.553533 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1301/2618] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:39:50.558619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd05fb-fc40-4f5d-87f9-068a6a81ab8e None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:50.567874 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd05fb-fc40-4f5d-87f9-068a6a81ab8e None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:50.572457 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bcde4-b788-4753-833e-1fd9c8e52be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:50.573101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bcde4-b788-4753-833e-1fd9c8e52be4 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:50.573391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bcde4-b788-4753-833e-1fd9c8e52be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:50.573673 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bcde4-b788-4753-833e-1fd9c8e52be4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:50.574387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bcde4-b788-4753-833e-1fd9c8e52be4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:50.576350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bcde4-b788-4753-833e-1fd9c8e52be4 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:50.601600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1318/2619] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:39:50 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:39:50.606374 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016418ca-bedb-4e54-8c7a-ac6ca4c3d2ad admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:50.616256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016418ca-bedb-4e54-8c7a-ac6ca4c3d2ad admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:50.672296 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9b9f6-1d39-459b-8a19-16a68a0f9b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:50.672967 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9b9f6-1d39-459b-8a19-16a68a0f9b20 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:50.673254 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9b9f6-1d39-459b-8a19-16a68a0f9b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:50.673534 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9b9f6-1d39-459b-8a19-16a68a0f9b20 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:50.674250 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9b9f6-1d39-459b-8a19-16a68a0f9b20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:50.676245 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9b9f6-1d39-459b-8a19-16a68a0f9b20 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:50.699521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1302/2620] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:39:50 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:39:50.700631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bcde4-b788-4753-833e-1fd9c8e52be4 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:50.711032 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bcde4-b788-4753-833e-1fd9c8e52be4 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:50.716026 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027dd10-6be4-4eed-b107-261bd2728a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:50.716692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027dd10-6be4-4eed-b107-261bd2728a75 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:50.716976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027dd10-6be4-4eed-b107-261bd2728a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:50.717253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027dd10-6be4-4eed-b107-261bd2728a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:50.717989 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027dd10-6be4-4eed-b107-261bd2728a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:50.719622 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027dd10-6be4-4eed-b107-261bd2728a75 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:50.730463 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1319/2621] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:39:50.734228 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9b9f6-1d39-459b-8a19-16a68a0f9b20 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:50.748556 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9b9f6-1d39-459b-8a19-16a68a0f9b20 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:50.757824 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29fd9c-b387-4c09-8591-a51b4cdf88df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:50.758495 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29fd9c-b387-4c09-8591-a51b4cdf88df admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:50.758815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29fd9c-b387-4c09-8591-a51b4cdf88df admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:50.759095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29fd9c-b387-4c09-8591-a51b4cdf88df admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:50.759826 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29fd9c-b387-4c09-8591-a51b4cdf88df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:50.761499 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29fd9c-b387-4c09-8591-a51b4cdf88df admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:50.771717 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1303/2622] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:50.776328 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027dd10-6be4-4eed-b107-261bd2728a75 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:50.786510 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027dd10-6be4-4eed-b107-261bd2728a75 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:50.791919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61de60-cf4c-4d8a-b62b-4be07b589ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:50.792802 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61de60-cf4c-4d8a-b62b-4be07b589ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:50.793094 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61de60-cf4c-4d8a-b62b-4be07b589ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:50.793376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61de60-cf4c-4d8a-b62b-4be07b589ff3 admin admin] PATH_INFO: `/v3/projects/e934fb2d53c94573a205707575b669a2/users/f63eebaa4be24f64966af298b7acb127/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:50.810771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61de60-cf4c-4d8a-b62b-4be07b589ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e934fb2d53c94573a205707575b669a2, user_id=f63eebaa4be24f64966af298b7acb127, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:50.813458 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61de60-cf4c-4d8a-b62b-4be07b589ff3 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:50.826026 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1320/2623] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:39:50 2022] PUT /identity/v3/projects/e934fb2d53c94573a205707575b669a2/users/f63eebaa4be24f64966af298b7acb127/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:50.836874 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c3577-be03-4e0d-bd40-0e4c1913a00a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:50.837171 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c3577-be03-4e0d-bd40-0e4c1913a00a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:50.837944 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c3577-be03-4e0d-bd40-0e4c1913a00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:50.850455 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:50.866771 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c18c3577-be03-4e0d-bd40-0e4c1913a00a None None] MFA Rules not processed for user `f63eebaa4be24f64966af298b7acb127`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:50.867926 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c18c3577-be03-4e0d-bd40-0e4c1913a00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:50.932783 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1304/2624] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:50.943943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61de60-cf4c-4d8a-b62b-4be07b589ff3 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:50.945628 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-7f61de60-cf4c-4d8a-b62b-4be07b589ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:50.969097 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c3577-be03-4e0d-bd40-0e4c1913a00a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:50.970491 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c18c3577-be03-4e0d-bd40-0e4c1913a00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:51.020339 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61de60-cf4c-4d8a-b62b-4be07b589ff3 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:51.026129 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f3eb3-0b0f-41d2-9f09-30da77597a24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:51.026808 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f3eb3-0b0f-41d2-9f09-30da77597a24 service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:51.027101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f3eb3-0b0f-41d2-9f09-30da77597a24 service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:51.030419 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f3eb3-0b0f-41d2-9f09-30da77597a24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:51.036905 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f3eb3-0b0f-41d2-9f09-30da77597a24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:51.037100 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c3577-be03-4e0d-bd40-0e4c1913a00a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:51.038753 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f3eb3-0b0f-41d2-9f09-30da77597a24 service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:51.042055 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1d56a-105d-4e93-9e9f-27e8e739903c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:51.042954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1d56a-105d-4e93-9e9f-27e8e739903c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:51.043235 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1d56a-105d-4e93-9e9f-27e8e739903c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:51.043505 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1d56a-105d-4e93-9e9f-27e8e739903c admin admin] PATH_INFO: `/v3/users/47eb60158ccc440eb62f7f38f5513f99` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:51.044707 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1d56a-105d-4e93-9e9f-27e8e739903c admin admin] RBAC: Authorizing `identity:delete_user(user_id=47eb60158ccc440eb62f7f38f5513f99)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:51.046646 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1d56a-105d-4e93-9e9f-27e8e739903c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:51.048413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1321/2625] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:39:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:51.095050 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f4c1d56a-105d-4e93-9e9f-27e8e739903c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47eb60158ccc440eb62f7f38f5513f99'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:51.102945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f4c1d56a-105d-4e93-9e9f-27e8e739903c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47eb60158ccc440eb62f7f38f5513f99'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:51.104285 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f4c1d56a-105d-4e93-9e9f-27e8e739903c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47eb60158ccc440eb62f7f38f5513f99'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:51.104923 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f4c1d56a-105d-4e93-9e9f-27e8e739903c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47eb60158ccc440eb62f7f38f5513f99'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:51.119651 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f4c1d56a-105d-4e93-9e9f-27e8e739903c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47eb60158ccc440eb62f7f38f5513f99'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:51.131807 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1305/2626] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:39:50 2022] DELETE /identity/v3/users/47eb60158ccc440eb62f7f38f5513f99 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:51.136295 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692dd03-907e-423b-bb86-c06de876ae0d None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:51.136665 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692dd03-907e-423b-bb86-c06de876ae0d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:51.137152 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692dd03-907e-423b-bb86-c06de876ae0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:51.155184 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-d692dd03-907e-423b-bb86-c06de876ae0d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:51.156479 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-d692dd03-907e-423b-bb86-c06de876ae0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:51.220792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1322/2627] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:51.231020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1d56a-105d-4e93-9e9f-27e8e739903c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:51.232487 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f4c1d56a-105d-4e93-9e9f-27e8e739903c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:51.251660 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:51.297184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1d56a-105d-4e93-9e9f-27e8e739903c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:51.302264 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe0b2f-8c57-4712-9830-5473d2b3faf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:51.302950 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe0b2f-8c57-4712-9830-5473d2b3faf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:51.303240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe0b2f-8c57-4712-9830-5473d2b3faf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:51.303522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe0b2f-8c57-4712-9830-5473d2b3faf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:51.315160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe0b2f-8c57-4712-9830-5473d2b3faf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:51.316568 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe0b2f-8c57-4712-9830-5473d2b3faf8 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:51.328244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1306/2628] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:39:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:51.518094 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692dd03-907e-423b-bb86-c06de876ae0d None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:51.519540 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-d692dd03-907e-423b-bb86-c06de876ae0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:51.533391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692dd03-907e-423b-bb86-c06de876ae0d None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:51.538048 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c252a-f2ce-45f9-a42f-780371848f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:51.538977 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c252a-f2ce-45f9-a42f-780371848f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:51.539280 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c252a-f2ce-45f9-a42f-780371848f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:51.539566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c252a-f2ce-45f9-a42f-780371848f6a admin admin] PATH_INFO: `/v3/projects/5fc5bc6fc05c499abc35964fe65dcdf7` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:51.541402 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c252a-f2ce-45f9-a42f-780371848f6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc5bc6fc05c499abc35964fe65dcdf7)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:51.543387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c252a-f2ce-45f9-a42f-780371848f6a admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:51.545303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:51.594128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-c25c252a-f2ce-45f9-a42f-780371848f6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc5bc6fc05c499abc35964fe65dcdf7', 'request_id': 'req-c25c252a-f2ce-45f9-a42f-780371848f6a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:51.600349 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-c25c252a-f2ce-45f9-a42f-780371848f6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc5bc6fc05c499abc35964fe65dcdf7', 'request_id': 'req-c25c252a-f2ce-45f9-a42f-780371848f6a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:51.608582 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-c25c252a-f2ce-45f9-a42f-780371848f6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc5bc6fc05c499abc35964fe65dcdf7', 'request_id': 'req-c25c252a-f2ce-45f9-a42f-780371848f6a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:51.619743 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-c25c252a-f2ce-45f9-a42f-780371848f6a admin admin] The token cache is being invalidate because project 5fc5bc6fc05c499abc35964fe65dcdf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:39:51.620030 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-c25c252a-f2ce-45f9-a42f-780371848f6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:51.620679 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-c25c252a-f2ce-45f9-a42f-780371848f6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:51.622271 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1323/2629] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:39:51 2022] DELETE /identity/v3/projects/5fc5bc6fc05c499abc35964fe65dcdf7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:51.627154 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2784c-9248-4c79-aa56-84118a5bca19 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:51.627452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2784c-9248-4c79-aa56-84118a5bca19 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:51.627736 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2784c-9248-4c79-aa56-84118a5bca19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:51.645470 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d9f2784c-9248-4c79-aa56-84118a5bca19 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:51.646639 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d9f2784c-9248-4c79-aa56-84118a5bca19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:51.704701 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1307/2630] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:51.712299 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb30ab2-2724-433b-9bf2-70893923d956 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:51.712593 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb30ab2-2724-433b-9bf2-70893923d956 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:51.712873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb30ab2-2724-433b-9bf2-70893923d956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:51.730687 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-7cb30ab2-2724-433b-9bf2-70893923d956 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:51.731870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-7cb30ab2-2724-433b-9bf2-70893923d956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:51.739568 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1324/2631] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:51.743549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2784c-9248-4c79-aa56-84118a5bca19 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:51.753700 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2784c-9248-4c79-aa56-84118a5bca19 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:51.758277 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84c4bd-f6d4-4a8a-9fff-fd18e455bc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:51.758956 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84c4bd-f6d4-4a8a-9fff-fd18e455bc27 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:51.759248 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84c4bd-f6d4-4a8a-9fff-fd18e455bc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:51.760154 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84c4bd-f6d4-4a8a-9fff-fd18e455bc27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:51.760882 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84c4bd-f6d4-4a8a-9fff-fd18e455bc27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:39:51.761195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84c4bd-f6d4-4a8a-9fff-fd18e455bc27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:51.762854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84c4bd-f6d4-4a8a-9fff-fd18e455bc27 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:51.774383 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1308/2632] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:39:51.778430 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb30ab2-2724-433b-9bf2-70893923d956 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:51.787537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb30ab2-2724-433b-9bf2-70893923d956 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:51.792758 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d2e14-60a2-4a4a-abf2-4b17f0004183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:51.793407 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d2e14-60a2-4a4a-abf2-4b17f0004183 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:51.793724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d2e14-60a2-4a4a-abf2-4b17f0004183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:51.794006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d2e14-60a2-4a4a-abf2-4b17f0004183 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:51.794791 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d2e14-60a2-4a4a-abf2-4b17f0004183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:51.797161 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d2e14-60a2-4a4a-abf2-4b17f0004183 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:51.824731 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1325/2633] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:39:51 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:39:51.828683 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84c4bd-f6d4-4a8a-9fff-fd18e455bc27 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:51.838790 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84c4bd-f6d4-4a8a-9fff-fd18e455bc27 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:51.894158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508beff-1a5c-429e-a6dd-bfd2f1acab6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:51.894861 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508beff-1a5c-429e-a6dd-bfd2f1acab6c admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:51.895149 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508beff-1a5c-429e-a6dd-bfd2f1acab6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:51.895426 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508beff-1a5c-429e-a6dd-bfd2f1acab6c admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:51.896176 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508beff-1a5c-429e-a6dd-bfd2f1acab6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:51.898051 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508beff-1a5c-429e-a6dd-bfd2f1acab6c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:51.917758 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1309/2634] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:39:51 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:39:51.921741 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d2e14-60a2-4a4a-abf2-4b17f0004183 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:51.932690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d2e14-60a2-4a4a-abf2-4b17f0004183 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:51.937233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeab8ae-cf10-4c3c-b390-55c5cf7b37c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:51.937885 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeab8ae-cf10-4c3c-b390-55c5cf7b37c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:51.938171 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeab8ae-cf10-4c3c-b390-55c5cf7b37c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:51.938451 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeab8ae-cf10-4c3c-b390-55c5cf7b37c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:51.939196 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeab8ae-cf10-4c3c-b390-55c5cf7b37c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:51.940792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeab8ae-cf10-4c3c-b390-55c5cf7b37c1 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:51.952563 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1326/2635] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:51.956284 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508beff-1a5c-429e-a6dd-bfd2f1acab6c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:51.966731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508beff-1a5c-429e-a6dd-bfd2f1acab6c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:51.971364 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8ae57-01de-49ba-bad9-7f5bcee2500d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:51.972017 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8ae57-01de-49ba-bad9-7f5bcee2500d admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:51.972307 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8ae57-01de-49ba-bad9-7f5bcee2500d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:51.972588 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8ae57-01de-49ba-bad9-7f5bcee2500d admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:51.973318 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8ae57-01de-49ba-bad9-7f5bcee2500d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:51.975020 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8ae57-01de-49ba-bad9-7f5bcee2500d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:51.984740 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1310/2636] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:51.988872 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeab8ae-cf10-4c3c-b390-55c5cf7b37c1 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:51.998601 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeab8ae-cf10-4c3c-b390-55c5cf7b37c1 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:52.003080 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465881d8-bc15-4aa8-8306-d2ae9aec52d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:52.003951 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465881d8-bc15-4aa8-8306-d2ae9aec52d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:52.004233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465881d8-bc15-4aa8-8306-d2ae9aec52d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:52.004507 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465881d8-bc15-4aa8-8306-d2ae9aec52d1 admin admin] PATH_INFO: `/v3/projects/c6773f7f5a384f048dff04572b8b990b/users/34799c8eae414491bbc27620a81e0b19/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:52.019047 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465881d8-bc15-4aa8-8306-d2ae9aec52d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6773f7f5a384f048dff04572b8b990b, user_id=34799c8eae414491bbc27620a81e0b19, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:52.021648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465881d8-bc15-4aa8-8306-d2ae9aec52d1 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:52.034759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1327/2637] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:39:51 2022] PUT /identity/v3/projects/c6773f7f5a384f048dff04572b8b990b/users/34799c8eae414491bbc27620a81e0b19/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:39:52.039687 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d079e2-ca05-411e-a31f-098ea935dd0e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:52.039985 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d079e2-ca05-411e-a31f-098ea935dd0e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:52.040273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d079e2-ca05-411e-a31f-098ea935dd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:52.059619 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a0d079e2-ca05-411e-a31f-098ea935dd0e None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:52.060847 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a0d079e2-ca05-411e-a31f-098ea935dd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:52.079673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:52.123801 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1311/2638] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:52.133334 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465881d8-bc15-4aa8-8306-d2ae9aec52d1 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:52.135659 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-465881d8-bc15-4aa8-8306-d2ae9aec52d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:52.196417 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465881d8-bc15-4aa8-8306-d2ae9aec52d1 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:52.201652 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21f805-267c-4165-850a-7bb437e96f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:52.202422 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21f805-267c-4165-850a-7bb437e96f5e service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:52.202821 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21f805-267c-4165-850a-7bb437e96f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:52.203116 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21f805-267c-4165-850a-7bb437e96f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:52.212794 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21f805-267c-4165-850a-7bb437e96f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:52.214256 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21f805-267c-4165-850a-7bb437e96f5e service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:52.223561 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1328/2639] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:39:52.881640 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814f9e3-abbf-42cd-b334-6e1c356f2a95 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:52.881938 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814f9e3-abbf-42cd-b334-6e1c356f2a95 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:52.882222 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814f9e3-abbf-42cd-b334-6e1c356f2a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:52.909090 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2814f9e3-abbf-42cd-b334-6e1c356f2a95 None None] MFA Rules not processed for user `34799c8eae414491bbc27620a81e0b19`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:52.910327 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2814f9e3-abbf-42cd-b334-6e1c356f2a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:52.978483 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1312/2640] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:52.989153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21f805-267c-4165-850a-7bb437e96f5e service neutron] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:52.990625 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-7e21f805-267c-4165-850a-7bb437e96f5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:53.023237 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:53.050181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21f805-267c-4165-850a-7bb437e96f5e service neutron] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:53.053705 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab876bc-1d77-4587-a1bd-adf14cd928d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:53.054348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab876bc-1d77-4587-a1bd-adf14cd928d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:53.054663 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab876bc-1d77-4587-a1bd-adf14cd928d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:53.055258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab876bc-1d77-4587-a1bd-adf14cd928d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:53.064293 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab876bc-1d77-4587-a1bd-adf14cd928d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:53.065725 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab876bc-1d77-4587-a1bd-adf14cd928d6 service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:53.075453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1329/2641] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:39:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:39:53.761918 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814f9e3-abbf-42cd-b334-6e1c356f2a95 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:53.761918 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2814f9e3-abbf-42cd-b334-6e1c356f2a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:53.774220 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814f9e3-abbf-42cd-b334-6e1c356f2a95 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:53.778902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5a427-ad07-4e56-9913-91cadb59fb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:53.779759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5a427-ad07-4e56-9913-91cadb59fb39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:53.780041 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5a427-ad07-4e56-9913-91cadb59fb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:53.780315 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5a427-ad07-4e56-9913-91cadb59fb39 admin admin] PATH_INFO: `/v3/users/f63eebaa4be24f64966af298b7acb127` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:53.781476 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5a427-ad07-4e56-9913-91cadb59fb39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f63eebaa4be24f64966af298b7acb127)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:53.783425 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5a427-ad07-4e56-9913-91cadb59fb39 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:53.831031 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d1e5a427-ad07-4e56-9913-91cadb59fb39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f63eebaa4be24f64966af298b7acb127'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:53.838319 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d1e5a427-ad07-4e56-9913-91cadb59fb39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f63eebaa4be24f64966af298b7acb127'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:53.839009 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d1e5a427-ad07-4e56-9913-91cadb59fb39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f63eebaa4be24f64966af298b7acb127'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:53.839724 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d1e5a427-ad07-4e56-9913-91cadb59fb39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f63eebaa4be24f64966af298b7acb127'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:53.851428 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d1e5a427-ad07-4e56-9913-91cadb59fb39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f63eebaa4be24f64966af298b7acb127'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:53.863694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1313/2642] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:39:53 2022] DELETE /identity/v3/users/f63eebaa4be24f64966af298b7acb127 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:53.868151 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535fc56-efe3-4dd8-9975-c613fbfe3115 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:53.868455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535fc56-efe3-4dd8-9975-c613fbfe3115 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:53.869256 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535fc56-efe3-4dd8-9975-c613fbfe3115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:53.887041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-a535fc56-efe3-4dd8-9975-c613fbfe3115 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:53.888247 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-a535fc56-efe3-4dd8-9975-c613fbfe3115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:53.945430 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1330/2643] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:53.954928 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5a427-ad07-4e56-9913-91cadb59fb39 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:53.956330 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d1e5a427-ad07-4e56-9913-91cadb59fb39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:53.987733 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:54.015833 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5a427-ad07-4e56-9913-91cadb59fb39 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:54.019489 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32e601-4e04-47f3-8e26-0320f21d023e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:54.020130 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32e601-4e04-47f3-8e26-0320f21d023e service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:54.020417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32e601-4e04-47f3-8e26-0320f21d023e service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:54.020694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32e601-4e04-47f3-8e26-0320f21d023e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:54.030268 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32e601-4e04-47f3-8e26-0320f21d023e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:54.031767 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32e601-4e04-47f3-8e26-0320f21d023e service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:54.041312 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1314/2644] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:54.303895 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535fc56-efe3-4dd8-9975-c613fbfe3115 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:54.305733 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-a535fc56-efe3-4dd8-9975-c613fbfe3115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:54.318238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535fc56-efe3-4dd8-9975-c613fbfe3115 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:54.323012 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66190718-8d18-4469-b864-34be16986c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:54.323894 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66190718-8d18-4469-b864-34be16986c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:54.324174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66190718-8d18-4469-b864-34be16986c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:54.324453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66190718-8d18-4469-b864-34be16986c05 admin admin] PATH_INFO: `/v3/projects/e934fb2d53c94573a205707575b669a2` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:54.325612 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66190718-8d18-4469-b864-34be16986c05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e934fb2d53c94573a205707575b669a2)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:54.327548 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66190718-8d18-4469-b864-34be16986c05 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:54.375877 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-66190718-8d18-4469-b864-34be16986c05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e934fb2d53c94573a205707575b669a2', 'request_id': 'req-66190718-8d18-4469-b864-34be16986c05'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:54.382192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-66190718-8d18-4469-b864-34be16986c05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e934fb2d53c94573a205707575b669a2', 'request_id': 'req-66190718-8d18-4469-b864-34be16986c05'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:54.390823 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-66190718-8d18-4469-b864-34be16986c05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e934fb2d53c94573a205707575b669a2', 'request_id': 'req-66190718-8d18-4469-b864-34be16986c05'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:54.402581 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-66190718-8d18-4469-b864-34be16986c05 admin admin] The token cache is being invalidate because project e934fb2d53c94573a205707575b669a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:39:54.402920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-66190718-8d18-4469-b864-34be16986c05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:54.403683 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-66190718-8d18-4469-b864-34be16986c05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:54.417965 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1331/2645] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:39:54 2022] DELETE /identity/v3/projects/e934fb2d53c94573a205707575b669a2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:54.418086 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7353d82-1c52-470f-bb61-e21107badb4b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:54.418086 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7353d82-1c52-470f-bb61-e21107badb4b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:54.418086 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7353d82-1c52-470f-bb61-e21107badb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:54.431363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f7353d82-1c52-470f-bb61-e21107badb4b None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:54.432611 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f7353d82-1c52-470f-bb61-e21107badb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:54.475666 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d302d4e-6842-4885-8aba-38bacca791ab None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:54.475964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d302d4e-6842-4885-8aba-38bacca791ab None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:54.476254 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d302d4e-6842-4885-8aba-38bacca791ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:54.495693 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-0d302d4e-6842-4885-8aba-38bacca791ab None None] MFA Rules not processed for user `34799c8eae414491bbc27620a81e0b19`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:54.496879 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1315/2646] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:54.497022 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-0d302d4e-6842-4885-8aba-38bacca791ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:54.504322 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443075a-c870-43f8-a823-7b6e332bdc21 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:54.504553 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443075a-c870-43f8-a823-7b6e332bdc21 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:54.504852 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443075a-c870-43f8-a823-7b6e332bdc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:54.522650 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7443075a-c870-43f8-a823-7b6e332bdc21 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:54.523861 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7443075a-c870-43f8-a823-7b6e332bdc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:54.532369 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1316/2647] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:39:54.536390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443075a-c870-43f8-a823-7b6e332bdc21 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:54.545728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443075a-c870-43f8-a823-7b6e332bdc21 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:54.546306 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:54.551051 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e0b15-fda6-4d0d-984d-560a7ffa9f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:54.551918 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e0b15-fda6-4d0d-984d-560a7ffa9f99 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:54.552210 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e0b15-fda6-4d0d-984d-560a7ffa9f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:54.552490 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e0b15-fda6-4d0d-984d-560a7ffa9f99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:54.553225 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e0b15-fda6-4d0d-984d-560a7ffa9f99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:39:54.553524 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e0b15-fda6-4d0d-984d-560a7ffa9f99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:54.558879 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1332/2648] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:39:54.559048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e0b15-fda6-4d0d-984d-560a7ffa9f99 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:54.569335 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1317/2649] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 12:39:54.573606 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d302d4e-6842-4885-8aba-38bacca791ab None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:54.584410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d302d4e-6842-4885-8aba-38bacca791ab None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:54.590535 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a3ff3-b671-4ea8-851c-9eb32b030195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:54.591234 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a3ff3-b671-4ea8-851c-9eb32b030195 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:54.591530 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a3ff3-b671-4ea8-851c-9eb32b030195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:54.591815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a3ff3-b671-4ea8-851c-9eb32b030195 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:54.592572 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a3ff3-b671-4ea8-851c-9eb32b030195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:54.594568 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a3ff3-b671-4ea8-851c-9eb32b030195 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:54.624779 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1333/2650] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:39:54 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:39:54.625881 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e0b15-fda6-4d0d-984d-560a7ffa9f99 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:54.636360 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e0b15-fda6-4d0d-984d-560a7ffa9f99 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:54.696182 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f731786-a72b-4150-94e5-977959765246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:54.696905 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f731786-a72b-4150-94e5-977959765246 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:54.697193 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f731786-a72b-4150-94e5-977959765246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:54.697474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f731786-a72b-4150-94e5-977959765246 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:54.698181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f731786-a72b-4150-94e5-977959765246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:54.700167 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f731786-a72b-4150-94e5-977959765246 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:54.722082 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1318/2651] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:39:54 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:39:54.726078 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a3ff3-b671-4ea8-851c-9eb32b030195 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:54.737456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a3ff3-b671-4ea8-851c-9eb32b030195 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:54.742090 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d32f0-8c84-4dde-9daa-e52fe0bdf6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:54.742812 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d32f0-8c84-4dde-9daa-e52fe0bdf6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:54.743068 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d32f0-8c84-4dde-9daa-e52fe0bdf6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:54.743352 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d32f0-8c84-4dde-9daa-e52fe0bdf6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:54.744107 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d32f0-8c84-4dde-9daa-e52fe0bdf6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:54.745721 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d32f0-8c84-4dde-9daa-e52fe0bdf6b9 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:54.756723 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1334/2652] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:54.761183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f731786-a72b-4150-94e5-977959765246 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:54.772136 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f731786-a72b-4150-94e5-977959765246 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:54.777484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fcebb-f1e5-491f-877e-42352132977f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:54.778148 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fcebb-f1e5-491f-877e-42352132977f admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:54.778437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fcebb-f1e5-491f-877e-42352132977f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:54.778752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fcebb-f1e5-491f-877e-42352132977f admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:54.779488 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fcebb-f1e5-491f-877e-42352132977f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:54.781424 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fcebb-f1e5-491f-877e-42352132977f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:54.794321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1319/2653] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:39:54.795512 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d32f0-8c84-4dde-9daa-e52fe0bdf6b9 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:54.796887 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fcebb-f1e5-491f-877e-42352132977f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:54.797352 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-241d32f0-8c84-4dde-9daa-e52fe0bdf6b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:54.808392 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fcebb-f1e5-491f-877e-42352132977f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:54.813388 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7badea-5e53-49fe-9ce8-bc11c6800110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:54.814266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7badea-5e53-49fe-9ce8-bc11c6800110 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:54.814582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7badea-5e53-49fe-9ce8-bc11c6800110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:54.814866 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7badea-5e53-49fe-9ce8-bc11c6800110 admin admin] PATH_INFO: `/v3/projects/3b5f9848fa58426c8d7353081878dfba/users/2d6bd189f8a8468b8517124af7977990/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:54.830671 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7badea-5e53-49fe-9ce8-bc11c6800110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b5f9848fa58426c8d7353081878dfba, user_id=2d6bd189f8a8468b8517124af7977990, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:54.833601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7badea-5e53-49fe-9ce8-bc11c6800110 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:54.847687 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1320/2654] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:39:54 2022] PUT /identity/v3/projects/3b5f9848fa58426c8d7353081878dfba/users/2d6bd189f8a8468b8517124af7977990/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:39:54.852643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc17ca-98b3-4012-865a-5afd8b0b24c3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:54.853457 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc17ca-98b3-4012-865a-5afd8b0b24c3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:54.853743 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc17ca-98b3-4012-865a-5afd8b0b24c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:54.860186 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:54.862970 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d32f0-8c84-4dde-9daa-e52fe0bdf6b9 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:54.872422 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-5efc17ca-98b3-4012-865a-5afd8b0b24c3 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:54.873816 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5efc17ca-98b3-4012-865a-5afd8b0b24c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:54.916092 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969af64-d476-42bf-9933-8239ecbfb465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:54.916742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969af64-d476-42bf-9933-8239ecbfb465 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:54.917032 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969af64-d476-42bf-9933-8239ecbfb465 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:54.917316 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969af64-d476-42bf-9933-8239ecbfb465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:54.919128 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-e969af64-d476-42bf-9933-8239ecbfb465 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:54.929168 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969af64-d476-42bf-9933-8239ecbfb465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:54.931203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969af64-d476-42bf-9933-8239ecbfb465 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:54.938110 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1321/2655] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:39:54.939914 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1335/2656] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:39:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:39:54.948120 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc17ca-98b3-4012-865a-5afd8b0b24c3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:54.949506 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5efc17ca-98b3-4012-865a-5afd8b0b24c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:54.961532 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc17ca-98b3-4012-865a-5afd8b0b24c3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:54.965349 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fe838-b12c-43cd-a8a2-3e5dc043d557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:54.965991 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fe838-b12c-43cd-a8a2-3e5dc043d557 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:54.966281 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fe838-b12c-43cd-a8a2-3e5dc043d557 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:54.966596 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fe838-b12c-43cd-a8a2-3e5dc043d557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:54.976089 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055fe838-b12c-43cd-a8a2-3e5dc043d557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:54.977577 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055fe838-b12c-43cd-a8a2-3e5dc043d557 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:54.988435 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1322/2657] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:39:55.737504 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b228e-95fc-4eef-ab65-b195b4d8880e None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:55.738012 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b228e-95fc-4eef-ab65-b195b4d8880e None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:55.738114 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b228e-95fc-4eef-ab65-b195b4d8880e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:55.769103 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-819b228e-95fc-4eef-ab65-b195b4d8880e None None] MFA Rules not processed for user `2d6bd189f8a8468b8517124af7977990`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:55.770326 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-819b228e-95fc-4eef-ab65-b195b4d8880e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:55.857528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1336/2658] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:55.862532 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fe838-b12c-43cd-a8a2-3e5dc043d557 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:55.872838 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fe838-b12c-43cd-a8a2-3e5dc043d557 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:55.877481 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ff3c2-3e67-408d-95f9-05b7be6bdba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:55.878138 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ff3c2-3e67-408d-95f9-05b7be6bdba7 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:55.878416 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ff3c2-3e67-408d-95f9-05b7be6bdba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:55.878727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ff3c2-3e67-408d-95f9-05b7be6bdba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:55.879582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ff3c2-3e67-408d-95f9-05b7be6bdba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:55.881493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ff3c2-3e67-408d-95f9-05b7be6bdba7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:55.915938 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1323/2659] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:39:55 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:39:55.917164 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b228e-95fc-4eef-ab65-b195b4d8880e None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:55.932210 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b228e-95fc-4eef-ab65-b195b4d8880e None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:55.949455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:56.002152 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274739d1-af8e-4431-a998-db488ba08619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:56.002873 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274739d1-af8e-4431-a998-db488ba08619 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:56.003167 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274739d1-af8e-4431-a998-db488ba08619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:56.003452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274739d1-af8e-4431-a998-db488ba08619 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:56.004142 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274739d1-af8e-4431-a998-db488ba08619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:56.006082 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274739d1-af8e-4431-a998-db488ba08619 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:56.029033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1337/2660] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:39:55 2022] POST /identity/v3/users => generated 308 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:39:56.030290 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ff3c2-3e67-408d-95f9-05b7be6bdba7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:56.041529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ff3c2-3e67-408d-95f9-05b7be6bdba7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:56.046219 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52511a47-cc6c-4192-89cd-904a18a21b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:56.047004 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52511a47-cc6c-4192-89cd-904a18a21b23 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:56.047353 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52511a47-cc6c-4192-89cd-904a18a21b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:56.047696 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52511a47-cc6c-4192-89cd-904a18a21b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:56.048515 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52511a47-cc6c-4192-89cd-904a18a21b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:56.050240 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52511a47-cc6c-4192-89cd-904a18a21b23 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:56.061832 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1324/2661] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:56.066350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274739d1-af8e-4431-a998-db488ba08619 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:56.077380 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274739d1-af8e-4431-a998-db488ba08619 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:56.082245 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c8a9f-3f83-49cc-af45-0b04abc9fe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:56.083407 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c8a9f-3f83-49cc-af45-0b04abc9fe89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:56.083834 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c8a9f-3f83-49cc-af45-0b04abc9fe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:56.084272 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c8a9f-3f83-49cc-af45-0b04abc9fe89 admin admin] PATH_INFO: `/v3/projects/facaba00bb09473fb2314ae80f031173/users/737e62bcd3c74a1aa37b783d5e6e199f/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:56.100102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c8a9f-3f83-49cc-af45-0b04abc9fe89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=facaba00bb09473fb2314ae80f031173, user_id=737e62bcd3c74a1aa37b783d5e6e199f, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:56.102869 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c8a9f-3f83-49cc-af45-0b04abc9fe89 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:56.122268 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1338/2662] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:39:56 2022] PUT /identity/v3/projects/facaba00bb09473fb2314ae80f031173/users/737e62bcd3c74a1aa37b783d5e6e199f/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:56.126232 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52511a47-cc6c-4192-89cd-904a18a21b23 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:56.136421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52511a47-cc6c-4192-89cd-904a18a21b23 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:56.196969 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a70b35-df16-440f-99f5-95cf91bd6f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:56.197730 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a70b35-df16-440f-99f5-95cf91bd6f7e admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:56.198097 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a70b35-df16-440f-99f5-95cf91bd6f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:56.198452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a70b35-df16-440f-99f5-95cf91bd6f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:56.199314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a70b35-df16-440f-99f5-95cf91bd6f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:56.201221 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a70b35-df16-440f-99f5-95cf91bd6f7e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:56.211853 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1325/2663] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:39:56.216556 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c8a9f-3f83-49cc-af45-0b04abc9fe89 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:56.228328 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c8a9f-3f83-49cc-af45-0b04abc9fe89 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:56.234203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1d694-d44c-4514-8922-cffa51409a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:56.235297 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1d694-d44c-4514-8922-cffa51409a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:56.235589 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1d694-d44c-4514-8922-cffa51409a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:56.235870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1d694-d44c-4514-8922-cffa51409a69 admin admin] PATH_INFO: `/v3/projects/facaba00bb09473fb2314ae80f031173/users/737e62bcd3c74a1aa37b783d5e6e199f/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:56.237910 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1d694-d44c-4514-8922-cffa51409a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=facaba00bb09473fb2314ae80f031173, user_id=737e62bcd3c74a1aa37b783d5e6e199f, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:56.240648 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1d694-d44c-4514-8922-cffa51409a69 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:56.252930 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1339/2664] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:39:56 2022] PUT /identity/v3/projects/facaba00bb09473fb2314ae80f031173/users/737e62bcd3c74a1aa37b783d5e6e199f/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:56.912864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59be9aa-0ab8-4fd8-a798-336427da9697 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:56.913155 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59be9aa-0ab8-4fd8-a798-336427da9697 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:56.913514 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59be9aa-0ab8-4fd8-a798-336427da9697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:56.945244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f59be9aa-0ab8-4fd8-a798-336427da9697 None None] MFA Rules not processed for user `737e62bcd3c74a1aa37b783d5e6e199f`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:56.946582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f59be9aa-0ab8-4fd8-a798-336427da9697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:57.000239 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:57.033888 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1326/2665] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:56 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:58.604575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1d694-d44c-4514-8922-cffa51409a69 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:58.669131 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1d694-d44c-4514-8922-cffa51409a69 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:58.673755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293903f0-1922-4458-98b1-94436f10d595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:58.674659 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293903f0-1922-4458-98b1-94436f10d595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:58.674952 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293903f0-1922-4458-98b1-94436f10d595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:58.675232 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293903f0-1922-4458-98b1-94436f10d595 admin admin] PATH_INFO: `/v3/users/2d6bd189f8a8468b8517124af7977990` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:58.676420 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293903f0-1922-4458-98b1-94436f10d595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d6bd189f8a8468b8517124af7977990)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:58.678346 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293903f0-1922-4458-98b1-94436f10d595 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:58.724555 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-293903f0-1922-4458-98b1-94436f10d595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d6bd189f8a8468b8517124af7977990'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:58.732044 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-293903f0-1922-4458-98b1-94436f10d595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d6bd189f8a8468b8517124af7977990'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:58.742783 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:58.744498 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-293903f0-1922-4458-98b1-94436f10d595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d6bd189f8a8468b8517124af7977990'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:58.753100 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-293903f0-1922-4458-98b1-94436f10d595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d6bd189f8a8468b8517124af7977990'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:58.753742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-293903f0-1922-4458-98b1-94436f10d595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d6bd189f8a8468b8517124af7977990'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:58.759796 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1340/2666] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:39:58 2022] DELETE /identity/v3/users/2d6bd189f8a8468b8517124af7977990 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:58.934213 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59be9aa-0ab8-4fd8-a798-336427da9697 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:58.944869 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59be9aa-0ab8-4fd8-a798-336427da9697 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:59.002814 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba20b1a-e6be-4afe-8e65-edfbb6564a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:59.003675 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba20b1a-e6be-4afe-8e65-edfbb6564a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:59.003958 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba20b1a-e6be-4afe-8e65-edfbb6564a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:59.004232 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba20b1a-e6be-4afe-8e65-edfbb6564a99 admin admin] PATH_INFO: `/v3/projects/3b5f9848fa58426c8d7353081878dfba` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:59.005399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba20b1a-e6be-4afe-8e65-edfbb6564a99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b5f9848fa58426c8d7353081878dfba)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:59.007376 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba20b1a-e6be-4afe-8e65-edfbb6564a99 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:59.052011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-1ba20b1a-e6be-4afe-8e65-edfbb6564a99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b5f9848fa58426c8d7353081878dfba', 'request_id': 'req-1ba20b1a-e6be-4afe-8e65-edfbb6564a99'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:59.058785 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-1ba20b1a-e6be-4afe-8e65-edfbb6564a99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b5f9848fa58426c8d7353081878dfba', 'request_id': 'req-1ba20b1a-e6be-4afe-8e65-edfbb6564a99'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:59.064224 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-1ba20b1a-e6be-4afe-8e65-edfbb6564a99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b5f9848fa58426c8d7353081878dfba', 'request_id': 'req-1ba20b1a-e6be-4afe-8e65-edfbb6564a99'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:59.076418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-1ba20b1a-e6be-4afe-8e65-edfbb6564a99 admin admin] The token cache is being invalidate because project 3b5f9848fa58426c8d7353081878dfba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:39:59.076642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-1ba20b1a-e6be-4afe-8e65-edfbb6564a99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:59.077251 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-1ba20b1a-e6be-4afe-8e65-edfbb6564a99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:59.078796 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1327/2667] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:39:58 2022] DELETE /identity/v3/projects/3b5f9848fa58426c8d7353081878dfba => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:59.082750 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293903f0-1922-4458-98b1-94436f10d595 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:59.084220 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-293903f0-1922-4458-98b1-94436f10d595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:59.098985 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293903f0-1922-4458-98b1-94436f10d595 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:59.160199 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9397cfd-6e5e-4fa3-ab5c-7f208f7c8ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:59.161076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9397cfd-6e5e-4fa3-ab5c-7f208f7c8ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:59.161361 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9397cfd-6e5e-4fa3-ab5c-7f208f7c8ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:59.161638 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9397cfd-6e5e-4fa3-ab5c-7f208f7c8ca1 admin admin] PATH_INFO: `/v3/users/737e62bcd3c74a1aa37b783d5e6e199f` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:59.162893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9397cfd-6e5e-4fa3-ab5c-7f208f7c8ca1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=737e62bcd3c74a1aa37b783d5e6e199f)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:59.164795 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9397cfd-6e5e-4fa3-ab5c-7f208f7c8ca1 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:59.218943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-e9397cfd-6e5e-4fa3-ab5c-7f208f7c8ca1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '737e62bcd3c74a1aa37b783d5e6e199f'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:59.226228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-e9397cfd-6e5e-4fa3-ab5c-7f208f7c8ca1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '737e62bcd3c74a1aa37b783d5e6e199f'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:59.238593 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-e9397cfd-6e5e-4fa3-ab5c-7f208f7c8ca1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '737e62bcd3c74a1aa37b783d5e6e199f'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:59.246699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-e9397cfd-6e5e-4fa3-ab5c-7f208f7c8ca1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '737e62bcd3c74a1aa37b783d5e6e199f'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:59.247385 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-e9397cfd-6e5e-4fa3-ab5c-7f208f7c8ca1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '737e62bcd3c74a1aa37b783d5e6e199f'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:59.253476 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1341/2668] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:39:59 2022] DELETE /identity/v3/users/737e62bcd3c74a1aa37b783d5e6e199f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:39:59.545803 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba20b1a-e6be-4afe-8e65-edfbb6564a99 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:59.547265 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1ba20b1a-e6be-4afe-8e65-edfbb6564a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:59.560537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba20b1a-e6be-4afe-8e65-edfbb6564a99 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:59.624103 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe287e5-456f-4805-8d73-94657ebb2691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:59.625540 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe287e5-456f-4805-8d73-94657ebb2691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:59.625900 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe287e5-456f-4805-8d73-94657ebb2691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:59.626183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe287e5-456f-4805-8d73-94657ebb2691 admin admin] PATH_INFO: `/v3/projects/facaba00bb09473fb2314ae80f031173` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:59.627442 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe287e5-456f-4805-8d73-94657ebb2691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=facaba00bb09473fb2314ae80f031173)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:59.629377 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe287e5-456f-4805-8d73-94657ebb2691 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:59.641427 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:59.679681 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0fe287e5-456f-4805-8d73-94657ebb2691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'facaba00bb09473fb2314ae80f031173', 'request_id': 'req-0fe287e5-456f-4805-8d73-94657ebb2691'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:59.686226 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0fe287e5-456f-4805-8d73-94657ebb2691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'facaba00bb09473fb2314ae80f031173', 'request_id': 'req-0fe287e5-456f-4805-8d73-94657ebb2691'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:59.691902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0fe287e5-456f-4805-8d73-94657ebb2691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'facaba00bb09473fb2314ae80f031173', 'request_id': 'req-0fe287e5-456f-4805-8d73-94657ebb2691'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:59.703754 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0fe287e5-456f-4805-8d73-94657ebb2691 admin admin] The token cache is being invalidate because project facaba00bb09473fb2314ae80f031173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:39:59.704043 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0fe287e5-456f-4805-8d73-94657ebb2691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:59.704693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0fe287e5-456f-4805-8d73-94657ebb2691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:39:59.706261 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1328/2669] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:39:59 2022] DELETE /identity/v3/projects/facaba00bb09473fb2314ae80f031173 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:39:59.711271 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b48c6-c494-4948-8fd0-9e2ed2a3a3bb None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:59.711771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b48c6-c494-4948-8fd0-9e2ed2a3a3bb None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:59.711875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b48c6-c494-4948-8fd0-9e2ed2a3a3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:59.731000 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-2b0b48c6-c494-4948-8fd0-9e2ed2a3a3bb None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:59.732353 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-2b0b48c6-c494-4948-8fd0-9e2ed2a3a3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:59.799908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1342/2670] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:59.809888 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123c389-ce2e-4890-80a4-ea9756c0c215 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:59.810200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123c389-ce2e-4890-80a4-ea9756c0c215 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:59.810595 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123c389-ce2e-4890-80a4-ea9756c0c215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:59.833740 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9123c389-ce2e-4890-80a4-ea9756c0c215 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:39:59.834948 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9123c389-ce2e-4890-80a4-ea9756c0c215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:39:59.843706 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1329/2671] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:39:59.847838 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b48c6-c494-4948-8fd0-9e2ed2a3a3bb None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:59.858741 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b48c6-c494-4948-8fd0-9e2ed2a3a3bb None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:59.863650 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68307be4-5812-4201-9295-cc21bb6ca4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:59.864342 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68307be4-5812-4201-9295-cc21bb6ca4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:59.864633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68307be4-5812-4201-9295-cc21bb6ca4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:59.864915 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68307be4-5812-4201-9295-cc21bb6ca4d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:59.865790 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68307be4-5812-4201-9295-cc21bb6ca4d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:39:59.866105 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68307be4-5812-4201-9295-cc21bb6ca4d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:59.869263 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68307be4-5812-4201-9295-cc21bb6ca4d7 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:59.872464 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:39:59.885621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1343/2672] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:39:59.889999 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123c389-ce2e-4890-80a4-ea9756c0c215 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:59.900321 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123c389-ce2e-4890-80a4-ea9756c0c215 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:39:59.905416 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29a297-9f23-4710-80cb-8d6d2f24e81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:39:59.906129 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29a297-9f23-4710-80cb-8d6d2f24e81b admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:39:59.906427 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29a297-9f23-4710-80cb-8d6d2f24e81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:39:59.906750 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29a297-9f23-4710-80cb-8d6d2f24e81b admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:39:59.907486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29a297-9f23-4710-80cb-8d6d2f24e81b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:39:59.909563 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29a297-9f23-4710-80cb-8d6d2f24e81b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:39:59.937184 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1330/2673] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:39:59 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:39:59.941227 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68307be4-5812-4201-9295-cc21bb6ca4d7 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:39:59.951274 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68307be4-5812-4201-9295-cc21bb6ca4d7 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:00.012822 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44782c-8b4e-4b0e-aedf-b67fc12ec18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:00.013490 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44782c-8b4e-4b0e-aedf-b67fc12ec18d admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:00.013775 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44782c-8b4e-4b0e-aedf-b67fc12ec18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:00.014051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44782c-8b4e-4b0e-aedf-b67fc12ec18d admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:00.014780 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44782c-8b4e-4b0e-aedf-b67fc12ec18d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:00.016699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44782c-8b4e-4b0e-aedf-b67fc12ec18d admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:00.040268 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1344/2674] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:39:59 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:40:00.044113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29a297-9f23-4710-80cb-8d6d2f24e81b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:00.055042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29a297-9f23-4710-80cb-8d6d2f24e81b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:00.059854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec54b8-a45d-4157-89f3-fa238babbac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:00.060527 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec54b8-a45d-4157-89f3-fa238babbac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:00.060818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec54b8-a45d-4157-89f3-fa238babbac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:00.061102 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec54b8-a45d-4157-89f3-fa238babbac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:00.061900 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec54b8-a45d-4157-89f3-fa238babbac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:00.063948 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec54b8-a45d-4157-89f3-fa238babbac8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:00.076123 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1331/2675] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:40:00.080487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44782c-8b4e-4b0e-aedf-b67fc12ec18d admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:00.094267 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44782c-8b4e-4b0e-aedf-b67fc12ec18d admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:00.099212 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8ac14-572f-4d53-8922-806e5055c113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:00.100056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8ac14-572f-4d53-8922-806e5055c113 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:00.100353 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8ac14-572f-4d53-8922-806e5055c113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:00.100638 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8ac14-572f-4d53-8922-806e5055c113 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:00.101373 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8ac14-572f-4d53-8922-806e5055c113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:00.103215 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8ac14-572f-4d53-8922-806e5055c113 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:00.117644 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1345/2676] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:40:00.118692 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec54b8-a45d-4157-89f3-fa238babbac8 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:00.130737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec54b8-a45d-4157-89f3-fa238babbac8 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:00.135984 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0d634-8ae3-403d-8432-8d08fdbeebaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:00.136875 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0d634-8ae3-403d-8432-8d08fdbeebaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:00.137195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0d634-8ae3-403d-8432-8d08fdbeebaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:00.137475 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0d634-8ae3-403d-8432-8d08fdbeebaf admin admin] PATH_INFO: `/v3/projects/f1d6c1970c7a493d9dd331586cc380eb/users/dd7aba5cdd244088bca82b186da83af5/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:00.153272 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0d634-8ae3-403d-8432-8d08fdbeebaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d6c1970c7a493d9dd331586cc380eb, user_id=dd7aba5cdd244088bca82b186da83af5, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:00.155973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0d634-8ae3-403d-8432-8d08fdbeebaf admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:00.168725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1332/2677] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:40:00 2022] PUT /identity/v3/projects/f1d6c1970c7a493d9dd331586cc380eb/users/dd7aba5cdd244088bca82b186da83af5/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:40:00.179005 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224afec1-75db-4e88-9911-b165fd3c8b92 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:00.179300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224afec1-75db-4e88-9911-b165fd3c8b92 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:00.179835 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224afec1-75db-4e88-9911-b165fd3c8b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:00.208334 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-224afec1-75db-4e88-9911-b165fd3c8b92 None None] MFA Rules not processed for user `dd7aba5cdd244088bca82b186da83af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:00.209549 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-224afec1-75db-4e88-9911-b165fd3c8b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:00.271942 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1346/2678] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:40:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:00.277041 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0d634-8ae3-403d-8432-8d08fdbeebaf admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:00.347126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0d634-8ae3-403d-8432-8d08fdbeebaf admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:00.352036 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac0a43-b1dd-4c31-9f24-0824de431733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:00.353107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac0a43-b1dd-4c31-9f24-0824de431733 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:00.353107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac0a43-b1dd-4c31-9f24-0824de431733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:00.353343 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac0a43-b1dd-4c31-9f24-0824de431733 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:00.354024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac0a43-b1dd-4c31-9f24-0824de431733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:00.355972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac0a43-b1dd-4c31-9f24-0824de431733 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:00.384793 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1333/2679] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:40:00 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:40:00.389352 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224afec1-75db-4e88-9911-b165fd3c8b92 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:00.400587 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224afec1-75db-4e88-9911-b165fd3c8b92 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:00.467529 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278a018-fb8f-40c1-a299-2eba8c288f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:00.468199 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278a018-fb8f-40c1-a299-2eba8c288f73 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:00.468483 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278a018-fb8f-40c1-a299-2eba8c288f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:00.468775 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278a018-fb8f-40c1-a299-2eba8c288f73 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:00.469453 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278a018-fb8f-40c1-a299-2eba8c288f73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:00.471401 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278a018-fb8f-40c1-a299-2eba8c288f73 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:00.479150 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:00.491679 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1347/2680] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:40:00 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:40:00.496448 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac0a43-b1dd-4c31-9f24-0824de431733 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:00.507021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac0a43-b1dd-4c31-9f24-0824de431733 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:00.512206 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde683f7-a249-4925-b4fc-b58d1e6f0a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:00.512868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde683f7-a249-4925-b4fc-b58d1e6f0a6a admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:00.513153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde683f7-a249-4925-b4fc-b58d1e6f0a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:00.513552 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde683f7-a249-4925-b4fc-b58d1e6f0a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:00.514287 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde683f7-a249-4925-b4fc-b58d1e6f0a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:00.515960 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde683f7-a249-4925-b4fc-b58d1e6f0a6a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:00.530286 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1334/2681] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:40:00.531634 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278a018-fb8f-40c1-a299-2eba8c288f73 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:00.543980 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278a018-fb8f-40c1-a299-2eba8c288f73 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:00.549050 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbccce8-df0f-42af-863b-83bfdd40988e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:00.550149 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbccce8-df0f-42af-863b-83bfdd40988e admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:00.550560 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbccce8-df0f-42af-863b-83bfdd40988e admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:00.551006 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbccce8-df0f-42af-863b-83bfdd40988e admin admin] PATH_INFO: `/v3/projects/5671f68e0af5424bb1f48fbde86ff537/users/94699b3fd408418fb049ec9d858fb619/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:00.569959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbccce8-df0f-42af-863b-83bfdd40988e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5671f68e0af5424bb1f48fbde86ff537, user_id=94699b3fd408418fb049ec9d858fb619, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:00.573496 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbccce8-df0f-42af-863b-83bfdd40988e admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:00.589097 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1348/2682] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:40:00 2022] PUT /identity/v3/projects/5671f68e0af5424bb1f48fbde86ff537/users/94699b3fd408418fb049ec9d858fb619/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:40:00.593727 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde683f7-a249-4925-b4fc-b58d1e6f0a6a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:00.603981 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde683f7-a249-4925-b4fc-b58d1e6f0a6a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:00.612288 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:00.665200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd47d84-2332-4b60-8a8d-dc03f9217bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:00.665863 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd47d84-2332-4b60-8a8d-dc03f9217bbc admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:00.666147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd47d84-2332-4b60-8a8d-dc03f9217bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:00.666422 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd47d84-2332-4b60-8a8d-dc03f9217bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:00.667165 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd47d84-2332-4b60-8a8d-dc03f9217bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:00.668764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd47d84-2332-4b60-8a8d-dc03f9217bbc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:00.678611 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1335/2683] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:40:00.683446 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbccce8-df0f-42af-863b-83bfdd40988e admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:00.693810 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbccce8-df0f-42af-863b-83bfdd40988e admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:00.698944 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d7a49-d219-43d9-ac53-0b1726c2a61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:00.699826 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d7a49-d219-43d9-ac53-0b1726c2a61a admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:00.700114 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d7a49-d219-43d9-ac53-0b1726c2a61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:00.700394 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d7a49-d219-43d9-ac53-0b1726c2a61a admin admin] PATH_INFO: `/v3/projects/5671f68e0af5424bb1f48fbde86ff537/users/94699b3fd408418fb049ec9d858fb619/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:00.702330 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d7a49-d219-43d9-ac53-0b1726c2a61a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5671f68e0af5424bb1f48fbde86ff537, user_id=94699b3fd408418fb049ec9d858fb619, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:00.704979 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d7a49-d219-43d9-ac53-0b1726c2a61a admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:00.715205 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1349/2684] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:40:00 2022] PUT /identity/v3/projects/5671f68e0af5424bb1f48fbde86ff537/users/94699b3fd408418fb049ec9d858fb619/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:40:00.726175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b911b-6c8d-4d33-a8c4-04f1561e4187 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:00.726469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b911b-6c8d-4d33-a8c4-04f1561e4187 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:00.726773 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b911b-6c8d-4d33-a8c4-04f1561e4187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:00.753710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-dc7b911b-6c8d-4d33-a8c4-04f1561e4187 None None] MFA Rules not processed for user `94699b3fd408418fb049ec9d858fb619`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:00.755094 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-dc7b911b-6c8d-4d33-a8c4-04f1561e4187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:00.824247 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1336/2685] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:40:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:00.836433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d7a49-d219-43d9-ac53-0b1726c2a61a admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:00.838238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-964d7a49-d219-43d9-ac53-0b1726c2a61a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:00.903114 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d7a49-d219-43d9-ac53-0b1726c2a61a admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:00.906749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf14059-017c-489b-90d7-f601113c5da5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:00.907379 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf14059-017c-489b-90d7-f601113c5da5 service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:00.907666 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf14059-017c-489b-90d7-f601113c5da5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:00.907940 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf14059-017c-489b-90d7-f601113c5da5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:00.917147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf14059-017c-489b-90d7-f601113c5da5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:00.918609 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf14059-017c-489b-90d7-f601113c5da5 service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:00.927869 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1350/2686] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:40:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:01.001153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b911b-6c8d-4d33-a8c4-04f1561e4187 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:01.010856 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b911b-6c8d-4d33-a8c4-04f1561e4187 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:01.014415 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c9ef5-731f-47fe-a705-c270d35bb260 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:01.015093 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c9ef5-731f-47fe-a705-c270d35bb260 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:01.015378 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c9ef5-731f-47fe-a705-c270d35bb260 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:01.015655 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c9ef5-731f-47fe-a705-c270d35bb260 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:01.071983 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c9ef5-731f-47fe-a705-c270d35bb260 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:01.073451 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c9ef5-731f-47fe-a705-c270d35bb260 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:01.082602 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1337/2687] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:40:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:07.942858 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf14059-017c-489b-90d7-f601113c5da5 service cinder] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:08.006526 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf14059-017c-489b-90d7-f601113c5da5 service cinder] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:08.011526 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f1c31-0ca0-476e-9f4a-c1c7bb6d8c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:08.012399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f1c31-0ca0-476e-9f4a-c1c7bb6d8c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:08.012685 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f1c31-0ca0-476e-9f4a-c1c7bb6d8c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:08.012981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f1c31-0ca0-476e-9f4a-c1c7bb6d8c09 admin admin] PATH_INFO: `/v3/users/dd7aba5cdd244088bca82b186da83af5` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:08.014144 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f1c31-0ca0-476e-9f4a-c1c7bb6d8c09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd7aba5cdd244088bca82b186da83af5)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:08.016090 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f1c31-0ca0-476e-9f4a-c1c7bb6d8c09 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:08.063824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0a2f1c31-0ca0-476e-9f4a-c1c7bb6d8c09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd7aba5cdd244088bca82b186da83af5'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:08.071452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0a2f1c31-0ca0-476e-9f4a-c1c7bb6d8c09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd7aba5cdd244088bca82b186da83af5'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:08.076048 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:08.085363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0a2f1c31-0ca0-476e-9f4a-c1c7bb6d8c09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd7aba5cdd244088bca82b186da83af5'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:08.094334 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0a2f1c31-0ca0-476e-9f4a-c1c7bb6d8c09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd7aba5cdd244088bca82b186da83af5'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:08.095254 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0a2f1c31-0ca0-476e-9f4a-c1c7bb6d8c09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd7aba5cdd244088bca82b186da83af5'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:08.101921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1351/2688] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:40:07 2022] DELETE /identity/v3/users/dd7aba5cdd244088bca82b186da83af5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:40:08.107182 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd4281-eef8-4b83-9ddf-b95f33e93323 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:08.107669 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd4281-eef8-4b83-9ddf-b95f33e93323 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:08.107781 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd4281-eef8-4b83-9ddf-b95f33e93323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:08.124783 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f2fd4281-eef8-4b83-9ddf-b95f33e93323 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:08.126062 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f2fd4281-eef8-4b83-9ddf-b95f33e93323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:08.152673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:08.192391 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1338/2689] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:08.202482 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f1c31-0ca0-476e-9f4a-c1c7bb6d8c09 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:08.203911 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-0a2f1c31-0ca0-476e-9f4a-c1c7bb6d8c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:08.269896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f1c31-0ca0-476e-9f4a-c1c7bb6d8c09 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:08.274711 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c518f2-c537-4c17-b118-68acdbd6695c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:08.275538 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c518f2-c537-4c17-b118-68acdbd6695c service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:08.275777 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c518f2-c537-4c17-b118-68acdbd6695c service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:08.276205 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c518f2-c537-4c17-b118-68acdbd6695c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:08.290288 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c518f2-c537-4c17-b118-68acdbd6695c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:08.291884 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c518f2-c537-4c17-b118-68acdbd6695c service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:08.303195 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1352/2690] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:40:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:08.682327 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd4281-eef8-4b83-9ddf-b95f33e93323 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:08.684200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f2fd4281-eef8-4b83-9ddf-b95f33e93323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:08.704734 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd4281-eef8-4b83-9ddf-b95f33e93323 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:08.715798 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96daf28-1844-480f-b221-fe6e89452b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:08.716719 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96daf28-1844-480f-b221-fe6e89452b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:08.717008 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96daf28-1844-480f-b221-fe6e89452b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:08.717293 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96daf28-1844-480f-b221-fe6e89452b60 admin admin] PATH_INFO: `/v3/projects/f1d6c1970c7a493d9dd331586cc380eb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:08.726779 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96daf28-1844-480f-b221-fe6e89452b60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1d6c1970c7a493d9dd331586cc380eb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:08.726779 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96daf28-1844-480f-b221-fe6e89452b60 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:08.770471 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f96daf28-1844-480f-b221-fe6e89452b60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1d6c1970c7a493d9dd331586cc380eb', 'request_id': 'req-f96daf28-1844-480f-b221-fe6e89452b60'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:08.776944 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f96daf28-1844-480f-b221-fe6e89452b60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1d6c1970c7a493d9dd331586cc380eb', 'request_id': 'req-f96daf28-1844-480f-b221-fe6e89452b60'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:08.782693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f96daf28-1844-480f-b221-fe6e89452b60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1d6c1970c7a493d9dd331586cc380eb', 'request_id': 'req-f96daf28-1844-480f-b221-fe6e89452b60'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:08.794864 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f96daf28-1844-480f-b221-fe6e89452b60 admin admin] The token cache is being invalidate because project f1d6c1970c7a493d9dd331586cc380eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:40:08.795160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f96daf28-1844-480f-b221-fe6e89452b60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:08.795827 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f96daf28-1844-480f-b221-fe6e89452b60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:08.797493 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1339/2691] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:40:08 2022] DELETE /identity/v3/projects/f1d6c1970c7a493d9dd331586cc380eb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:40:08.801750 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c518f2-c537-4c17-b118-68acdbd6695c service neutron] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:08.813358 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c518f2-c537-4c17-b118-68acdbd6695c service neutron] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:08.871434 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fada7-715d-4267-81f3-221508ca237c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:08.872315 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fada7-715d-4267-81f3-221508ca237c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:08.872599 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fada7-715d-4267-81f3-221508ca237c admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:08.872877 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fada7-715d-4267-81f3-221508ca237c admin admin] PATH_INFO: `/v3/users/94699b3fd408418fb049ec9d858fb619` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:08.874063 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fada7-715d-4267-81f3-221508ca237c admin admin] RBAC: Authorizing `identity:delete_user(user_id=94699b3fd408418fb049ec9d858fb619)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:08.876043 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fada7-715d-4267-81f3-221508ca237c admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:08.925253 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-f85fada7-715d-4267-81f3-221508ca237c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94699b3fd408418fb049ec9d858fb619'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:08.933856 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-f85fada7-715d-4267-81f3-221508ca237c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94699b3fd408418fb049ec9d858fb619'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:08.946430 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-f85fada7-715d-4267-81f3-221508ca237c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94699b3fd408418fb049ec9d858fb619'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:08.953279 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-f85fada7-715d-4267-81f3-221508ca237c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94699b3fd408418fb049ec9d858fb619'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:08.953985 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-f85fada7-715d-4267-81f3-221508ca237c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94699b3fd408418fb049ec9d858fb619'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:08.955423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:08.962247 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1353/2692] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:40:08 2022] DELETE /identity/v3/users/94699b3fd408418fb049ec9d858fb619 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:40:09.249368 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96daf28-1844-480f-b221-fe6e89452b60 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:09.250991 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f96daf28-1844-480f-b221-fe6e89452b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:09.264538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96daf28-1844-480f-b221-fe6e89452b60 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:09.326106 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ced6a6-5296-457e-a51a-358744b67867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:09.327112 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ced6a6-5296-457e-a51a-358744b67867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:09.327399 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ced6a6-5296-457e-a51a-358744b67867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:09.327783 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ced6a6-5296-457e-a51a-358744b67867 admin admin] PATH_INFO: `/v3/projects/5671f68e0af5424bb1f48fbde86ff537` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:09.328968 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ced6a6-5296-457e-a51a-358744b67867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5671f68e0af5424bb1f48fbde86ff537)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:09.331453 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ced6a6-5296-457e-a51a-358744b67867 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:09.381702 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c8ced6a6-5296-457e-a51a-358744b67867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5671f68e0af5424bb1f48fbde86ff537', 'request_id': 'req-c8ced6a6-5296-457e-a51a-358744b67867'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:09.388131 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c8ced6a6-5296-457e-a51a-358744b67867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5671f68e0af5424bb1f48fbde86ff537', 'request_id': 'req-c8ced6a6-5296-457e-a51a-358744b67867'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:09.390723 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:09.394397 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c8ced6a6-5296-457e-a51a-358744b67867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5671f68e0af5424bb1f48fbde86ff537', 'request_id': 'req-c8ced6a6-5296-457e-a51a-358744b67867'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:09.419551 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c8ced6a6-5296-457e-a51a-358744b67867 admin admin] The token cache is being invalidate because project 5671f68e0af5424bb1f48fbde86ff537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:40:09.419852 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c8ced6a6-5296-457e-a51a-358744b67867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:09.420526 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c8ced6a6-5296-457e-a51a-358744b67867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:09.422367 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1340/2693] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:40:09 2022] DELETE /identity/v3/projects/5671f68e0af5424bb1f48fbde86ff537 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:40:09.427519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5062a-017a-45fa-b354-891c2f5373e3 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:09.427818 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5062a-017a-45fa-b354-891c2f5373e3 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:09.428101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5062a-017a-45fa-b354-891c2f5373e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:09.446641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-69a5062a-017a-45fa-b354-891c2f5373e3 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:09.447800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-69a5062a-017a-45fa-b354-891c2f5373e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:09.510610 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1354/2694] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:09.518389 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cac35-d641-4132-857f-a97a57ecc9dd None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:09.518709 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cac35-d641-4132-857f-a97a57ecc9dd None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:09.518991 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cac35-d641-4132-857f-a97a57ecc9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:09.538174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d12cac35-d641-4132-857f-a97a57ecc9dd None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:09.539512 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d12cac35-d641-4132-857f-a97a57ecc9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:09.548970 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1341/2695] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:09.553200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5062a-017a-45fa-b354-891c2f5373e3 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:09.563080 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5062a-017a-45fa-b354-891c2f5373e3 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:09.567677 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc72f5c-da50-49eb-9622-294f06e08696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:09.568357 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc72f5c-da50-49eb-9622-294f06e08696 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:09.568645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc72f5c-da50-49eb-9622-294f06e08696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:09.568922 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc72f5c-da50-49eb-9622-294f06e08696 admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:09.569724 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc72f5c-da50-49eb-9622-294f06e08696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:40:09.570041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc72f5c-da50-49eb-9622-294f06e08696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:09.571697 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc72f5c-da50-49eb-9622-294f06e08696 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:09.584117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1355/2696] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:40:09.588871 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cac35-d641-4132-857f-a97a57ecc9dd None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:09.598398 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cac35-d641-4132-857f-a97a57ecc9dd None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:09.604302 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33d5d0-ad35-41d1-8579-1d8362166e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:09.604975 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33d5d0-ad35-41d1-8579-1d8362166e8d admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:09.605263 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33d5d0-ad35-41d1-8579-1d8362166e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:09.605544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33d5d0-ad35-41d1-8579-1d8362166e8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:09.606241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33d5d0-ad35-41d1-8579-1d8362166e8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:09.608227 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33d5d0-ad35-41d1-8579-1d8362166e8d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:09.638279 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1342/2697] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:40:09 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:40:09.642539 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc72f5c-da50-49eb-9622-294f06e08696 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:09.654055 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc72f5c-da50-49eb-9622-294f06e08696 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:09.714524 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41cfba-4776-4ea1-bbda-d80480c4c633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:09.715139 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41cfba-4776-4ea1-bbda-d80480c4c633 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:09.715429 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41cfba-4776-4ea1-bbda-d80480c4c633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:09.715708 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41cfba-4776-4ea1-bbda-d80480c4c633 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:09.716415 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41cfba-4776-4ea1-bbda-d80480c4c633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:09.718358 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41cfba-4776-4ea1-bbda-d80480c4c633 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:09.738683 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1356/2698] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:40:09 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:40:09.744265 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33d5d0-ad35-41d1-8579-1d8362166e8d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:09.755311 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33d5d0-ad35-41d1-8579-1d8362166e8d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:09.760034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e4ef7-35b4-4ceb-93ca-ce1f69066574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:09.760698 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e4ef7-35b4-4ceb-93ca-ce1f69066574 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:09.761042 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e4ef7-35b4-4ceb-93ca-ce1f69066574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:09.761324 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e4ef7-35b4-4ceb-93ca-ce1f69066574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:09.764938 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e4ef7-35b4-4ceb-93ca-ce1f69066574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:09.766622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e4ef7-35b4-4ceb-93ca-ce1f69066574 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:09.784731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1343/2699] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:40:09.789155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41cfba-4776-4ea1-bbda-d80480c4c633 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:09.800294 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41cfba-4776-4ea1-bbda-d80480c4c633 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:09.806352 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc883571-a00d-49dc-91cb-7ef79222891f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:09.807045 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc883571-a00d-49dc-91cb-7ef79222891f admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:09.807336 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc883571-a00d-49dc-91cb-7ef79222891f admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:09.807618 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc883571-a00d-49dc-91cb-7ef79222891f admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:09.808346 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc883571-a00d-49dc-91cb-7ef79222891f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:09.809953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc883571-a00d-49dc-91cb-7ef79222891f admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:09.820183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1357/2700] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:40:09.824518 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e4ef7-35b4-4ceb-93ca-ce1f69066574 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:09.834574 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e4ef7-35b4-4ceb-93ca-ce1f69066574 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:09.839130 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cfa26-b680-4b29-ba4d-d42a81a76e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:09.840001 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cfa26-b680-4b29-ba4d-d42a81a76e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:09.840281 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cfa26-b680-4b29-ba4d-d42a81a76e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:09.840560 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cfa26-b680-4b29-ba4d-d42a81a76e5b admin admin] PATH_INFO: `/v3/projects/17f478f1af304ee7a39f51577f308df5/users/ae5b17aa001e401c951b69a3309a20fd/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:09.856458 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7cfa26-b680-4b29-ba4d-d42a81a76e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f478f1af304ee7a39f51577f308df5, user_id=ae5b17aa001e401c951b69a3309a20fd, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:09.859296 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7cfa26-b680-4b29-ba4d-d42a81a76e5b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:09.873477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1344/2701] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:40:09 2022] PUT /identity/v3/projects/17f478f1af304ee7a39f51577f308df5/users/ae5b17aa001e401c951b69a3309a20fd/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:40:09.885032 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e0b35-1459-4b81-a324-9a050d6a39dc None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:09.885363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e0b35-1459-4b81-a324-9a050d6a39dc None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:09.885652 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e0b35-1459-4b81-a324-9a050d6a39dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:09.912108 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-0d0e0b35-1459-4b81-a324-9a050d6a39dc None None] MFA Rules not processed for user `ae5b17aa001e401c951b69a3309a20fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:09.913320 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-0d0e0b35-1459-4b81-a324-9a050d6a39dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:09.973753 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:09.986829 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1358/2702] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:40:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:09.991252 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cfa26-b680-4b29-ba4d-d42a81a76e5b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:10.053677 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cfa26-b680-4b29-ba4d-d42a81a76e5b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:10.059189 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d86b6-3c62-46aa-ab91-895f9664b171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:10.059844 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d86b6-3c62-46aa-ab91-895f9664b171 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:10.060128 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d86b6-3c62-46aa-ab91-895f9664b171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:10.060404 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d86b6-3c62-46aa-ab91-895f9664b171 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:10.061087 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d86b6-3c62-46aa-ab91-895f9664b171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:10.063039 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d86b6-3c62-46aa-ab91-895f9664b171 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:10.088800 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1345/2703] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:40:09 2022] POST /identity/v3/projects => generated 389 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:40:10.092731 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e0b35-1459-4b81-a324-9a050d6a39dc None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:10.104018 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e0b35-1459-4b81-a324-9a050d6a39dc None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:10.162464 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0588a-9aae-46f1-9554-0baf25d8eee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:10.163250 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0588a-9aae-46f1-9554-0baf25d8eee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:10.163543 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0588a-9aae-46f1-9554-0baf25d8eee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:10.163822 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0588a-9aae-46f1-9554-0baf25d8eee8 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:10.164524 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0588a-9aae-46f1-9554-0baf25d8eee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:10.167041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0588a-9aae-46f1-9554-0baf25d8eee8 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:10.191877 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1359/2704] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:40:10 2022] POST /identity/v3/users => generated 301 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:40:10.193092 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d86b6-3c62-46aa-ab91-895f9664b171 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:10.205002 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d86b6-3c62-46aa-ab91-895f9664b171 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:10.209671 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe0c55-f0db-43cc-973b-f5ec4986e8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:10.210413 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe0c55-f0db-43cc-973b-f5ec4986e8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:10.210742 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe0c55-f0db-43cc-973b-f5ec4986e8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:10.211024 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe0c55-f0db-43cc-973b-f5ec4986e8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:10.212271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe0c55-f0db-43cc-973b-f5ec4986e8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:10.213908 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe0c55-f0db-43cc-973b-f5ec4986e8b0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:10.226314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1346/2705] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:40:10.231087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0588a-9aae-46f1-9554-0baf25d8eee8 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:10.241415 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0588a-9aae-46f1-9554-0baf25d8eee8 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:10.246298 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b253db3-02c0-4f4e-ad35-451cd579f230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:10.247251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b253db3-02c0-4f4e-ad35-451cd579f230 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:10.247544 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b253db3-02c0-4f4e-ad35-451cd579f230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:10.247823 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b253db3-02c0-4f4e-ad35-451cd579f230 admin admin] PATH_INFO: `/v3/projects/7002c34789a349d2bd0cb4ec07c9efd4/users/e0dda7b2209d44e3b09211c8d2d46aa4/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:10.272520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b253db3-02c0-4f4e-ad35-451cd579f230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7002c34789a349d2bd0cb4ec07c9efd4, user_id=e0dda7b2209d44e3b09211c8d2d46aa4, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:10.276371 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b253db3-02c0-4f4e-ad35-451cd579f230 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:10.293751 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1360/2706] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:40:10 2022] PUT /identity/v3/projects/7002c34789a349d2bd0cb4ec07c9efd4/users/e0dda7b2209d44e3b09211c8d2d46aa4/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:40:10.297980 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe0c55-f0db-43cc-973b-f5ec4986e8b0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:10.309115 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe0c55-f0db-43cc-973b-f5ec4986e8b0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:10.362768 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:10.371685 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c487f2-8e09-4b51-a0ea-37618761c81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:10.372695 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c487f2-8e09-4b51-a0ea-37618761c81a admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:10.373198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c487f2-8e09-4b51-a0ea-37618761c81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:10.373661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c487f2-8e09-4b51-a0ea-37618761c81a admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:10.374458 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c487f2-8e09-4b51-a0ea-37618761c81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:10.376308 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c487f2-8e09-4b51-a0ea-37618761c81a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:10.386561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1347/2707] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:40:10.392001 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b253db3-02c0-4f4e-ad35-451cd579f230 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:10.406968 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b253db3-02c0-4f4e-ad35-451cd579f230 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:10.411694 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2dec2a-1728-454a-bcac-d5537088ea7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:10.412590 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dec2a-1728-454a-bcac-d5537088ea7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:10.412875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dec2a-1728-454a-bcac-d5537088ea7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:10.413153 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dec2a-1728-454a-bcac-d5537088ea7f admin admin] PATH_INFO: `/v3/projects/7002c34789a349d2bd0cb4ec07c9efd4/users/e0dda7b2209d44e3b09211c8d2d46aa4/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:10.415852 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2dec2a-1728-454a-bcac-d5537088ea7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7002c34789a349d2bd0cb4ec07c9efd4, user_id=e0dda7b2209d44e3b09211c8d2d46aa4, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:10.418480 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2dec2a-1728-454a-bcac-d5537088ea7f admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:10.429586 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1361/2708] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:40:10 2022] PUT /identity/v3/projects/7002c34789a349d2bd0cb4ec07c9efd4/users/e0dda7b2209d44e3b09211c8d2d46aa4/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:40:10.440224 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade0470-3ffc-41a0-ba2c-ad3bd8e7fea5 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:10.440523 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade0470-3ffc-41a0-ba2c-ad3bd8e7fea5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:10.440805 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade0470-3ffc-41a0-ba2c-ad3bd8e7fea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:10.469252 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-aade0470-3ffc-41a0-ba2c-ad3bd8e7fea5 None None] MFA Rules not processed for user `e0dda7b2209d44e3b09211c8d2d46aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:10.470490 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-aade0470-3ffc-41a0-ba2c-ad3bd8e7fea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:10.540942 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1348/2709] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:40:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:10.552098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2dec2a-1728-454a-bcac-d5537088ea7f admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:10.553796 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-3e2dec2a-1728-454a-bcac-d5537088ea7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:10.612830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2dec2a-1728-454a-bcac-d5537088ea7f admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:10.616493 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c93d97-1254-4784-b6ed-3b68df6dfc0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:10.617119 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c93d97-1254-4784-b6ed-3b68df6dfc0b service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:10.617407 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c93d97-1254-4784-b6ed-3b68df6dfc0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:10.617741 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c93d97-1254-4784-b6ed-3b68df6dfc0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:10.626681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c93d97-1254-4784-b6ed-3b68df6dfc0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:10.628124 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c93d97-1254-4784-b6ed-3b68df6dfc0b service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:10.637895 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1362/2710] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:40:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:10.767465 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade0470-3ffc-41a0-ba2c-ad3bd8e7fea5 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:10.850250 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade0470-3ffc-41a0-ba2c-ad3bd8e7fea5 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:10.854823 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d341c7-352e-45de-963b-630bdfa3572f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:10.855702 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d341c7-352e-45de-963b-630bdfa3572f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:10.855990 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d341c7-352e-45de-963b-630bdfa3572f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:10.856271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d341c7-352e-45de-963b-630bdfa3572f admin admin] PATH_INFO: `/v3/users/ae5b17aa001e401c951b69a3309a20fd` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:10.857484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d341c7-352e-45de-963b-630bdfa3572f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae5b17aa001e401c951b69a3309a20fd)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:10.859565 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d341c7-352e-45de-963b-630bdfa3572f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:10.909613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-31d341c7-352e-45de-963b-630bdfa3572f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae5b17aa001e401c951b69a3309a20fd'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:10.916930 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-31d341c7-352e-45de-963b-630bdfa3572f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae5b17aa001e401c951b69a3309a20fd'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:10.917672 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-31d341c7-352e-45de-963b-630bdfa3572f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae5b17aa001e401c951b69a3309a20fd'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:10.918429 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-31d341c7-352e-45de-963b-630bdfa3572f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae5b17aa001e401c951b69a3309a20fd'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:10.931180 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-31d341c7-352e-45de-963b-630bdfa3572f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae5b17aa001e401c951b69a3309a20fd'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:10.936684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:10.946647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1349/2711] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:40:10 2022] DELETE /identity/v3/users/ae5b17aa001e401c951b69a3309a20fd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:40:10.951118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b3b55-f8b6-4de8-9739-6a6849c2706d None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:10.951413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b3b55-f8b6-4de8-9739-6a6849c2706d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:10.951693 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b3b55-f8b6-4de8-9739-6a6849c2706d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:10.969520 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-274b3b55-f8b6-4de8-9739-6a6849c2706d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:10.970759 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-274b3b55-f8b6-4de8-9739-6a6849c2706d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:11.016694 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:11.033048 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1363/2712] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:11.042973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d341c7-352e-45de-963b-630bdfa3572f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:11.044377 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-31d341c7-352e-45de-963b-630bdfa3572f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:11.104440 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d341c7-352e-45de-963b-630bdfa3572f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:11.108127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063059d4-84f1-4f08-bce7-21b44c84d3ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:11.108776 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063059d4-84f1-4f08-bce7-21b44c84d3ba service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:11.109065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063059d4-84f1-4f08-bce7-21b44c84d3ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:11.109344 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063059d4-84f1-4f08-bce7-21b44c84d3ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:11.118598 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063059d4-84f1-4f08-bce7-21b44c84d3ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:11.120059 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063059d4-84f1-4f08-bce7-21b44c84d3ba service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:11.129514 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1350/2713] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:40:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:40:11.400888 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b3b55-f8b6-4de8-9739-6a6849c2706d None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:11.402394 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-274b3b55-f8b6-4de8-9739-6a6849c2706d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:11.415693 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b3b55-f8b6-4de8-9739-6a6849c2706d None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:11.420540 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ea20e-2f93-46cd-a6f0-2b21e3476cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:11.421426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ea20e-2f93-46cd-a6f0-2b21e3476cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:11.421713 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ea20e-2f93-46cd-a6f0-2b21e3476cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:11.421998 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ea20e-2f93-46cd-a6f0-2b21e3476cb7 admin admin] PATH_INFO: `/v3/projects/17f478f1af304ee7a39f51577f308df5` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:11.423237 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ea20e-2f93-46cd-a6f0-2b21e3476cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17f478f1af304ee7a39f51577f308df5)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:11.425334 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ea20e-2f93-46cd-a6f0-2b21e3476cb7 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:11.474166 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-db9ea20e-2f93-46cd-a6f0-2b21e3476cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17f478f1af304ee7a39f51577f308df5', 'request_id': 'req-db9ea20e-2f93-46cd-a6f0-2b21e3476cb7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:11.480504 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-db9ea20e-2f93-46cd-a6f0-2b21e3476cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17f478f1af304ee7a39f51577f308df5', 'request_id': 'req-db9ea20e-2f93-46cd-a6f0-2b21e3476cb7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:11.488221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-db9ea20e-2f93-46cd-a6f0-2b21e3476cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17f478f1af304ee7a39f51577f308df5', 'request_id': 'req-db9ea20e-2f93-46cd-a6f0-2b21e3476cb7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:11.499105 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-db9ea20e-2f93-46cd-a6f0-2b21e3476cb7 admin admin] The token cache is being invalidate because project 17f478f1af304ee7a39f51577f308df5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:40:11.499398 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-db9ea20e-2f93-46cd-a6f0-2b21e3476cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:11.500027 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-db9ea20e-2f93-46cd-a6f0-2b21e3476cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:11.501559 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1364/2714] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:40:11 2022] DELETE /identity/v3/projects/17f478f1af304ee7a39f51577f308df5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:40:11.505700 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063059d4-84f1-4f08-bce7-21b44c84d3ba service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:11.516160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063059d4-84f1-4f08-bce7-21b44c84d3ba service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:11.576509 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab90a8d-5a09-4cc8-9f64-1cca34faa103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:11.577386 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab90a8d-5a09-4cc8-9f64-1cca34faa103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:11.577677 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab90a8d-5a09-4cc8-9f64-1cca34faa103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:11.577958 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab90a8d-5a09-4cc8-9f64-1cca34faa103 admin admin] PATH_INFO: `/v3/users/e0dda7b2209d44e3b09211c8d2d46aa4` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:11.579452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab90a8d-5a09-4cc8-9f64-1cca34faa103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0dda7b2209d44e3b09211c8d2d46aa4)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:11.581432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab90a8d-5a09-4cc8-9f64-1cca34faa103 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:11.630945 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7ab90a8d-5a09-4cc8-9f64-1cca34faa103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0dda7b2209d44e3b09211c8d2d46aa4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:11.637928 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7ab90a8d-5a09-4cc8-9f64-1cca34faa103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0dda7b2209d44e3b09211c8d2d46aa4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:11.638670 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7ab90a8d-5a09-4cc8-9f64-1cca34faa103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0dda7b2209d44e3b09211c8d2d46aa4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:11.639271 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7ab90a8d-5a09-4cc8-9f64-1cca34faa103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0dda7b2209d44e3b09211c8d2d46aa4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:11.652899 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7ab90a8d-5a09-4cc8-9f64-1cca34faa103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0dda7b2209d44e3b09211c8d2d46aa4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:11.665676 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1351/2715] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:40:11 2022] DELETE /identity/v3/users/e0dda7b2209d44e3b09211c8d2d46aa4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:40:12.038129 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ea20e-2f93-46cd-a6f0-2b21e3476cb7 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:12.040124 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-db9ea20e-2f93-46cd-a6f0-2b21e3476cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:12.054921 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ea20e-2f93-46cd-a6f0-2b21e3476cb7 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:12.132559 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424eac1d-a10b-486d-8844-4ae16f8fe8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:12.133551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424eac1d-a10b-486d-8844-4ae16f8fe8d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:12.133842 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424eac1d-a10b-486d-8844-4ae16f8fe8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:12.134126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424eac1d-a10b-486d-8844-4ae16f8fe8d7 admin admin] PATH_INFO: `/v3/projects/7002c34789a349d2bd0cb4ec07c9efd4` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:12.135372 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424eac1d-a10b-486d-8844-4ae16f8fe8d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7002c34789a349d2bd0cb4ec07c9efd4)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:12.137616 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424eac1d-a10b-486d-8844-4ae16f8fe8d7 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:12.208196 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-424eac1d-a10b-486d-8844-4ae16f8fe8d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7002c34789a349d2bd0cb4ec07c9efd4', 'request_id': 'req-424eac1d-a10b-486d-8844-4ae16f8fe8d7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:12.216295 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-424eac1d-a10b-486d-8844-4ae16f8fe8d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7002c34789a349d2bd0cb4ec07c9efd4', 'request_id': 'req-424eac1d-a10b-486d-8844-4ae16f8fe8d7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:12.225370 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-424eac1d-a10b-486d-8844-4ae16f8fe8d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7002c34789a349d2bd0cb4ec07c9efd4', 'request_id': 'req-424eac1d-a10b-486d-8844-4ae16f8fe8d7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:12.238221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-424eac1d-a10b-486d-8844-4ae16f8fe8d7 admin admin] The token cache is being invalidate because project 7002c34789a349d2bd0cb4ec07c9efd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:40:12.238536 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-424eac1d-a10b-486d-8844-4ae16f8fe8d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:12.239427 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-424eac1d-a10b-486d-8844-4ae16f8fe8d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:12.242622 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1365/2716] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:40:12 2022] DELETE /identity/v3/projects/7002c34789a349d2bd0cb4ec07c9efd4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:40:12.246777 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30db0c1-420a-47ab-b918-9d19e1ee5543 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:12.247077 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30db0c1-420a-47ab-b918-9d19e1ee5543 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:12.247359 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30db0c1-420a-47ab-b918-9d19e1ee5543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:12.266206 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a30db0c1-420a-47ab-b918-9d19e1ee5543 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:12.267480 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a30db0c1-420a-47ab-b918-9d19e1ee5543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:12.283555 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:12.342017 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1352/2717] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:12.350613 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc98b0-b436-4a6e-91d6-0ce54e4e0d75 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:12.350930 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc98b0-b436-4a6e-91d6-0ce54e4e0d75 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:12.351208 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc98b0-b436-4a6e-91d6-0ce54e4e0d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:12.359681 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:12.375809 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-7bbc98b0-b436-4a6e-91d6-0ce54e4e0d75 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:12.378138 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-7bbc98b0-b436-4a6e-91d6-0ce54e4e0d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:12.387537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1366/2718] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:12.391808 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30db0c1-420a-47ab-b918-9d19e1ee5543 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:12.409827 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30db0c1-420a-47ab-b918-9d19e1ee5543 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:12.415084 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fff14c-6e1c-4b0b-ab75-324f0463025a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:12.415752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fff14c-6e1c-4b0b-ab75-324f0463025a admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:12.416035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fff14c-6e1c-4b0b-ab75-324f0463025a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:12.416307 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fff14c-6e1c-4b0b-ab75-324f0463025a admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:12.418244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fff14c-6e1c-4b0b-ab75-324f0463025a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:40:12.420023 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fff14c-6e1c-4b0b-ab75-324f0463025a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:12.423586 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fff14c-6e1c-4b0b-ab75-324f0463025a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:12.440567 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1353/2719] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:40:12.444833 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc98b0-b436-4a6e-91d6-0ce54e4e0d75 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:12.456417 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc98b0-b436-4a6e-91d6-0ce54e4e0d75 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:12.460391 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b08aa4-9a93-4866-b7d3-76b3cb150a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:12.461069 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b08aa4-9a93-4866-b7d3-76b3cb150a0d admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:12.461896 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b08aa4-9a93-4866-b7d3-76b3cb150a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:12.462175 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b08aa4-9a93-4866-b7d3-76b3cb150a0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:12.462931 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b08aa4-9a93-4866-b7d3-76b3cb150a0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:12.464854 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b08aa4-9a93-4866-b7d3-76b3cb150a0d admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:12.492385 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1367/2720] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:40:12 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:40:12.496492 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fff14c-6e1c-4b0b-ab75-324f0463025a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:12.506841 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fff14c-6e1c-4b0b-ab75-324f0463025a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:12.566666 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a84f5f-2fe6-4224-b5be-622c17034e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:12.567350 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a84f5f-2fe6-4224-b5be-622c17034e9d admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:12.567641 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a84f5f-2fe6-4224-b5be-622c17034e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:12.567922 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a84f5f-2fe6-4224-b5be-622c17034e9d admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:12.568762 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a84f5f-2fe6-4224-b5be-622c17034e9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:12.570780 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a84f5f-2fe6-4224-b5be-622c17034e9d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:12.596681 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1354/2721] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:40:12 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:40:12.597882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b08aa4-9a93-4866-b7d3-76b3cb150a0d admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:12.610591 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b08aa4-9a93-4866-b7d3-76b3cb150a0d admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:12.615972 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97112ae8-7105-4613-bcb6-7a0070629f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:12.617123 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97112ae8-7105-4613-bcb6-7a0070629f53 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:12.617670 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97112ae8-7105-4613-bcb6-7a0070629f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:12.618174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97112ae8-7105-4613-bcb6-7a0070629f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:12.619559 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97112ae8-7105-4613-bcb6-7a0070629f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:12.621529 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97112ae8-7105-4613-bcb6-7a0070629f53 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:12.636102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1368/2722] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:40:12.637301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a84f5f-2fe6-4224-b5be-622c17034e9d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:12.647880 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a84f5f-2fe6-4224-b5be-622c17034e9d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:12.653052 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484aab3f-4eaf-407b-9a7a-e1baf26f543d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:12.653718 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484aab3f-4eaf-407b-9a7a-e1baf26f543d admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:12.654003 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484aab3f-4eaf-407b-9a7a-e1baf26f543d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:12.654289 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484aab3f-4eaf-407b-9a7a-e1baf26f543d admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:12.655057 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484aab3f-4eaf-407b-9a7a-e1baf26f543d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:12.656688 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484aab3f-4eaf-407b-9a7a-e1baf26f543d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:12.673474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1355/2723] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:40:12.675702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97112ae8-7105-4613-bcb6-7a0070629f53 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:12.686262 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97112ae8-7105-4613-bcb6-7a0070629f53 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:12.690995 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cfa7e-4251-460f-8cdc-a773c2009b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:12.692433 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cfa7e-4251-460f-8cdc-a773c2009b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:12.692720 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cfa7e-4251-460f-8cdc-a773c2009b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:12.693386 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cfa7e-4251-460f-8cdc-a773c2009b68 admin admin] PATH_INFO: `/v3/projects/09bbbd852b3a442cb9dd0af89a888443/users/4fa3edd5c8ad4e3fbc5660cdc7ec5715/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:12.710025 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8cfa7e-4251-460f-8cdc-a773c2009b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09bbbd852b3a442cb9dd0af89a888443, user_id=4fa3edd5c8ad4e3fbc5660cdc7ec5715, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:12.713290 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8cfa7e-4251-460f-8cdc-a773c2009b68 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:12.727722 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1369/2724] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:40:12 2022] PUT /identity/v3/projects/09bbbd852b3a442cb9dd0af89a888443/users/4fa3edd5c8ad4e3fbc5660cdc7ec5715/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:40:12.739440 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a6bb8-9ce0-4af0-acb4-a3ff7f9f6d1e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:12.739732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a6bb8-9ce0-4af0-acb4-a3ff7f9f6d1e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:12.740007 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a6bb8-9ce0-4af0-acb4-a3ff7f9f6d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:12.768345 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d63a6bb8-9ce0-4af0-acb4-a3ff7f9f6d1e None None] MFA Rules not processed for user `4fa3edd5c8ad4e3fbc5660cdc7ec5715`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:12.769580 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d63a6bb8-9ce0-4af0-acb4-a3ff7f9f6d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:12.842039 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1356/2725] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:40:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:12.853115 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cfa7e-4251-460f-8cdc-a773c2009b68 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:12.854885 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-5a8cfa7e-4251-460f-8cdc-a773c2009b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:12.915171 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cfa7e-4251-460f-8cdc-a773c2009b68 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:12.919207 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab590fdb-9412-49aa-91ae-30bddc264c4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:12.920052 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab590fdb-9412-49aa-91ae-30bddc264c4f service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:12.920344 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab590fdb-9412-49aa-91ae-30bddc264c4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:12.920621 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab590fdb-9412-49aa-91ae-30bddc264c4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:12.933258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab590fdb-9412-49aa-91ae-30bddc264c4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:12.933258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab590fdb-9412-49aa-91ae-30bddc264c4f service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:12.940334 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1370/2726] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:40:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:16.086003 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a6bb8-9ce0-4af0-acb4-a3ff7f9f6d1e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:16.098976 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:16.152917 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a6bb8-9ce0-4af0-acb4-a3ff7f9f6d1e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:16.157324 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e177c-f456-47bd-b5eb-4a188c48f0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:16.158189 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e177c-f456-47bd-b5eb-4a188c48f0f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:16.158478 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e177c-f456-47bd-b5eb-4a188c48f0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:16.158792 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e177c-f456-47bd-b5eb-4a188c48f0f6 admin admin] PATH_INFO: `/v3/users/4fa3edd5c8ad4e3fbc5660cdc7ec5715` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:16.160055 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e177c-f456-47bd-b5eb-4a188c48f0f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fa3edd5c8ad4e3fbc5660cdc7ec5715)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:16.161982 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e177c-f456-47bd-b5eb-4a188c48f0f6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:16.209684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-de7e177c-f456-47bd-b5eb-4a188c48f0f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa3edd5c8ad4e3fbc5660cdc7ec5715'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:16.219139 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-de7e177c-f456-47bd-b5eb-4a188c48f0f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa3edd5c8ad4e3fbc5660cdc7ec5715'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:16.219759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-de7e177c-f456-47bd-b5eb-4a188c48f0f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa3edd5c8ad4e3fbc5660cdc7ec5715'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:16.220424 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-de7e177c-f456-47bd-b5eb-4a188c48f0f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa3edd5c8ad4e3fbc5660cdc7ec5715'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:16.233461 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-de7e177c-f456-47bd-b5eb-4a188c48f0f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa3edd5c8ad4e3fbc5660cdc7ec5715'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:16.246971 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1357/2727] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:40:16 2022] DELETE /identity/v3/users/4fa3edd5c8ad4e3fbc5660cdc7ec5715 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:40:16.251547 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feacbc5-5150-4e6b-bdfe-ad8044461dab None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:16.252011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feacbc5-5150-4e6b-bdfe-ad8044461dab None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:16.252132 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feacbc5-5150-4e6b-bdfe-ad8044461dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:16.268966 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-1feacbc5-5150-4e6b-bdfe-ad8044461dab None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:16.270168 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-1feacbc5-5150-4e6b-bdfe-ad8044461dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:16.332125 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1371/2728] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:16.342531 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e177c-f456-47bd-b5eb-4a188c48f0f6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:16.344003 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-de7e177c-f456-47bd-b5eb-4a188c48f0f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:16.407734 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e177c-f456-47bd-b5eb-4a188c48f0f6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:16.411524 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17706d-49a5-4ff0-8729-b206c7d8ef90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:16.412193 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17706d-49a5-4ff0-8729-b206c7d8ef90 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:16.412474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17706d-49a5-4ff0-8729-b206c7d8ef90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:16.412747 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17706d-49a5-4ff0-8729-b206c7d8ef90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:16.422463 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17706d-49a5-4ff0-8729-b206c7d8ef90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:16.423925 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17706d-49a5-4ff0-8729-b206c7d8ef90 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:16.433737 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1358/2729] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:16.919142 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feacbc5-5150-4e6b-bdfe-ad8044461dab None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:16.920609 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-1feacbc5-5150-4e6b-bdfe-ad8044461dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:16.933725 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feacbc5-5150-4e6b-bdfe-ad8044461dab None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:16.944146 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407036d-709a-4c4b-8d83-d97d4d51e1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:16.945168 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407036d-709a-4c4b-8d83-d97d4d51e1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:16.946782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407036d-709a-4c4b-8d83-d97d4d51e1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:16.946782 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407036d-709a-4c4b-8d83-d97d4d51e1f0 admin admin] PATH_INFO: `/v3/projects/09bbbd852b3a442cb9dd0af89a888443` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:16.947954 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407036d-709a-4c4b-8d83-d97d4d51e1f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09bbbd852b3a442cb9dd0af89a888443)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:16.950051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407036d-709a-4c4b-8d83-d97d4d51e1f0 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:16.991040 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:17.003562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9407036d-709a-4c4b-8d83-d97d4d51e1f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09bbbd852b3a442cb9dd0af89a888443', 'request_id': 'req-9407036d-709a-4c4b-8d83-d97d4d51e1f0'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:17.012003 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9407036d-709a-4c4b-8d83-d97d4d51e1f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09bbbd852b3a442cb9dd0af89a888443', 'request_id': 'req-9407036d-709a-4c4b-8d83-d97d4d51e1f0'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:17.024227 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9407036d-709a-4c4b-8d83-d97d4d51e1f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09bbbd852b3a442cb9dd0af89a888443', 'request_id': 'req-9407036d-709a-4c4b-8d83-d97d4d51e1f0'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:17.036480 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9407036d-709a-4c4b-8d83-d97d4d51e1f0 admin admin] The token cache is being invalidate because project 09bbbd852b3a442cb9dd0af89a888443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:40:17.036772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9407036d-709a-4c4b-8d83-d97d4d51e1f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:17.037426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-9407036d-709a-4c4b-8d83-d97d4d51e1f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:17.039012 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1372/2730] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:40:16 2022] DELETE /identity/v3/projects/09bbbd852b3a442cb9dd0af89a888443 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:40:17.043957 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ea437-354e-4b55-92e8-fa2a29928823 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:17.044248 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ea437-354e-4b55-92e8-fa2a29928823 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:17.044525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ea437-354e-4b55-92e8-fa2a29928823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:17.070166 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6a2ea437-354e-4b55-92e8-fa2a29928823 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:17.072058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6a2ea437-354e-4b55-92e8-fa2a29928823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:17.103081 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:17.147063 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1359/2731] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:40:17.154803 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa07ddb-e2a2-4848-bbae-e690881f16d8 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:17.155101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa07ddb-e2a2-4848-bbae-e690881f16d8 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:17.155381 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa07ddb-e2a2-4848-bbae-e690881f16d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:17.175438 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-caa07ddb-e2a2-4848-bbae-e690881f16d8 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:17.176637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-caa07ddb-e2a2-4848-bbae-e690881f16d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:17.189797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1373/2732] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:17.193996 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ea437-354e-4b55-92e8-fa2a29928823 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:17.203846 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ea437-354e-4b55-92e8-fa2a29928823 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:17.208811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffd7f8-61ab-4dea-975f-094e20d1dbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:17.209501 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffd7f8-61ab-4dea-975f-094e20d1dbbc admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:17.209785 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffd7f8-61ab-4dea-975f-094e20d1dbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:17.210077 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffd7f8-61ab-4dea-975f-094e20d1dbbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:17.210819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffd7f8-61ab-4dea-975f-094e20d1dbbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:40:17.211659 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffd7f8-61ab-4dea-975f-094e20d1dbbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:17.213962 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffd7f8-61ab-4dea-975f-094e20d1dbbc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:17.229234 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1360/2733] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:40:17.230624 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa07ddb-e2a2-4848-bbae-e690881f16d8 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:17.240926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa07ddb-e2a2-4848-bbae-e690881f16d8 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:17.249217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73897473-0590-421e-9629-cffcfbfa6408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:17.249969 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73897473-0590-421e-9629-cffcfbfa6408 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:17.250331 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73897473-0590-421e-9629-cffcfbfa6408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:17.250712 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73897473-0590-421e-9629-cffcfbfa6408 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:17.251492 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73897473-0590-421e-9629-cffcfbfa6408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:17.253500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73897473-0590-421e-9629-cffcfbfa6408 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:17.282534 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1374/2734] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:40:17 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:40:17.285746 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffd7f8-61ab-4dea-975f-094e20d1dbbc admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:17.297752 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffd7f8-61ab-4dea-975f-094e20d1dbbc admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:17.384902 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d7a67-2e02-4c64-b7e6-3e1a7db7edc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:17.385674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d7a67-2e02-4c64-b7e6-3e1a7db7edc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:17.385889 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d7a67-2e02-4c64-b7e6-3e1a7db7edc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:17.386175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d7a67-2e02-4c64-b7e6-3e1a7db7edc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:17.387096 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d7a67-2e02-4c64-b7e6-3e1a7db7edc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:17.388930 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d7a67-2e02-4c64-b7e6-3e1a7db7edc1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:17.409145 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1361/2735] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:40:17 2022] POST /identity/v3/users => generated 285 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:40:17.413465 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73897473-0590-421e-9629-cffcfbfa6408 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:17.427124 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73897473-0590-421e-9629-cffcfbfa6408 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:17.433430 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4d540-6905-4df9-8b3b-172747227754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:17.434100 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4d540-6905-4df9-8b3b-172747227754 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:17.434396 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4d540-6905-4df9-8b3b-172747227754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:17.434703 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4d540-6905-4df9-8b3b-172747227754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:17.436692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4d540-6905-4df9-8b3b-172747227754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:17.437075 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4d540-6905-4df9-8b3b-172747227754 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:17.450919 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1375/2736] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:40:17.455529 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d7a67-2e02-4c64-b7e6-3e1a7db7edc1 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:17.467612 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d7a67-2e02-4c64-b7e6-3e1a7db7edc1 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:17.472589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593857c6-305e-463d-b884-ea4d7f5e341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:17.473190 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593857c6-305e-463d-b884-ea4d7f5e341a admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:17.473486 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593857c6-305e-463d-b884-ea4d7f5e341a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:17.473875 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593857c6-305e-463d-b884-ea4d7f5e341a admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:17.474582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593857c6-305e-463d-b884-ea4d7f5e341a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:17.476257 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593857c6-305e-463d-b884-ea4d7f5e341a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:17.487867 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1362/2737] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:40:17.491863 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4d540-6905-4df9-8b3b-172747227754 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:17.502737 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4d540-6905-4df9-8b3b-172747227754 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:17.507465 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12658a3e-4fa5-4f55-b66e-c27dc2375fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:17.508347 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12658a3e-4fa5-4f55-b66e-c27dc2375fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:17.508637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12658a3e-4fa5-4f55-b66e-c27dc2375fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:17.508917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12658a3e-4fa5-4f55-b66e-c27dc2375fd2 admin admin] PATH_INFO: `/v3/projects/a048716915d84f2cb5226c47b7427225/users/0338e73d8bb247138582143b5adb27d5/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:17.525729 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12658a3e-4fa5-4f55-b66e-c27dc2375fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a048716915d84f2cb5226c47b7427225, user_id=0338e73d8bb247138582143b5adb27d5, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:17.529619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12658a3e-4fa5-4f55-b66e-c27dc2375fd2 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:17.542708 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1376/2738] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:40:17 2022] PUT /identity/v3/projects/a048716915d84f2cb5226c47b7427225/users/0338e73d8bb247138582143b5adb27d5/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:40:17.553041 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b915a5-d082-486a-8457-31728c20a2a2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:17.553370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b915a5-d082-486a-8457-31728c20a2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:17.553722 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b915a5-d082-486a-8457-31728c20a2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:17.584696 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a3b915a5-d082-486a-8457-31728c20a2a2 None None] MFA Rules not processed for user `0338e73d8bb247138582143b5adb27d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:17.586021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a3b915a5-d082-486a-8457-31728c20a2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:17.668404 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1363/2739] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:40:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:17.682295 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12658a3e-4fa5-4f55-b66e-c27dc2375fd2 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:17.684730 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-12658a3e-4fa5-4f55-b66e-c27dc2375fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:17.748956 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12658a3e-4fa5-4f55-b66e-c27dc2375fd2 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:17.752633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cacdc80-1e77-45df-a959-b4395b8be979 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ed824e419544b33a2c4413da4b45aaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:17.753286 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacdc80-1e77-45df-a959-b4395b8be979 service glance] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:17.753574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacdc80-1e77-45df-a959-b4395b8be979 service glance] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:17.753854 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacdc80-1e77-45df-a959-b4395b8be979 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:17.765064 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cacdc80-1e77-45df-a959-b4395b8be979 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:17.766537 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cacdc80-1e77-45df-a959-b4395b8be979 service glance] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:17.776160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1377/2740] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:40:17 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 12:40:20.162953 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b915a5-d082-486a-8457-31728c20a2a2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:20.164381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a3b915a5-d082-486a-8457-31728c20a2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:20.209697 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:20.241637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b915a5-d082-486a-8457-31728c20a2a2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:20.245872 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a691af1-9033-48b0-b35b-170fb9eab91b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:20.246547 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a691af1-9033-48b0-b35b-170fb9eab91b service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:20.247427 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a691af1-9033-48b0-b35b-170fb9eab91b service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:20.247427 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a691af1-9033-48b0-b35b-170fb9eab91b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:20.249268 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8a691af1-9033-48b0-b35b-170fb9eab91b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:20.327901 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a691af1-9033-48b0-b35b-170fb9eab91b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:20.329963 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a691af1-9033-48b0-b35b-170fb9eab91b service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:20.350226 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1364/2741] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:22.371575 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6d467-bf7c-4a06-b067-1283800b2697 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:22.372099 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6d467-bf7c-4a06-b067-1283800b2697 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:22.372207 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6d467-bf7c-4a06-b067-1283800b2697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:22.389599 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-98b6d467-bf7c-4a06-b067-1283800b2697 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:22.390847 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-98b6d467-bf7c-4a06-b067-1283800b2697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:22.399620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1378/2742] 10.222.0.41 () {58 vars in 1016 bytes} [Mon May 23 12:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:22.420758 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a691af1-9033-48b0-b35b-170fb9eab91b service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:22.422304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8a691af1-9033-48b0-b35b-170fb9eab91b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:22.505130 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a691af1-9033-48b0-b35b-170fb9eab91b service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:22.516320 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cdd43-7558-405e-a8b8-51375fbcf0ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:22.516998 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cdd43-7558-405e-a8b8-51375fbcf0ed service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:22.517283 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cdd43-7558-405e-a8b8-51375fbcf0ed service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:22.517561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cdd43-7558-405e-a8b8-51375fbcf0ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:22.527344 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cdd43-7558-405e-a8b8-51375fbcf0ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:22.528993 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cdd43-7558-405e-a8b8-51375fbcf0ed service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:22.539079 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1365/2743] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:40:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:25.319109 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6d467-bf7c-4a06-b067-1283800b2697 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:25.320868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-98b6d467-bf7c-4a06-b067-1283800b2697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:25.341411 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6d467-bf7c-4a06-b067-1283800b2697 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:25.350052 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99251c-09bc-4ce5-b2ae-f9181fd647c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:25.350052 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99251c-09bc-4ce5-b2ae-f9181fd647c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:25.350052 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99251c-09bc-4ce5-b2ae-f9181fd647c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:25.350052 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99251c-09bc-4ce5-b2ae-f9181fd647c3 admin admin] PATH_INFO: `/v3/users/bd289d366668499692e13eaf08aab9b7` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:25.350455 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99251c-09bc-4ce5-b2ae-f9181fd647c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd289d366668499692e13eaf08aab9b7)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:25.352742 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99251c-09bc-4ce5-b2ae-f9181fd647c3 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:25.413368 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-5a99251c-09bc-4ce5-b2ae-f9181fd647c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd289d366668499692e13eaf08aab9b7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:25.418019 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:25.421957 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-5a99251c-09bc-4ce5-b2ae-f9181fd647c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd289d366668499692e13eaf08aab9b7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:25.438186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-5a99251c-09bc-4ce5-b2ae-f9181fd647c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd289d366668499692e13eaf08aab9b7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:25.445283 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-5a99251c-09bc-4ce5-b2ae-f9181fd647c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd289d366668499692e13eaf08aab9b7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:25.446169 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-5a99251c-09bc-4ce5-b2ae-f9181fd647c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd289d366668499692e13eaf08aab9b7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:25.454269 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1379/2744] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:40:25 2022] DELETE /identity/v3/users/bd289d366668499692e13eaf08aab9b7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:40:25.495142 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00ce92-f5f8-4744-8c99-e71f7e8f14cc None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:25.495820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00ce92-f5f8-4744-8c99-e71f7e8f14cc None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:25.496200 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00ce92-f5f8-4744-8c99-e71f7e8f14cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:25.517039 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9c00ce92-f5f8-4744-8c99-e71f7e8f14cc None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:25.518288 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9c00ce92-f5f8-4744-8c99-e71f7e8f14cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:25.606944 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1366/2745] 10.222.0.41 () {58 vars in 1016 bytes} [Mon May 23 12:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:40:25.622123 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99251c-09bc-4ce5-b2ae-f9181fd647c3 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:25.624137 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-5a99251c-09bc-4ce5-b2ae-f9181fd647c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:25.664027 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00ce92-f5f8-4744-8c99-e71f7e8f14cc None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:25.665716 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9c00ce92-f5f8-4744-8c99-e71f7e8f14cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:25.682163 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00ce92-f5f8-4744-8c99-e71f7e8f14cc None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:25.688523 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2ee86-8a19-4d70-9490-f4479c824fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:25.689935 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2ee86-8a19-4d70-9490-f4479c824fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:25.690438 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2ee86-8a19-4d70-9490-f4479c824fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:25.690812 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2ee86-8a19-4d70-9490-f4479c824fbc admin admin] PATH_INFO: `/v3/projects/69843689bc854280895f9d0c106e6237` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:25.692147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2ee86-8a19-4d70-9490-f4479c824fbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=69843689bc854280895f9d0c106e6237)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:25.694578 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2ee86-8a19-4d70-9490-f4479c824fbc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:25.697047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:25.725387 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99251c-09bc-4ce5-b2ae-f9181fd647c3 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:25.731953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb6b3b-4bb6-405b-9cf0-6d6c6a686794 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:25.732628 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb6b3b-4bb6-405b-9cf0-6d6c6a686794 service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:25.732897 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb6b3b-4bb6-405b-9cf0-6d6c6a686794 service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:25.733182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb6b3b-4bb6-405b-9cf0-6d6c6a686794 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:25.742028 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb6b3b-4bb6-405b-9cf0-6d6c6a686794 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:25.743667 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb6b3b-4bb6-405b-9cf0-6d6c6a686794 service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:25.749183 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-66e2ee86-8a19-4d70-9490-f4479c824fbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69843689bc854280895f9d0c106e6237', 'request_id': 'req-66e2ee86-8a19-4d70-9490-f4479c824fbc'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:25.753164 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1380/2746] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:25.755887 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-66e2ee86-8a19-4d70-9490-f4479c824fbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69843689bc854280895f9d0c106e6237', 'request_id': 'req-66e2ee86-8a19-4d70-9490-f4479c824fbc'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:25.764852 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-66e2ee86-8a19-4d70-9490-f4479c824fbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69843689bc854280895f9d0c106e6237', 'request_id': 'req-66e2ee86-8a19-4d70-9490-f4479c824fbc'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:25.778604 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-66e2ee86-8a19-4d70-9490-f4479c824fbc admin admin] The token cache is being invalidate because project 69843689bc854280895f9d0c106e6237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:40:25.778886 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-66e2ee86-8a19-4d70-9490-f4479c824fbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:25.779533 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-66e2ee86-8a19-4d70-9490-f4479c824fbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:25.781098 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1367/2747] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:40:25 2022] DELETE /identity/v3/projects/69843689bc854280895f9d0c106e6237 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:40:25.785125 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb6b3b-4bb6-405b-9cf0-6d6c6a686794 service nova] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:25.795048 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb6b3b-4bb6-405b-9cf0-6d6c6a686794 service nova] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:25.860061 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460302aa-bdfc-4a1e-95d1-54d6332f9992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:25.860936 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460302aa-bdfc-4a1e-95d1-54d6332f9992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:25.861217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460302aa-bdfc-4a1e-95d1-54d6332f9992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:25.861490 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460302aa-bdfc-4a1e-95d1-54d6332f9992 admin admin] PATH_INFO: `/v3/users/ae2eb0d6d0954b058981eee070d33a02` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:25.862709 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460302aa-bdfc-4a1e-95d1-54d6332f9992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae2eb0d6d0954b058981eee070d33a02)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:25.864620 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460302aa-bdfc-4a1e-95d1-54d6332f9992 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:25.929060 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-460302aa-bdfc-4a1e-95d1-54d6332f9992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae2eb0d6d0954b058981eee070d33a02'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:25.939147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-460302aa-bdfc-4a1e-95d1-54d6332f9992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae2eb0d6d0954b058981eee070d33a02'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:25.941218 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:25.954365 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-460302aa-bdfc-4a1e-95d1-54d6332f9992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae2eb0d6d0954b058981eee070d33a02'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:25.961322 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-460302aa-bdfc-4a1e-95d1-54d6332f9992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae2eb0d6d0954b058981eee070d33a02'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:25.962002 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-460302aa-bdfc-4a1e-95d1-54d6332f9992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae2eb0d6d0954b058981eee070d33a02'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:25.967922 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1381/2748] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:40:25 2022] DELETE /identity/v3/users/ae2eb0d6d0954b058981eee070d33a02 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:40:26.149626 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2ee86-8a19-4d70-9490-f4479c824fbc admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:26.151142 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-66e2ee86-8a19-4d70-9490-f4479c824fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:26.164969 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2ee86-8a19-4d70-9490-f4479c824fbc admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:26.235121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64c3bb-8fbd-4b49-9d55-d3c330feb2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:26.235990 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64c3bb-8fbd-4b49-9d55-d3c330feb2fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:26.236286 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64c3bb-8fbd-4b49-9d55-d3c330feb2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:26.236568 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64c3bb-8fbd-4b49-9d55-d3c330feb2fe admin admin] PATH_INFO: `/v3/projects/b629b591ebf84af9a656cf190c64af44` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:26.237779 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64c3bb-8fbd-4b49-9d55-d3c330feb2fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b629b591ebf84af9a656cf190c64af44)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:26.239800 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64c3bb-8fbd-4b49-9d55-d3c330feb2fe admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:26.286191 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3d64c3bb-8fbd-4b49-9d55-d3c330feb2fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b629b591ebf84af9a656cf190c64af44', 'request_id': 'req-3d64c3bb-8fbd-4b49-9d55-d3c330feb2fe'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:26.293378 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3d64c3bb-8fbd-4b49-9d55-d3c330feb2fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b629b591ebf84af9a656cf190c64af44', 'request_id': 'req-3d64c3bb-8fbd-4b49-9d55-d3c330feb2fe'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:26.299266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3d64c3bb-8fbd-4b49-9d55-d3c330feb2fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b629b591ebf84af9a656cf190c64af44', 'request_id': 'req-3d64c3bb-8fbd-4b49-9d55-d3c330feb2fe'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:26.312419 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3d64c3bb-8fbd-4b49-9d55-d3c330feb2fe admin admin] The token cache is being invalidate because project b629b591ebf84af9a656cf190c64af44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:40:26.312712 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3d64c3bb-8fbd-4b49-9d55-d3c330feb2fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:26.313328 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3d64c3bb-8fbd-4b49-9d55-d3c330feb2fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:26.314909 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1368/2749] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:40:26 2022] DELETE /identity/v3/projects/b629b591ebf84af9a656cf190c64af44 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:40:28.754631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb281e7-c15c-4c4b-b059-5661883cfa75 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:28.755140 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb281e7-c15c-4c4b-b059-5661883cfa75 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:28.755256 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb281e7-c15c-4c4b-b059-5661883cfa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:28.778064 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-5eb281e7-c15c-4c4b-b059-5661883cfa75 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:28.779350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-5eb281e7-c15c-4c4b-b059-5661883cfa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:28.839951 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1382/2750] 10.222.0.41 () {58 vars in 1016 bytes} [Mon May 23 12:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:28.857138 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64c3bb-8fbd-4b49-9d55-d3c330feb2fe admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:28.858701 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3d64c3bb-8fbd-4b49-9d55-d3c330feb2fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:28.881563 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:28.938611 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64c3bb-8fbd-4b49-9d55-d3c330feb2fe admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:28.944260 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38387e0-7cfb-412a-8a78-26cecb30079b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:28.945538 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38387e0-7cfb-412a-8a78-26cecb30079b service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:28.945822 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38387e0-7cfb-412a-8a78-26cecb30079b service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:28.946101 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38387e0-7cfb-412a-8a78-26cecb30079b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:28.954332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38387e0-7cfb-412a-8a78-26cecb30079b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:28.955963 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38387e0-7cfb-412a-8a78-26cecb30079b service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:28.965243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1369/2751] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:40:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:31.815277 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29fbe6-e1ca-42a1-94a9-325322e5f0ad None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:31.815805 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29fbe6-e1ca-42a1-94a9-325322e5f0ad None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:31.815926 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29fbe6-e1ca-42a1-94a9-325322e5f0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:31.833710 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-ac29fbe6-e1ca-42a1-94a9-325322e5f0ad None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:31.834934 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ac29fbe6-e1ca-42a1-94a9-325322e5f0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:31.842688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1383/2752] 10.222.0.41 () {58 vars in 1016 bytes} [Mon May 23 12:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:31.860041 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38387e0-7cfb-412a-8a78-26cecb30079b service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:31.861484 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a38387e0-7cfb-412a-8a78-26cecb30079b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:31.876666 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38387e0-7cfb-412a-8a78-26cecb30079b service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:31.882306 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b2b73-8219-4137-a59a-74ae81aa29b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:31.882988 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b2b73-8219-4137-a59a-74ae81aa29b8 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:31.883270 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b2b73-8219-4137-a59a-74ae81aa29b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:31.883593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b2b73-8219-4137-a59a-74ae81aa29b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:31.894837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b2b73-8219-4137-a59a-74ae81aa29b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:31.896625 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b2b73-8219-4137-a59a-74ae81aa29b8 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:31.908386 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1370/2753] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:34.968870 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8bf29-8127-4b88-9b02-4f443d0614d2 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:34.969371 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8bf29-8127-4b88-9b02-4f443d0614d2 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:34.969482 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8bf29-8127-4b88-9b02-4f443d0614d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:34.988671 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-49e8bf29-8127-4b88-9b02-4f443d0614d2 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:34.989879 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-49e8bf29-8127-4b88-9b02-4f443d0614d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:34.997785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1384/2754] 10.222.0.41 () {58 vars in 1016 bytes} [Mon May 23 12:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:35.013756 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b2b73-8219-4137-a59a-74ae81aa29b8 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:35.026023 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b2b73-8219-4137-a59a-74ae81aa29b8 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:35.031469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff046899-901b-4a11-a2d1-4effaddeee3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:35.032106 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff046899-901b-4a11-a2d1-4effaddeee3a service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:35.032393 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff046899-901b-4a11-a2d1-4effaddeee3a service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:35.032673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff046899-901b-4a11-a2d1-4effaddeee3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:35.041381 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff046899-901b-4a11-a2d1-4effaddeee3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:35.043043 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff046899-901b-4a11-a2d1-4effaddeee3a service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:35.052380 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1371/2755] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:38.124924 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae209f-1847-4330-ab9d-06f591c271c6 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:38.125362 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae209f-1847-4330-ab9d-06f591c271c6 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:38.125512 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae209f-1847-4330-ab9d-06f591c271c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:38.145802 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-34ae209f-1847-4330-ab9d-06f591c271c6 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:38.147350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-34ae209f-1847-4330-ab9d-06f591c271c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:38.156760 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1385/2756] 10.222.0.41 () {58 vars in 1016 bytes} [Mon May 23 12:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:38.173250 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff046899-901b-4a11-a2d1-4effaddeee3a service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:38.186610 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff046899-901b-4a11-a2d1-4effaddeee3a service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:38.192402 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde7a6b-3779-47d9-acda-de515f8b0137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:38.193051 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde7a6b-3779-47d9-acda-de515f8b0137 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:38.193338 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde7a6b-3779-47d9-acda-de515f8b0137 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:38.193618 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde7a6b-3779-47d9-acda-de515f8b0137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:38.203600 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde7a6b-3779-47d9-acda-de515f8b0137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:38.205216 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde7a6b-3779-47d9-acda-de515f8b0137 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:38.214804 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1372/2757] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:40:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:42.616505 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae209f-1847-4330-ab9d-06f591c271c6 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:42.618057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-34ae209f-1847-4330-ab9d-06f591c271c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:42.630072 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae209f-1847-4330-ab9d-06f591c271c6 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:42.635409 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c7070-afda-4049-921e-95d86088344d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:42.636501 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c7070-afda-4049-921e-95d86088344d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:42.636891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c7070-afda-4049-921e-95d86088344d admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:42.637281 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c7070-afda-4049-921e-95d86088344d admin admin] PATH_INFO: `/v3/users/0338e73d8bb247138582143b5adb27d5` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:42.638740 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c7070-afda-4049-921e-95d86088344d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0338e73d8bb247138582143b5adb27d5)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:42.640936 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c7070-afda-4049-921e-95d86088344d admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:42.691511 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-2a4c7070-afda-4049-921e-95d86088344d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0338e73d8bb247138582143b5adb27d5'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:42.699641 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-2a4c7070-afda-4049-921e-95d86088344d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0338e73d8bb247138582143b5adb27d5'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:42.714436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-2a4c7070-afda-4049-921e-95d86088344d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0338e73d8bb247138582143b5adb27d5'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:42.722585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-2a4c7070-afda-4049-921e-95d86088344d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0338e73d8bb247138582143b5adb27d5'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:42.723310 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-2a4c7070-afda-4049-921e-95d86088344d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0338e73d8bb247138582143b5adb27d5'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:42.731581 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1386/2758] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:40:42 2022] DELETE /identity/v3/users/0338e73d8bb247138582143b5adb27d5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:40:42.736005 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e0be7-19fa-4639-bd86-ff1c07d481b6 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:42.736525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e0be7-19fa-4639-bd86-ff1c07d481b6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:42.736628 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e0be7-19fa-4639-bd86-ff1c07d481b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:42.759841 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1f0e0be7-19fa-4639-bd86-ff1c07d481b6 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:42.761035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1f0e0be7-19fa-4639-bd86-ff1c07d481b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:42.819653 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1373/2759] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:40:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:42.829304 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c7070-afda-4049-921e-95d86088344d admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:42.830726 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-2a4c7070-afda-4049-921e-95d86088344d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:42.861542 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:42.889312 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c7070-afda-4049-921e-95d86088344d admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:42.892887 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43d908-2a32-436f-b92a-43146aba6f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:42.893519 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43d908-2a32-436f-b92a-43146aba6f44 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:42.893804 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43d908-2a32-436f-b92a-43146aba6f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:42.894080 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43d908-2a32-436f-b92a-43146aba6f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:42.902879 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43d908-2a32-436f-b92a-43146aba6f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:42.904306 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43d908-2a32-436f-b92a-43146aba6f44 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:42.913996 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1387/2760] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:40:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:43.179892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e0be7-19fa-4639-bd86-ff1c07d481b6 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:43.181423 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1f0e0be7-19fa-4639-bd86-ff1c07d481b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:43.193610 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e0be7-19fa-4639-bd86-ff1c07d481b6 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:43.198467 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ea047-cecc-46ab-acd3-3d6b7ceaa434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:43.199353 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ea047-cecc-46ab-acd3-3d6b7ceaa434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:43.199634 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ea047-cecc-46ab-acd3-3d6b7ceaa434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:43.199980 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ea047-cecc-46ab-acd3-3d6b7ceaa434 admin admin] PATH_INFO: `/v3/projects/a048716915d84f2cb5226c47b7427225` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:43.201179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ea047-cecc-46ab-acd3-3d6b7ceaa434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a048716915d84f2cb5226c47b7427225)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:43.203147 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ea047-cecc-46ab-acd3-3d6b7ceaa434 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:43.250130 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-358ea047-cecc-46ab-acd3-3d6b7ceaa434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a048716915d84f2cb5226c47b7427225', 'request_id': 'req-358ea047-cecc-46ab-acd3-3d6b7ceaa434'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:43.256370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-358ea047-cecc-46ab-acd3-3d6b7ceaa434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a048716915d84f2cb5226c47b7427225', 'request_id': 'req-358ea047-cecc-46ab-acd3-3d6b7ceaa434'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:43.260976 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:43.262612 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-358ea047-cecc-46ab-acd3-3d6b7ceaa434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a048716915d84f2cb5226c47b7427225', 'request_id': 'req-358ea047-cecc-46ab-acd3-3d6b7ceaa434'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:43.275046 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-358ea047-cecc-46ab-acd3-3d6b7ceaa434 admin admin] The token cache is being invalidate because project a048716915d84f2cb5226c47b7427225 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:40:43.275387 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-358ea047-cecc-46ab-acd3-3d6b7ceaa434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:43.276002 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-358ea047-cecc-46ab-acd3-3d6b7ceaa434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:43.277548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1374/2761] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:40:43 2022] DELETE /identity/v3/projects/a048716915d84f2cb5226c47b7427225 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:40:43.282490 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef0580-37cc-4265-83c5-e32d91f1ba5d None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:43.282815 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef0580-37cc-4265-83c5-e32d91f1ba5d None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:43.283099 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef0580-37cc-4265-83c5-e32d91f1ba5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:43.301118 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-1aef0580-37cc-4265-83c5-e32d91f1ba5d None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:43.302342 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-1aef0580-37cc-4265-83c5-e32d91f1ba5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:43.363629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1388/2762] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:40:43.371152 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfed1b-3ae8-4b3a-b4c9-da3a40ec2edd None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:43.371476 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfed1b-3ae8-4b3a-b4c9-da3a40ec2edd None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:43.371766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfed1b-3ae8-4b3a-b4c9-da3a40ec2edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:43.391008 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-50cfed1b-3ae8-4b3a-b4c9-da3a40ec2edd None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:43.392660 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-50cfed1b-3ae8-4b3a-b4c9-da3a40ec2edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:43.401974 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1375/2763] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:43.406226 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef0580-37cc-4265-83c5-e32d91f1ba5d None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:43.416941 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef0580-37cc-4265-83c5-e32d91f1ba5d None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:43.421632 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1589ebf-504a-459b-b16d-dc063964e9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:43.422286 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1589ebf-504a-459b-b16d-dc063964e9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:43.422611 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1589ebf-504a-459b-b16d-dc063964e9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:43.422893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1589ebf-504a-459b-b16d-dc063964e9e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:43.423615 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1589ebf-504a-459b-b16d-dc063964e9e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:40:43.423932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1589ebf-504a-459b-b16d-dc063964e9e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:43.425529 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1589ebf-504a-459b-b16d-dc063964e9e2 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:43.437199 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1389/2764] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:40:43.441541 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfed1b-3ae8-4b3a-b4c9-da3a40ec2edd None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:43.451007 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfed1b-3ae8-4b3a-b4c9-da3a40ec2edd None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:43.456028 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4f7fc-f387-4303-bbb4-529518d9b23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:43.456681 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4f7fc-f387-4303-bbb4-529518d9b23f admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:43.456966 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4f7fc-f387-4303-bbb4-529518d9b23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:43.457244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4f7fc-f387-4303-bbb4-529518d9b23f admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:43.457938 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4f7fc-f387-4303-bbb4-529518d9b23f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:43.460434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4f7fc-f387-4303-bbb4-529518d9b23f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:43.486857 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1376/2765] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:40:43 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:40:43.490830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1589ebf-504a-459b-b16d-dc063964e9e2 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:43.502580 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1589ebf-504a-459b-b16d-dc063964e9e2 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:43.563044 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9023774-7223-43b9-8697-5943cf2f8a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:43.563639 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9023774-7223-43b9-8697-5943cf2f8a60 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:43.563929 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9023774-7223-43b9-8697-5943cf2f8a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:43.564207 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9023774-7223-43b9-8697-5943cf2f8a60 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:43.564925 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9023774-7223-43b9-8697-5943cf2f8a60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:43.567021 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9023774-7223-43b9-8697-5943cf2f8a60 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:43.587868 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1390/2766] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:40:43 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:40:43.592075 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4f7fc-f387-4303-bbb4-529518d9b23f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:43.602415 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4f7fc-f387-4303-bbb4-529518d9b23f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:43.607558 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd96d4-6631-4387-9b28-9062edde5d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:43.608213 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd96d4-6631-4387-9b28-9062edde5d75 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:43.608497 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd96d4-6631-4387-9b28-9062edde5d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:43.608774 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd96d4-6631-4387-9b28-9062edde5d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:43.609504 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd96d4-6631-4387-9b28-9062edde5d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:43.611375 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd96d4-6631-4387-9b28-9062edde5d75 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:43.622396 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1377/2767] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:40:43.626663 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9023774-7223-43b9-8697-5943cf2f8a60 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:43.639810 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9023774-7223-43b9-8697-5943cf2f8a60 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:43.644497 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6c658-f886-4de7-b143-e02e435e0a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:43.645198 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6c658-f886-4de7-b143-e02e435e0a15 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:43.645654 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6c658-f886-4de7-b143-e02e435e0a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:43.645928 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6c658-f886-4de7-b143-e02e435e0a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:43.646731 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6c658-f886-4de7-b143-e02e435e0a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:43.649117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6c658-f886-4de7-b143-e02e435e0a15 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:43.661699 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1391/2768] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:40:43.665890 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd96d4-6631-4387-9b28-9062edde5d75 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:43.676731 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd96d4-6631-4387-9b28-9062edde5d75 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:43.681696 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b02ae-bc3e-491a-a041-92c0f3fa23c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:43.682618 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b02ae-bc3e-491a-a041-92c0f3fa23c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:43.682910 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b02ae-bc3e-491a-a041-92c0f3fa23c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:43.683188 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b02ae-bc3e-491a-a041-92c0f3fa23c6 admin admin] PATH_INFO: `/v3/projects/a175ef5249ac4e339a331aab120e4219/users/8e827c1dd19648a6aa4ec1df2a5fb72a/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:43.698595 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b02ae-bc3e-491a-a041-92c0f3fa23c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a175ef5249ac4e339a331aab120e4219, user_id=8e827c1dd19648a6aa4ec1df2a5fb72a, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:43.701394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b02ae-bc3e-491a-a041-92c0f3fa23c6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:43.715847 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1378/2769] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:40:43 2022] PUT /identity/v3/projects/a175ef5249ac4e339a331aab120e4219/users/8e827c1dd19648a6aa4ec1df2a5fb72a/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:40:43.725917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d49c1-675a-43a2-8a5e-d3f054881dd1 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:43.726315 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d49c1-675a-43a2-8a5e-d3f054881dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:43.726635 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d49c1-675a-43a2-8a5e-d3f054881dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:43.753184 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-6e6d49c1-675a-43a2-8a5e-d3f054881dd1 None None] MFA Rules not processed for user `8e827c1dd19648a6aa4ec1df2a5fb72a`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:43.754819 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-6e6d49c1-675a-43a2-8a5e-d3f054881dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:43.782996 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:43.830843 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1392/2770] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:40:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:43.842714 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b02ae-bc3e-491a-a041-92c0f3fa23c6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:43.844564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-440b02ae-bc3e-491a-a041-92c0f3fa23c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:43.904801 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b02ae-bc3e-491a-a041-92c0f3fa23c6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:43.908383 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b7db8-6fe2-4afc-8d2d-4c2aa53fe53e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:43.909029 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b7db8-6fe2-4afc-8d2d-4c2aa53fe53e service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:43.909313 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b7db8-6fe2-4afc-8d2d-4c2aa53fe53e service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:43.909589 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b7db8-6fe2-4afc-8d2d-4c2aa53fe53e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:43.919110 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b7db8-6fe2-4afc-8d2d-4c2aa53fe53e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:43.920578 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b7db8-6fe2-4afc-8d2d-4c2aa53fe53e service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:43.932998 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1379/2771] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:40:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:43.958024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d49c1-675a-43a2-8a5e-d3f054881dd1 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:44.030777 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d49c1-675a-43a2-8a5e-d3f054881dd1 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:44.035230 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3a7bc-0536-4ebe-8623-887daab828b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:44.036291 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3a7bc-0536-4ebe-8623-887daab828b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:44.036583 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3a7bc-0536-4ebe-8623-887daab828b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:44.036886 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3a7bc-0536-4ebe-8623-887daab828b1 admin admin] PATH_INFO: `/v3/users/8e827c1dd19648a6aa4ec1df2a5fb72a` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:44.038098 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3a7bc-0536-4ebe-8623-887daab828b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e827c1dd19648a6aa4ec1df2a5fb72a)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:44.040033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3a7bc-0536-4ebe-8623-887daab828b1 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:44.085347 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0dc3a7bc-0536-4ebe-8623-887daab828b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e827c1dd19648a6aa4ec1df2a5fb72a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:44.092646 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0dc3a7bc-0536-4ebe-8623-887daab828b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e827c1dd19648a6aa4ec1df2a5fb72a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:44.104410 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0dc3a7bc-0536-4ebe-8623-887daab828b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e827c1dd19648a6aa4ec1df2a5fb72a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:44.111078 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0dc3a7bc-0536-4ebe-8623-887daab828b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e827c1dd19648a6aa4ec1df2a5fb72a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:44.111720 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-0dc3a7bc-0536-4ebe-8623-887daab828b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e827c1dd19648a6aa4ec1df2a5fb72a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:44.118785 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1393/2772] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:40:43 2022] DELETE /identity/v3/users/8e827c1dd19648a6aa4ec1df2a5fb72a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:40:44.123601 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e9b55-e77d-4e97-a043-1809ee7d5ab4 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:44.123900 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e9b55-e77d-4e97-a043-1809ee7d5ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:44.124186 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e9b55-e77d-4e97-a043-1809ee7d5ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:44.142058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-902e9b55-e77d-4e97-a043-1809ee7d5ab4 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:44.143370 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-902e9b55-e77d-4e97-a043-1809ee7d5ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:44.202582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1380/2773] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:40:44.212330 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3a7bc-0536-4ebe-8623-887daab828b1 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:44.213706 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-0dc3a7bc-0536-4ebe-8623-887daab828b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:44.259972 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:44.272352 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3a7bc-0536-4ebe-8623-887daab828b1 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:44.276229 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9150d-c34c-4501-b910-5afab3a61d80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:44.276894 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9150d-c34c-4501-b910-5afab3a61d80 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:44.277175 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9150d-c34c-4501-b910-5afab3a61d80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:44.277456 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9150d-c34c-4501-b910-5afab3a61d80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:44.286824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9150d-c34c-4501-b910-5afab3a61d80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:44.288258 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9150d-c34c-4501-b910-5afab3a61d80 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:44.298004 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1394/2774] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:40:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:40:44.554834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e9b55-e77d-4e97-a043-1809ee7d5ab4 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:40:44.556326 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-902e9b55-e77d-4e97-a043-1809ee7d5ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:44.568391 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e9b55-e77d-4e97-a043-1809ee7d5ab4 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:40:44.573032 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c88ea1-7da4-4ad8-ac4b-eb55dc8393bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:40:44.573990 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c88ea1-7da4-4ad8-ac4b-eb55dc8393bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:44.574285 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c88ea1-7da4-4ad8-ac4b-eb55dc8393bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:44.574595 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c88ea1-7da4-4ad8-ac4b-eb55dc8393bc admin admin] PATH_INFO: `/v3/projects/a175ef5249ac4e339a331aab120e4219` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:44.575796 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c88ea1-7da4-4ad8-ac4b-eb55dc8393bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a175ef5249ac4e339a331aab120e4219)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:40:44.577739 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c88ea1-7da4-4ad8-ac4b-eb55dc8393bc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:40:44.603209 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:40:44.627080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-89c88ea1-7da4-4ad8-ac4b-eb55dc8393bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a175ef5249ac4e339a331aab120e4219', 'request_id': 'req-89c88ea1-7da4-4ad8-ac4b-eb55dc8393bc'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:44.633091 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-89c88ea1-7da4-4ad8-ac4b-eb55dc8393bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a175ef5249ac4e339a331aab120e4219', 'request_id': 'req-89c88ea1-7da4-4ad8-ac4b-eb55dc8393bc'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:44.638537 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-89c88ea1-7da4-4ad8-ac4b-eb55dc8393bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a175ef5249ac4e339a331aab120e4219', 'request_id': 'req-89c88ea1-7da4-4ad8-ac4b-eb55dc8393bc'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:44.651395 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-89c88ea1-7da4-4ad8-ac4b-eb55dc8393bc admin admin] The token cache is being invalidate because project a175ef5249ac4e339a331aab120e4219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:40:44.651688 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-89c88ea1-7da4-4ad8-ac4b-eb55dc8393bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:44.652356 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-89c88ea1-7da4-4ad8-ac4b-eb55dc8393bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:40:44.653905 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1381/2775] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:40:44 2022] DELETE /identity/v3/projects/a175ef5249ac4e339a331aab120e4219 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:40:53.169298 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792403a-dc03-4644-aa5a-31a26a842c63 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:40:53.169847 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792403a-dc03-4644-aa5a-31a26a842c63 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:40:53.169847 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792403a-dc03-4644-aa5a-31a26a842c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:40:53.187805 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-6792403a-dc03-4644-aa5a-31a26a842c63 None None] MFA Rules not processed for user `34799c8eae414491bbc27620a81e0b19`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:40:53.189024 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-6792403a-dc03-4644-aa5a-31a26a842c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:40:53.242964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1395/2776] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:40:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:40:54.648395 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=15,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:41:02.841757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1a7d1-643c-4645-8b95-5ffecaf55595 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:02.842361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1a7d1-643c-4645-8b95-5ffecaf55595 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:02.842361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1a7d1-643c-4645-8b95-5ffecaf55595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:02.860088 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b0a1a7d1-643c-4645-8b95-5ffecaf55595 None None] MFA Rules not processed for user `b691b57ca26e4de4a47313a031fce203`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:41:02.861299 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b0a1a7d1-643c-4645-8b95-5ffecaf55595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:02.917531 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1382/2777] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:41:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:41:03.230490 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792403a-dc03-4644-aa5a-31a26a842c63 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:41:03.231928 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-6792403a-dc03-4644-aa5a-31a26a842c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:03.290235 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792403a-dc03-4644-aa5a-31a26a842c63 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:41:03.293824 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf97283-73cc-40a8-8532-bc2610fd7d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:41:03.294635 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf97283-73cc-40a8-8532-bc2610fd7d1a service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:03.294932 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf97283-73cc-40a8-8532-bc2610fd7d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:03.295217 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf97283-73cc-40a8-8532-bc2610fd7d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:03.296989 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ccf97283-73cc-40a8-8532-bc2610fd7d1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:03.307512 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf97283-73cc-40a8-8532-bc2610fd7d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:41:03.308943 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf97283-73cc-40a8-8532-bc2610fd7d1a service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:41:03.317040 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1396/2778] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:41:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:41:07.131325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0ab16-7fe9-4274-a6c1-28f3aaff45a6 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:07.131880 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0ab16-7fe9-4274-a6c1-28f3aaff45a6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:07.132006 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0ab16-7fe9-4274-a6c1-28f3aaff45a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:07.157304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-efe0ab16-7fe9-4274-a6c1-28f3aaff45a6 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:41:07.158565 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-efe0ab16-7fe9-4274-a6c1-28f3aaff45a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:07.218113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1383/2779] 10.222.0.41 () {58 vars in 1016 bytes} [Mon May 23 12:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:41:07.232181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf97283-73cc-40a8-8532-bc2610fd7d1a service neutron] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:41:07.233607 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ccf97283-73cc-40a8-8532-bc2610fd7d1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:07.307101 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf97283-73cc-40a8-8532-bc2610fd7d1a service neutron] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:41:07.312538 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff49fc8-dde7-4a4e-92b3-15fbefb0bc70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:41:07.313180 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff49fc8-dde7-4a4e-92b3-15fbefb0bc70 service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:07.313467 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff49fc8-dde7-4a4e-92b3-15fbefb0bc70 service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:07.313745 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff49fc8-dde7-4a4e-92b3-15fbefb0bc70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:07.321949 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff49fc8-dde7-4a4e-92b3-15fbefb0bc70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:41:07.323691 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff49fc8-dde7-4a4e-92b3-15fbefb0bc70 service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:41:07.333174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1397/2780] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:41:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:41:10.378372 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bed37-82be-4db2-babd-1f110758d7db None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:10.378860 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bed37-82be-4db2-babd-1f110758d7db None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:10.378983 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bed37-82be-4db2-babd-1f110758d7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:10.398317 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0b9bed37-82be-4db2-babd-1f110758d7db None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:41:10.399557 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0b9bed37-82be-4db2-babd-1f110758d7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:10.407423 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1384/2781] 10.222.0.41 () {58 vars in 1016 bytes} [Mon May 23 12:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:41:10.422211 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff49fc8-dde7-4a4e-92b3-15fbefb0bc70 service nova] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:41:10.434057 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff49fc8-dde7-4a4e-92b3-15fbefb0bc70 service nova] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:41:10.439763 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fe646-fc5d-4c70-afb8-355a5f41c32a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:41:10.440400 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fe646-fc5d-4c70-afb8-355a5f41c32a service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:10.440692 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fe646-fc5d-4c70-afb8-355a5f41c32a service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:10.440970 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fe646-fc5d-4c70-afb8-355a5f41c32a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:10.449866 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8fe646-fc5d-4c70-afb8-355a5f41c32a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:41:10.451479 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8fe646-fc5d-4c70-afb8-355a5f41c32a service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:41:10.460843 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1398/2782] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:41:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:41:11.858756 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bed37-82be-4db2-babd-1f110758d7db None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:41:11.860160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0b9bed37-82be-4db2-babd-1f110758d7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:11.928707 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bed37-82be-4db2-babd-1f110758d7db None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:41:11.933782 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236e6c4-b8ee-4a32-ad31-9138b4e01c45 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fde90ab1e0490ebb7cb514173d984e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:41:11.934422 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236e6c4-b8ee-4a32-ad31-9138b4e01c45 service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:11.934739 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236e6c4-b8ee-4a32-ad31-9138b4e01c45 service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:11.935017 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236e6c4-b8ee-4a32-ad31-9138b4e01c45 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:11.936753 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8236e6c4-b8ee-4a32-ad31-9138b4e01c45 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:11.948669 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236e6c4-b8ee-4a32-ad31-9138b4e01c45 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:41:11.950257 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236e6c4-b8ee-4a32-ad31-9138b4e01c45 service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:41:11.960012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1385/2783] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:41:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:41:13.456778 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827caef-da3f-44d9-aa6b-66fbd40e7df0 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:13.457255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827caef-da3f-44d9-aa6b-66fbd40e7df0 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:13.457354 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827caef-da3f-44d9-aa6b-66fbd40e7df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:13.470212 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=100 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:41:13.477078 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-4827caef-da3f-44d9-aa6b-66fbd40e7df0 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:41:13.478284 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-4827caef-da3f-44d9-aa6b-66fbd40e7df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:13.486398 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1399/2784] 10.222.0.41 () {58 vars in 1016 bytes} [Mon May 23 12:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:41:13.500631 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236e6c4-b8ee-4a32-ad31-9138b4e01c45 service placement] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:41:13.514525 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236e6c4-b8ee-4a32-ad31-9138b4e01c45 service placement] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:41:13.520868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ddf60-b732-4861-a160-b68621c5c582 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:41:13.521509 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ddf60-b732-4861-a160-b68621c5c582 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:13.521793 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ddf60-b732-4861-a160-b68621c5c582 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:13.522071 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ddf60-b732-4861-a160-b68621c5c582 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:13.530615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ddf60-b732-4861-a160-b68621c5c582 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:41:13.532194 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ddf60-b732-4861-a160-b68621c5c582 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:41:13.542000 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1386/2785] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:41:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:41:16.621271 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ce7c5-12c7-4b2f-81a1-09eac9052025 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:16.621749 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ce7c5-12c7-4b2f-81a1-09eac9052025 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:16.621849 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ce7c5-12c7-4b2f-81a1-09eac9052025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:16.639769 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-f59ce7c5-12c7-4b2f-81a1-09eac9052025 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:41:16.640964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-f59ce7c5-12c7-4b2f-81a1-09eac9052025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:16.648809 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1400/2786] 10.222.0.41 () {58 vars in 1016 bytes} [Mon May 23 12:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:41:16.671524 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ddf60-b732-4861-a160-b68621c5c582 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:41:16.683462 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ddf60-b732-4861-a160-b68621c5c582 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:41:16.688840 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54128c78-a3af-4c78-8376-d15fd1d30f61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:41:16.689469 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54128c78-a3af-4c78-8376-d15fd1d30f61 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:16.689753 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54128c78-a3af-4c78-8376-d15fd1d30f61 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:16.690030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54128c78-a3af-4c78-8376-d15fd1d30f61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:16.698230 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54128c78-a3af-4c78-8376-d15fd1d30f61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:41:16.699845 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54128c78-a3af-4c78-8376-d15fd1d30f61 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:41:16.709038 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1387/2787] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:41:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:41:19.790292 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216eb50-104d-43f4-9054-6dd4adae55ec None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:19.790832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216eb50-104d-43f4-9054-6dd4adae55ec None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:19.790933 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216eb50-104d-43f4-9054-6dd4adae55ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:19.810212 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-c216eb50-104d-43f4-9054-6dd4adae55ec None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:41:19.811445 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-c216eb50-104d-43f4-9054-6dd4adae55ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:19.819259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1401/2788] 10.222.0.41 () {58 vars in 1016 bytes} [Mon May 23 12:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:41:19.835664 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54128c78-a3af-4c78-8376-d15fd1d30f61 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:41:19.841565 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:41:19.847819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54128c78-a3af-4c78-8376-d15fd1d30f61 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:41:19.854012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed808651-b923-4294-9d96-b2ef6b82cb78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:41:19.854690 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed808651-b923-4294-9d96-b2ef6b82cb78 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:19.854983 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed808651-b923-4294-9d96-b2ef6b82cb78 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:19.855263 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed808651-b923-4294-9d96-b2ef6b82cb78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:19.863480 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed808651-b923-4294-9d96-b2ef6b82cb78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:41:19.865791 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed808651-b923-4294-9d96-b2ef6b82cb78 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:41:19.875322 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1388/2789] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:41:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:41:29.804589 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=6 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:41:29.871008 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=5 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:41:47.451830 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216eb50-104d-43f4-9054-6dd4adae55ec None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:41:47.453755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-c216eb50-104d-43f4-9054-6dd4adae55ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:41:47.467423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216eb50-104d-43f4-9054-6dd4adae55ec None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:41:47.472074 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e049dc7-270c-45f7-8983-c6cd098eaf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:41:47.472948 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e049dc7-270c-45f7-8983-c6cd098eaf1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:47.473237 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e049dc7-270c-45f7-8983-c6cd098eaf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:47.473521 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e049dc7-270c-45f7-8983-c6cd098eaf1b admin admin] PATH_INFO: `/v3/users/34799c8eae414491bbc27620a81e0b19` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:47.474735 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e049dc7-270c-45f7-8983-c6cd098eaf1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=34799c8eae414491bbc27620a81e0b19)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:41:47.477419 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e049dc7-270c-45f7-8983-c6cd098eaf1b admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:41:47.524300 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-6e049dc7-270c-45f7-8983-c6cd098eaf1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34799c8eae414491bbc27620a81e0b19'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:41:47.531424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-6e049dc7-270c-45f7-8983-c6cd098eaf1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34799c8eae414491bbc27620a81e0b19'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:41:47.543581 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-6e049dc7-270c-45f7-8983-c6cd098eaf1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34799c8eae414491bbc27620a81e0b19'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:41:47.550315 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-6e049dc7-270c-45f7-8983-c6cd098eaf1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34799c8eae414491bbc27620a81e0b19'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:41:47.551235 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-6e049dc7-270c-45f7-8983-c6cd098eaf1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34799c8eae414491bbc27620a81e0b19'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:41:47.558319 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1402/2790] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:41:47 2022] DELETE /identity/v3/users/34799c8eae414491bbc27620a81e0b19 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:41:47.742642 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed808651-b923-4294-9d96-b2ef6b82cb78 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:41:47.754280 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed808651-b923-4294-9d96-b2ef6b82cb78 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:41:47.814161 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd38e0-4f39-40b6-a2e7-0ac5f40d6a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:41:47.815229 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd38e0-4f39-40b6-a2e7-0ac5f40d6a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:41:47.815523 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd38e0-4f39-40b6-a2e7-0ac5f40d6a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:41:47.816366 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd38e0-4f39-40b6-a2e7-0ac5f40d6a65 admin admin] PATH_INFO: `/v3/projects/c6773f7f5a384f048dff04572b8b990b` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:41:47.817556 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd38e0-4f39-40b6-a2e7-0ac5f40d6a65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6773f7f5a384f048dff04572b8b990b)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:41:47.819524 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd38e0-4f39-40b6-a2e7-0ac5f40d6a65 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:41:47.865894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dfbd38e0-4f39-40b6-a2e7-0ac5f40d6a65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6773f7f5a384f048dff04572b8b990b', 'request_id': 'req-dfbd38e0-4f39-40b6-a2e7-0ac5f40d6a65'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:41:47.872037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dfbd38e0-4f39-40b6-a2e7-0ac5f40d6a65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6773f7f5a384f048dff04572b8b990b', 'request_id': 'req-dfbd38e0-4f39-40b6-a2e7-0ac5f40d6a65'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:41:47.877448 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dfbd38e0-4f39-40b6-a2e7-0ac5f40d6a65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6773f7f5a384f048dff04572b8b990b', 'request_id': 'req-dfbd38e0-4f39-40b6-a2e7-0ac5f40d6a65'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:41:47.889742 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dfbd38e0-4f39-40b6-a2e7-0ac5f40d6a65 admin admin] The token cache is being invalidate because project c6773f7f5a384f048dff04572b8b990b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:41:47.890029 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dfbd38e0-4f39-40b6-a2e7-0ac5f40d6a65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:41:47.890803 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dfbd38e0-4f39-40b6-a2e7-0ac5f40d6a65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:41:47.892396 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1389/2791] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:41:47 2022] DELETE /identity/v3/projects/c6773f7f5a384f048dff04572b8b990b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:41:57.553634 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:41:57.886819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:07.880486 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e049dc7-270c-45f7-8983-c6cd098eaf1b admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:07.881901 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-6e049dc7-270c-45f7-8983-c6cd098eaf1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:07.940246 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd38e0-4f39-40b6-a2e7-0ac5f40d6a65 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:07.942139 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-dfbd38e0-4f39-40b6-a2e7-0ac5f40d6a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:07.958337 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e049dc7-270c-45f7-8983-c6cd098eaf1b admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:08.011660 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd38e0-4f39-40b6-a2e7-0ac5f40d6a65 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:08.016814 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4efcd-aa5f-4391-84db-e37339cb1fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:08.018243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4efcd-aa5f-4391-84db-e37339cb1fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:08.018553 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4efcd-aa5f-4391-84db-e37339cb1fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:08.018831 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4efcd-aa5f-4391-84db-e37339cb1fd7 admin admin] PATH_INFO: `/v3/users/b691b57ca26e4de4a47313a031fce203` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:08.020028 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4efcd-aa5f-4391-84db-e37339cb1fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b691b57ca26e4de4a47313a031fce203)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:08.021133 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e9777-eacf-47e5-9e45-4356c0df25c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fde90ab1e0490ebb7cb514173d984e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:08.021789 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e9777-eacf-47e5-9e45-4356c0df25c8 service placement] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:08.021992 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4efcd-aa5f-4391-84db-e37339cb1fd7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:08.022127 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e9777-eacf-47e5-9e45-4356c0df25c8 service placement] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:08.022370 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e9777-eacf-47e5-9e45-4356c0df25c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:08.024336 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ac3e9777-eacf-47e5-9e45-4356c0df25c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:08.035638 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e9777-eacf-47e5-9e45-4356c0df25c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:08.037233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e9777-eacf-47e5-9e45-4356c0df25c8 service placement] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:08.047199 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1403/2792] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:42:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:42:08.072561 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2cf4efcd-aa5f-4391-84db-e37339cb1fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b691b57ca26e4de4a47313a031fce203'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:08.080298 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2cf4efcd-aa5f-4391-84db-e37339cb1fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b691b57ca26e4de4a47313a031fce203'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:08.081175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2cf4efcd-aa5f-4391-84db-e37339cb1fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b691b57ca26e4de4a47313a031fce203'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:08.081786 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2cf4efcd-aa5f-4391-84db-e37339cb1fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b691b57ca26e4de4a47313a031fce203'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:08.093908 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2cf4efcd-aa5f-4391-84db-e37339cb1fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b691b57ca26e4de4a47313a031fce203'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:08.106267 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1390/2793] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:42:07 2022] DELETE /identity/v3/users/b691b57ca26e4de4a47313a031fce203 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:08.284106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e9777-eacf-47e5-9e45-4356c0df25c8 service placement] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:08.294976 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e9777-eacf-47e5-9e45-4356c0df25c8 service placement] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:08.354308 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62108887-ba0e-4735-86b8-d1568bad61c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:08.355203 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62108887-ba0e-4735-86b8-d1568bad61c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:08.355494 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62108887-ba0e-4735-86b8-d1568bad61c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:08.355775 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62108887-ba0e-4735-86b8-d1568bad61c7 admin admin] PATH_INFO: `/v3/projects/712178a6d613429a85b8347dcae03916` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:08.357093 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62108887-ba0e-4735-86b8-d1568bad61c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=712178a6d613429a85b8347dcae03916)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:08.359063 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62108887-ba0e-4735-86b8-d1568bad61c7 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:08.394673 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:08.405185 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-62108887-ba0e-4735-86b8-d1568bad61c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '712178a6d613429a85b8347dcae03916', 'request_id': 'req-62108887-ba0e-4735-86b8-d1568bad61c7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:08.411938 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-62108887-ba0e-4735-86b8-d1568bad61c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '712178a6d613429a85b8347dcae03916', 'request_id': 'req-62108887-ba0e-4735-86b8-d1568bad61c7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:08.419179 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-62108887-ba0e-4735-86b8-d1568bad61c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '712178a6d613429a85b8347dcae03916', 'request_id': 'req-62108887-ba0e-4735-86b8-d1568bad61c7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:08.429569 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-62108887-ba0e-4735-86b8-d1568bad61c7 admin admin] The token cache is being invalidate because project 712178a6d613429a85b8347dcae03916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:42:08.429861 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-62108887-ba0e-4735-86b8-d1568bad61c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:08.431104 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-62108887-ba0e-4735-86b8-d1568bad61c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:08.432667 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1404/2794] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:42:08 2022] DELETE /identity/v3/projects/712178a6d613429a85b8347dcae03916 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:08.437741 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a73ef-5db5-4553-8a58-fd2a5ed01c0f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:08.438061 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a73ef-5db5-4553-8a58-fd2a5ed01c0f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:08.438341 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a73ef-5db5-4553-8a58-fd2a5ed01c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:08.456203 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a44a73ef-5db5-4553-8a58-fd2a5ed01c0f None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:08.457410 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a44a73ef-5db5-4553-8a58-fd2a5ed01c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:08.514388 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1391/2795] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:08.523011 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49101940-e613-415d-9919-76434151113b None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:08.523302 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49101940-e613-415d-9919-76434151113b None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:08.523583 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49101940-e613-415d-9919-76434151113b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:08.542124 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-49101940-e613-415d-9919-76434151113b None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:08.543435 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-49101940-e613-415d-9919-76434151113b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:08.552263 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1405/2796] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:08.556790 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a73ef-5db5-4553-8a58-fd2a5ed01c0f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:08.568226 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a73ef-5db5-4553-8a58-fd2a5ed01c0f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:08.572850 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cba1c-9ddf-45cf-871e-7ee0ed52917e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:08.573506 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cba1c-9ddf-45cf-871e-7ee0ed52917e admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:08.573792 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cba1c-9ddf-45cf-871e-7ee0ed52917e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:08.574069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cba1c-9ddf-45cf-871e-7ee0ed52917e admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:08.574828 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594cba1c-9ddf-45cf-871e-7ee0ed52917e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:42:08.575137 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594cba1c-9ddf-45cf-871e-7ee0ed52917e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:08.576802 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594cba1c-9ddf-45cf-871e-7ee0ed52917e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:08.588838 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1392/2797] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:42:08.593282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49101940-e613-415d-9919-76434151113b None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:08.603092 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49101940-e613-415d-9919-76434151113b None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:08.609856 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800df32-6315-4c5d-97b4-f13f01ef20e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:08.610734 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800df32-6315-4c5d-97b4-f13f01ef20e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:08.611215 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800df32-6315-4c5d-97b4-f13f01ef20e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:08.612301 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800df32-6315-4c5d-97b4-f13f01ef20e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:08.613406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b800df32-6315-4c5d-97b4-f13f01ef20e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:08.616051 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b800df32-6315-4c5d-97b4-f13f01ef20e7 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:08.642384 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1406/2798] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:42:08 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:42:08.646836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cba1c-9ddf-45cf-871e-7ee0ed52917e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:08.657685 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cba1c-9ddf-45cf-871e-7ee0ed52917e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:08.661721 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:08.717291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4f6d4-3c15-47d0-a7ab-971fe427fbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:08.717958 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4f6d4-3c15-47d0-a7ab-971fe427fbcd admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:08.718246 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4f6d4-3c15-47d0-a7ab-971fe427fbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:08.718545 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4f6d4-3c15-47d0-a7ab-971fe427fbcd admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:08.719241 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4f6d4-3c15-47d0-a7ab-971fe427fbcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:08.721815 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4f6d4-3c15-47d0-a7ab-971fe427fbcd admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:08.741686 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1393/2799] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:42:08 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:42:08.745818 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800df32-6315-4c5d-97b4-f13f01ef20e7 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:08.756295 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800df32-6315-4c5d-97b4-f13f01ef20e7 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:08.761080 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd8a20-3964-430d-892c-4fbdeacdc602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:08.761739 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd8a20-3964-430d-892c-4fbdeacdc602 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:08.762029 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd8a20-3964-430d-892c-4fbdeacdc602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:08.762335 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd8a20-3964-430d-892c-4fbdeacdc602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:08.763100 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd8a20-3964-430d-892c-4fbdeacdc602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:08.764723 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd8a20-3964-430d-892c-4fbdeacdc602 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:08.775504 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1407/2800] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:42:08.779382 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4f6d4-3c15-47d0-a7ab-971fe427fbcd admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:08.790104 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4f6d4-3c15-47d0-a7ab-971fe427fbcd admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:08.794896 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03680de2-4768-47dd-a94f-bf65d010a9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:08.795551 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03680de2-4768-47dd-a94f-bf65d010a9aa admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:08.795842 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03680de2-4768-47dd-a94f-bf65d010a9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:08.796124 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03680de2-4768-47dd-a94f-bf65d010a9aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:08.796858 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03680de2-4768-47dd-a94f-bf65d010a9aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:08.798477 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03680de2-4768-47dd-a94f-bf65d010a9aa admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:08.809401 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1394/2801] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:42:08.813874 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd8a20-3964-430d-892c-4fbdeacdc602 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:08.825606 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd8a20-3964-430d-892c-4fbdeacdc602 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:08.831316 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f927ca6-e720-4b5c-b65f-e87566b421a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:08.832195 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f927ca6-e720-4b5c-b65f-e87566b421a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:08.832483 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f927ca6-e720-4b5c-b65f-e87566b421a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:08.832892 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f927ca6-e720-4b5c-b65f-e87566b421a6 admin admin] PATH_INFO: `/v3/projects/163dbf4d5919475cb3fbe452e3d098aa/users/b64cf4098991468e9c49c5293b0719a8/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:08.847995 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f927ca6-e720-4b5c-b65f-e87566b421a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=163dbf4d5919475cb3fbe452e3d098aa, user_id=b64cf4098991468e9c49c5293b0719a8, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:08.850688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f927ca6-e720-4b5c-b65f-e87566b421a6 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:08.863627 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1408/2802] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:42:08 2022] PUT /identity/v3/projects/163dbf4d5919475cb3fbe452e3d098aa/users/b64cf4098991468e9c49c5293b0719a8/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:08.874048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f792d2c-f050-48a4-8a46-e74c926bb1ed None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:08.874360 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f792d2c-f050-48a4-8a46-e74c926bb1ed None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:08.874674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f792d2c-f050-48a4-8a46-e74c926bb1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:08.901935 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2f792d2c-f050-48a4-8a46-e74c926bb1ed None None] MFA Rules not processed for user `b64cf4098991468e9c49c5293b0719a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:08.903209 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2f792d2c-f050-48a4-8a46-e74c926bb1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:08.967698 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1395/2803] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:08.979723 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f927ca6-e720-4b5c-b65f-e87566b421a6 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:08.981376 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-6f927ca6-e720-4b5c-b65f-e87566b421a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:09.054099 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f927ca6-e720-4b5c-b65f-e87566b421a6 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:09.059722 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaf7dd-54b2-4031-81c4-3d821dfc1e0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd49997b9108145b78eb4db1d8823bf4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:09.060362 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaf7dd-54b2-4031-81c4-3d821dfc1e0a service nova] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:09.060653 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaf7dd-54b2-4031-81c4-3d821dfc1e0a service nova] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:09.060935 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaf7dd-54b2-4031-81c4-3d821dfc1e0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:09.069170 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaaf7dd-54b2-4031-81c4-3d821dfc1e0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:09.070792 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaaf7dd-54b2-4031-81c4-3d821dfc1e0a service nova] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:09.079527 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1409/2804] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:42:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:42:09.287869 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f792d2c-f050-48a4-8a46-e74c926bb1ed None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:09.349741 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f792d2c-f050-48a4-8a46-e74c926bb1ed None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:09.354250 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b894219-85fd-4983-aed8-47a90adb4592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:09.355141 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b894219-85fd-4983-aed8-47a90adb4592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:09.355432 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b894219-85fd-4983-aed8-47a90adb4592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:09.355710 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b894219-85fd-4983-aed8-47a90adb4592 admin admin] PATH_INFO: `/v3/users/b64cf4098991468e9c49c5293b0719a8` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:09.356997 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b894219-85fd-4983-aed8-47a90adb4592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b64cf4098991468e9c49c5293b0719a8)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:09.358975 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b894219-85fd-4983-aed8-47a90adb4592 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:09.375268 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:09.409294 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4b894219-85fd-4983-aed8-47a90adb4592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b64cf4098991468e9c49c5293b0719a8'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:09.417084 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4b894219-85fd-4983-aed8-47a90adb4592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b64cf4098991468e9c49c5293b0719a8'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:09.417708 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4b894219-85fd-4983-aed8-47a90adb4592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b64cf4098991468e9c49c5293b0719a8'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:09.418325 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4b894219-85fd-4983-aed8-47a90adb4592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b64cf4098991468e9c49c5293b0719a8'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:09.430528 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4b894219-85fd-4983-aed8-47a90adb4592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b64cf4098991468e9c49c5293b0719a8'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:09.442978 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1396/2805] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:42:09 2022] DELETE /identity/v3/users/b64cf4098991468e9c49c5293b0719a8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:09.447490 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abef32-1f7f-49a8-b3dc-4737896715a7 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:09.447791 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abef32-1f7f-49a8-b3dc-4737896715a7 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:09.448103 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abef32-1f7f-49a8-b3dc-4737896715a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:09.465468 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-87abef32-1f7f-49a8-b3dc-4737896715a7 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:09.466748 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-87abef32-1f7f-49a8-b3dc-4737896715a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:09.506458 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:09.527240 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1410/2806] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:09.537414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b894219-85fd-4983-aed8-47a90adb4592 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:09.538904 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4b894219-85fd-4983-aed8-47a90adb4592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:09.595245 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b894219-85fd-4983-aed8-47a90adb4592 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:09.599509 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9dd22-1917-4a5f-9b26-fbfb1051c35e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:09.600146 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9dd22-1917-4a5f-9b26-fbfb1051c35e service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:09.600434 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9dd22-1917-4a5f-9b26-fbfb1051c35e service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:09.600714 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9dd22-1917-4a5f-9b26-fbfb1051c35e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:09.609644 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9dd22-1917-4a5f-9b26-fbfb1051c35e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:09.611143 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9dd22-1917-4a5f-9b26-fbfb1051c35e service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:09.620656 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1397/2807] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:42:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:42:09.882428 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abef32-1f7f-49a8-b3dc-4737896715a7 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:09.883958 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-87abef32-1f7f-49a8-b3dc-4737896715a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:09.897120 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abef32-1f7f-49a8-b3dc-4737896715a7 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:09.901706 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb19a8f-7f97-4733-81a9-94d1376caf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:09.902598 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb19a8f-7f97-4733-81a9-94d1376caf4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:09.902893 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb19a8f-7f97-4733-81a9-94d1376caf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:09.903174 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb19a8f-7f97-4733-81a9-94d1376caf4d admin admin] PATH_INFO: `/v3/projects/163dbf4d5919475cb3fbe452e3d098aa` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:09.904371 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb19a8f-7f97-4733-81a9-94d1376caf4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=163dbf4d5919475cb3fbe452e3d098aa)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:09.906284 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb19a8f-7f97-4733-81a9-94d1376caf4d admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:09.953515 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ebb19a8f-7f97-4733-81a9-94d1376caf4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '163dbf4d5919475cb3fbe452e3d098aa', 'request_id': 'req-ebb19a8f-7f97-4733-81a9-94d1376caf4d'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:09.959717 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ebb19a8f-7f97-4733-81a9-94d1376caf4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '163dbf4d5919475cb3fbe452e3d098aa', 'request_id': 'req-ebb19a8f-7f97-4733-81a9-94d1376caf4d'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:09.966881 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ebb19a8f-7f97-4733-81a9-94d1376caf4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '163dbf4d5919475cb3fbe452e3d098aa', 'request_id': 'req-ebb19a8f-7f97-4733-81a9-94d1376caf4d'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:09.977564 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ebb19a8f-7f97-4733-81a9-94d1376caf4d admin admin] The token cache is being invalidate because project 163dbf4d5919475cb3fbe452e3d098aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:42:09.977857 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ebb19a8f-7f97-4733-81a9-94d1376caf4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:09.978478 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-ebb19a8f-7f97-4733-81a9-94d1376caf4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:09.980046 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1411/2808] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:42:09 2022] DELETE /identity/v3/projects/163dbf4d5919475cb3fbe452e3d098aa => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:09.984994 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a5aa7-0c3d-4b91-a67d-cd9a7daceda9 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:09.985410 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a5aa7-0c3d-4b91-a67d-cd9a7daceda9 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:09.985564 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a5aa7-0c3d-4b91-a67d-cd9a7daceda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:10.003326 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2a0a5aa7-0c3d-4b91-a67d-cd9a7daceda9 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:10.005562 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2a0a5aa7-0c3d-4b91-a67d-cd9a7daceda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:10.063545 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1398/2809] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:10.071562 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570acc00-4c6a-4642-9446-6fbc1319eb26 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:10.071861 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570acc00-4c6a-4642-9446-6fbc1319eb26 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:10.072144 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570acc00-4c6a-4642-9446-6fbc1319eb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:10.090640 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-570acc00-4c6a-4642-9446-6fbc1319eb26 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:10.091832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-570acc00-4c6a-4642-9446-6fbc1319eb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:10.099664 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1412/2810] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:10.103605 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a5aa7-0c3d-4b91-a67d-cd9a7daceda9 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:10.113571 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a5aa7-0c3d-4b91-a67d-cd9a7daceda9 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:10.118219 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7707c-9872-4e2d-af7c-db50838f05c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:10.118907 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7707c-9872-4e2d-af7c-db50838f05c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:10.119195 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7707c-9872-4e2d-af7c-db50838f05c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:10.119476 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7707c-9872-4e2d-af7c-db50838f05c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:10.120206 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7707c-9872-4e2d-af7c-db50838f05c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:42:10.120519 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7707c-9872-4e2d-af7c-db50838f05c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:10.122135 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7707c-9872-4e2d-af7c-db50838f05c2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:10.133908 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1399/2811] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:42:10.138199 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570acc00-4c6a-4642-9446-6fbc1319eb26 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:10.147784 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570acc00-4c6a-4642-9446-6fbc1319eb26 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:10.152351 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b109efa-0eb8-48de-94f0-6a786e47d0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:10.152994 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b109efa-0eb8-48de-94f0-6a786e47d0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:10.153284 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b109efa-0eb8-48de-94f0-6a786e47d0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:10.153566 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b109efa-0eb8-48de-94f0-6a786e47d0a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:10.154256 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b109efa-0eb8-48de-94f0-6a786e47d0a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:10.156200 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b109efa-0eb8-48de-94f0-6a786e47d0a6 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:10.185315 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1413/2812] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:42:10 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:42:10.186765 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7707c-9872-4e2d-af7c-db50838f05c2 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:10.197544 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7707c-9872-4e2d-af7c-db50838f05c2 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:10.217563 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:10.255645 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10979e-b087-45f3-ae4f-585f070923d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:10.256303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10979e-b087-45f3-ae4f-585f070923d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:10.256594 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10979e-b087-45f3-ae4f-585f070923d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:10.256874 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10979e-b087-45f3-ae4f-585f070923d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:10.257572 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10979e-b087-45f3-ae4f-585f070923d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:10.259551 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10979e-b087-45f3-ae4f-585f070923d4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:10.280358 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1400/2813] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:42:10 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 12:42:10.284399 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b109efa-0eb8-48de-94f0-6a786e47d0a6 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:10.294526 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b109efa-0eb8-48de-94f0-6a786e47d0a6 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:10.299799 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bab73-d366-43e1-acb4-23c178b2e958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:10.300448 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bab73-d366-43e1-acb4-23c178b2e958 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:10.300735 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bab73-d366-43e1-acb4-23c178b2e958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:10.301033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bab73-d366-43e1-acb4-23c178b2e958 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:10.301735 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bab73-d366-43e1-acb4-23c178b2e958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:10.303374 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bab73-d366-43e1-acb4-23c178b2e958 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:10.313498 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1414/2814] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:42:10.318001 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10979e-b087-45f3-ae4f-585f070923d4 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:10.327906 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10979e-b087-45f3-ae4f-585f070923d4 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:10.332621 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429be07f-ead6-4e9a-ab97-d24afc070b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:10.333390 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429be07f-ead6-4e9a-ab97-d24afc070b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:10.333674 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429be07f-ead6-4e9a-ab97-d24afc070b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:10.333972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429be07f-ead6-4e9a-ab97-d24afc070b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:10.334715 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429be07f-ead6-4e9a-ab97-d24afc070b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:10.336369 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429be07f-ead6-4e9a-ab97-d24afc070b6e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:10.346783 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1401/2815] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:42:10.351008 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bab73-d366-43e1-acb4-23c178b2e958 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:10.360907 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bab73-d366-43e1-acb4-23c178b2e958 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:10.365971 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cf961-2a86-40f6-b6d1-79c85ba70d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:10.366863 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cf961-2a86-40f6-b6d1-79c85ba70d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:10.367146 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cf961-2a86-40f6-b6d1-79c85ba70d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:10.367424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cf961-2a86-40f6-b6d1-79c85ba70d0e admin admin] PATH_INFO: `/v3/projects/63c534011422418fb3b856a2c651ef71/users/9931068b54954e3b8d2ce25e99b5d762/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:10.382574 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cf961-2a86-40f6-b6d1-79c85ba70d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=63c534011422418fb3b856a2c651ef71, user_id=9931068b54954e3b8d2ce25e99b5d762, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:10.385220 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cf961-2a86-40f6-b6d1-79c85ba70d0e admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:10.397567 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1415/2816] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:42:10 2022] PUT /identity/v3/projects/63c534011422418fb3b856a2c651ef71/users/9931068b54954e3b8d2ce25e99b5d762/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:10.408799 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65731d-9f4f-41d9-9caf-695252903fcc None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:10.409098 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65731d-9f4f-41d9-9caf-695252903fcc None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:10.409379 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65731d-9f4f-41d9-9caf-695252903fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:10.436369 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ab65731d-9f4f-41d9-9caf-695252903fcc None None] MFA Rules not processed for user `9931068b54954e3b8d2ce25e99b5d762`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:10.437796 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ab65731d-9f4f-41d9-9caf-695252903fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:10.500897 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1402/2817] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:10.505894 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cf961-2a86-40f6-b6d1-79c85ba70d0e admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:10.566604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cf961-2a86-40f6-b6d1-79c85ba70d0e admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:10.571282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec67a36-cc46-424c-8d5b-1355a0b56664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:10.571875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec67a36-cc46-424c-8d5b-1355a0b56664 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:10.572166 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec67a36-cc46-424c-8d5b-1355a0b56664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:10.572447 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec67a36-cc46-424c-8d5b-1355a0b56664 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:10.573126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec67a36-cc46-424c-8d5b-1355a0b56664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:10.575070 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec67a36-cc46-424c-8d5b-1355a0b56664 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:10.582959 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:10.601833 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1416/2818] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:42:10 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:42:10.605810 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65731d-9f4f-41d9-9caf-695252903fcc None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:10.616772 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65731d-9f4f-41d9-9caf-695252903fcc None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:10.673747 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb37f1-ace4-4712-b678-3cc3ee4b25e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:10.675266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb37f1-ace4-4712-b678-3cc3ee4b25e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:10.675553 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb37f1-ace4-4712-b678-3cc3ee4b25e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:10.675831 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb37f1-ace4-4712-b678-3cc3ee4b25e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:10.676524 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb37f1-ace4-4712-b678-3cc3ee4b25e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:10.678467 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb37f1-ace4-4712-b678-3cc3ee4b25e8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:10.697706 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1403/2819] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:42:10 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:42:10.701598 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec67a36-cc46-424c-8d5b-1355a0b56664 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:10.711609 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec67a36-cc46-424c-8d5b-1355a0b56664 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:10.716093 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc27d1d-f944-401b-8cc7-45aa8ec8bd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:10.716733 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc27d1d-f944-401b-8cc7-45aa8ec8bd59 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:10.717022 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc27d1d-f944-401b-8cc7-45aa8ec8bd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:10.717299 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc27d1d-f944-401b-8cc7-45aa8ec8bd59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:10.718007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc27d1d-f944-401b-8cc7-45aa8ec8bd59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:10.719631 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc27d1d-f944-401b-8cc7-45aa8ec8bd59 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:10.730403 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1417/2820] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:42:10.734266 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb37f1-ace4-4712-b678-3cc3ee4b25e8 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:10.744950 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb37f1-ace4-4712-b678-3cc3ee4b25e8 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:10.749620 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096f4db-8451-4483-a05b-62f7762a1f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:10.750531 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096f4db-8451-4483-a05b-62f7762a1f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:10.750951 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096f4db-8451-4483-a05b-62f7762a1f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:10.751236 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096f4db-8451-4483-a05b-62f7762a1f76 admin admin] PATH_INFO: `/v3/projects/b0eed820adf84b0e837cea631ca71904/users/4c678e7cde3247fbab59476d58d17001/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:10.765988 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096f4db-8451-4483-a05b-62f7762a1f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0eed820adf84b0e837cea631ca71904, user_id=4c678e7cde3247fbab59476d58d17001, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:10.768682 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096f4db-8451-4483-a05b-62f7762a1f76 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:10.776382 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:10.782303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1404/2821] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:42:10 2022] PUT /identity/v3/projects/b0eed820adf84b0e837cea631ca71904/users/4c678e7cde3247fbab59476d58d17001/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:42:10.786691 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc27d1d-f944-401b-8cc7-45aa8ec8bd59 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:10.796527 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc27d1d-f944-401b-8cc7-45aa8ec8bd59 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:10.857050 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c850056-13f7-468e-94c7-1fb83ccf0c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:10.857748 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c850056-13f7-468e-94c7-1fb83ccf0c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:10.858038 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c850056-13f7-468e-94c7-1fb83ccf0c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:10.858351 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c850056-13f7-468e-94c7-1fb83ccf0c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:10.859146 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c850056-13f7-468e-94c7-1fb83ccf0c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:10.860743 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c850056-13f7-468e-94c7-1fb83ccf0c51 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:10.871022 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1418/2822] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:42:10.875121 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096f4db-8451-4483-a05b-62f7762a1f76 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:10.885125 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096f4db-8451-4483-a05b-62f7762a1f76 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:10.889694 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f4ed8-cd48-41cd-9ae6-b403a080fba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:10.890598 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f4ed8-cd48-41cd-9ae6-b403a080fba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:10.890884 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f4ed8-cd48-41cd-9ae6-b403a080fba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:10.891162 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f4ed8-cd48-41cd-9ae6-b403a080fba5 admin admin] PATH_INFO: `/v3/projects/b0eed820adf84b0e837cea631ca71904/users/4c678e7cde3247fbab59476d58d17001/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:10.893638 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f4ed8-cd48-41cd-9ae6-b403a080fba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0eed820adf84b0e837cea631ca71904, user_id=4c678e7cde3247fbab59476d58d17001, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:10.896283 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f4ed8-cd48-41cd-9ae6-b403a080fba5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:10.906224 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1405/2823] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:42:10 2022] PUT /identity/v3/projects/b0eed820adf84b0e837cea631ca71904/users/4c678e7cde3247fbab59476d58d17001/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:10.916570 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e1c57-1084-44b0-b3f6-b08368059cac None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:10.916863 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e1c57-1084-44b0-b3f6-b08368059cac None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:10.917144 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e1c57-1084-44b0-b3f6-b08368059cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:10.943181 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-819e1c57-1084-44b0-b3f6-b08368059cac None None] MFA Rules not processed for user `4c678e7cde3247fbab59476d58d17001`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:10.944480 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-819e1c57-1084-44b0-b3f6-b08368059cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:11.011441 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1419/2824] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:11.023153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f4ed8-cd48-41cd-9ae6-b403a080fba5 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:11.024874 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-aa6f4ed8-cd48-41cd-9ae6-b403a080fba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:11.081140 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f4ed8-cd48-41cd-9ae6-b403a080fba5 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:11.084817 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23ecd4-2d08-4e93-952e-79cab616d503 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:11.085460 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23ecd4-2d08-4e93-952e-79cab616d503 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:11.085747 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23ecd4-2d08-4e93-952e-79cab616d503 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:11.086025 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23ecd4-2d08-4e93-952e-79cab616d503 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:11.094983 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23ecd4-2d08-4e93-952e-79cab616d503 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:11.097021 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23ecd4-2d08-4e93-952e-79cab616d503 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:11.106297 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1406/2825] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:42:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:42:11.178360 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e1c57-1084-44b0-b3f6-b08368059cac None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:11.188714 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e1c57-1084-44b0-b3f6-b08368059cac None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:11.191908 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f8ce3-2226-4e1d-86e1-41688ee92666 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:11.192547 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f8ce3-2226-4e1d-86e1-41688ee92666 service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:11.192856 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f8ce3-2226-4e1d-86e1-41688ee92666 service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:11.193114 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f8ce3-2226-4e1d-86e1-41688ee92666 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:11.255274 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f8ce3-2226-4e1d-86e1-41688ee92666 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:11.256783 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f8ce3-2226-4e1d-86e1-41688ee92666 service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:11.260624 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:11.268334 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1420/2826] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:42:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:42:17.277733 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23ecd4-2d08-4e93-952e-79cab616d503 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:17.340126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23ecd4-2d08-4e93-952e-79cab616d503 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:17.344749 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d6a19-6b0e-47ed-abdd-5e6b9325b639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:17.346129 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d6a19-6b0e-47ed-abdd-5e6b9325b639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:17.346417 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d6a19-6b0e-47ed-abdd-5e6b9325b639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:17.346725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d6a19-6b0e-47ed-abdd-5e6b9325b639 admin admin] PATH_INFO: `/v3/users/9931068b54954e3b8d2ce25e99b5d762` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:17.347916 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d6a19-6b0e-47ed-abdd-5e6b9325b639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9931068b54954e3b8d2ce25e99b5d762)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:17.349854 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d6a19-6b0e-47ed-abdd-5e6b9325b639 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:17.395739 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4b5d6a19-6b0e-47ed-abdd-5e6b9325b639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9931068b54954e3b8d2ce25e99b5d762'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:17.402927 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4b5d6a19-6b0e-47ed-abdd-5e6b9325b639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9931068b54954e3b8d2ce25e99b5d762'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:17.403550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4b5d6a19-6b0e-47ed-abdd-5e6b9325b639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9931068b54954e3b8d2ce25e99b5d762'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:17.404160 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4b5d6a19-6b0e-47ed-abdd-5e6b9325b639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9931068b54954e3b8d2ce25e99b5d762'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:17.416661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4b5d6a19-6b0e-47ed-abdd-5e6b9325b639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9931068b54954e3b8d2ce25e99b5d762'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:17.429071 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1407/2827] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:42:17 2022] DELETE /identity/v3/users/9931068b54954e3b8d2ce25e99b5d762 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:17.433488 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326ed5b-b2a9-41df-8f53-1650a5630858 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:17.433964 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326ed5b-b2a9-41df-8f53-1650a5630858 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:17.434064 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326ed5b-b2a9-41df-8f53-1650a5630858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:17.451326 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-a326ed5b-b2a9-41df-8f53-1650a5630858 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:17.452525 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-a326ed5b-b2a9-41df-8f53-1650a5630858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:17.516126 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1421/2828] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:17.525757 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d6a19-6b0e-47ed-abdd-5e6b9325b639 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:17.527193 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4b5d6a19-6b0e-47ed-abdd-5e6b9325b639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:17.537494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:17.586320 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d6a19-6b0e-47ed-abdd-5e6b9325b639 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:17.589886 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c87ecd-200a-4f7a-9232-4d4e01fd801a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:17.590549 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c87ecd-200a-4f7a-9232-4d4e01fd801a service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:17.590836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c87ecd-200a-4f7a-9232-4d4e01fd801a service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:17.591113 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c87ecd-200a-4f7a-9232-4d4e01fd801a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:17.600421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c87ecd-200a-4f7a-9232-4d4e01fd801a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:17.601860 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c87ecd-200a-4f7a-9232-4d4e01fd801a service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:17.611593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1408/2829] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:42:17.871629 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326ed5b-b2a9-41df-8f53-1650a5630858 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:17.873160 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-a326ed5b-b2a9-41df-8f53-1650a5630858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:17.885400 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326ed5b-b2a9-41df-8f53-1650a5630858 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:17.890082 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b6592-29ff-4295-b91a-ad43d2fa10a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:17.891062 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b6592-29ff-4295-b91a-ad43d2fa10a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:17.891348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b6592-29ff-4295-b91a-ad43d2fa10a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:17.891627 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b6592-29ff-4295-b91a-ad43d2fa10a8 admin admin] PATH_INFO: `/v3/projects/63c534011422418fb3b856a2c651ef71` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:17.893373 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b6592-29ff-4295-b91a-ad43d2fa10a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63c534011422418fb3b856a2c651ef71)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:17.896303 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b6592-29ff-4295-b91a-ad43d2fa10a8 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:17.943326 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-747b6592-29ff-4295-b91a-ad43d2fa10a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63c534011422418fb3b856a2c651ef71', 'request_id': 'req-747b6592-29ff-4295-b91a-ad43d2fa10a8'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:17.949978 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-747b6592-29ff-4295-b91a-ad43d2fa10a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63c534011422418fb3b856a2c651ef71', 'request_id': 'req-747b6592-29ff-4295-b91a-ad43d2fa10a8'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:17.958267 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-747b6592-29ff-4295-b91a-ad43d2fa10a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63c534011422418fb3b856a2c651ef71', 'request_id': 'req-747b6592-29ff-4295-b91a-ad43d2fa10a8'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:17.968590 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-747b6592-29ff-4295-b91a-ad43d2fa10a8 admin admin] The token cache is being invalidate because project 63c534011422418fb3b856a2c651ef71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:42:17.968875 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-747b6592-29ff-4295-b91a-ad43d2fa10a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:17.969491 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-747b6592-29ff-4295-b91a-ad43d2fa10a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:17.971859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1422/2830] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:42:17 2022] DELETE /identity/v3/projects/63c534011422418fb3b856a2c651ef71 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:17.975839 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c87ecd-200a-4f7a-9232-4d4e01fd801a service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:17.985899 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c87ecd-200a-4f7a-9232-4d4e01fd801a service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:18.042496 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d759ec-9e1f-4391-b5c0-79cb79a397bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:18.043397 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d759ec-9e1f-4391-b5c0-79cb79a397bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:18.043687 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d759ec-9e1f-4391-b5c0-79cb79a397bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:18.043967 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d759ec-9e1f-4391-b5c0-79cb79a397bc admin admin] PATH_INFO: `/v3/users/4c678e7cde3247fbab59476d58d17001` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:18.045153 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d759ec-9e1f-4391-b5c0-79cb79a397bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c678e7cde3247fbab59476d58d17001)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:18.047128 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d759ec-9e1f-4391-b5c0-79cb79a397bc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:18.093954 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e4d759ec-9e1f-4391-b5c0-79cb79a397bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c678e7cde3247fbab59476d58d17001'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:18.100992 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e4d759ec-9e1f-4391-b5c0-79cb79a397bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c678e7cde3247fbab59476d58d17001'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:18.101725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e4d759ec-9e1f-4391-b5c0-79cb79a397bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c678e7cde3247fbab59476d58d17001'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:18.102337 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e4d759ec-9e1f-4391-b5c0-79cb79a397bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c678e7cde3247fbab59476d58d17001'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:18.114097 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e4d759ec-9e1f-4391-b5c0-79cb79a397bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c678e7cde3247fbab59476d58d17001'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:18.126196 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1409/2831] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:42:17 2022] DELETE /identity/v3/users/4c678e7cde3247fbab59476d58d17001 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:18.399233 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b6592-29ff-4295-b91a-ad43d2fa10a8 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:18.400788 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-747b6592-29ff-4295-b91a-ad43d2fa10a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:18.416140 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b6592-29ff-4295-b91a-ad43d2fa10a8 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:18.474361 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9225f3d-ed88-4fb6-87b0-f9242119050a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:18.475178 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9225f3d-ed88-4fb6-87b0-f9242119050a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:18.475461 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9225f3d-ed88-4fb6-87b0-f9242119050a admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:18.475735 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9225f3d-ed88-4fb6-87b0-f9242119050a admin admin] PATH_INFO: `/v3/projects/b0eed820adf84b0e837cea631ca71904` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:18.476906 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9225f3d-ed88-4fb6-87b0-f9242119050a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0eed820adf84b0e837cea631ca71904)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:18.478864 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9225f3d-ed88-4fb6-87b0-f9242119050a admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:18.502103 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:18.525147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d9225f3d-ed88-4fb6-87b0-f9242119050a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0eed820adf84b0e837cea631ca71904', 'request_id': 'req-d9225f3d-ed88-4fb6-87b0-f9242119050a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:18.531170 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d9225f3d-ed88-4fb6-87b0-f9242119050a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0eed820adf84b0e837cea631ca71904', 'request_id': 'req-d9225f3d-ed88-4fb6-87b0-f9242119050a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:18.538585 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d9225f3d-ed88-4fb6-87b0-f9242119050a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0eed820adf84b0e837cea631ca71904', 'request_id': 'req-d9225f3d-ed88-4fb6-87b0-f9242119050a'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:18.549048 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d9225f3d-ed88-4fb6-87b0-f9242119050a admin admin] The token cache is being invalidate because project b0eed820adf84b0e837cea631ca71904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:42:18.549592 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d9225f3d-ed88-4fb6-87b0-f9242119050a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:18.550227 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-d9225f3d-ed88-4fb6-87b0-f9242119050a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:18.551794 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1423/2832] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:42:18 2022] DELETE /identity/v3/projects/b0eed820adf84b0e837cea631ca71904 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:18.556668 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23272bf2-d459-4a21-8637-590bc0a8bf82 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:18.557156 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23272bf2-d459-4a21-8637-590bc0a8bf82 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:18.557347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23272bf2-d459-4a21-8637-590bc0a8bf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:18.576189 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-23272bf2-d459-4a21-8637-590bc0a8bf82 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:18.577411 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-23272bf2-d459-4a21-8637-590bc0a8bf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:18.601673 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:18.639187 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1410/2833] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:18.648637 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312f7fc-f5e1-436a-90a3-8659d8c174cf None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:18.648928 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312f7fc-f5e1-436a-90a3-8659d8c174cf None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:18.649278 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312f7fc-f5e1-436a-90a3-8659d8c174cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:18.667450 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-3312f7fc-f5e1-436a-90a3-8659d8c174cf None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:18.668658 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-3312f7fc-f5e1-436a-90a3-8659d8c174cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:18.677602 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1424/2834] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:18.681963 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23272bf2-d459-4a21-8637-590bc0a8bf82 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:18.691865 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23272bf2-d459-4a21-8637-590bc0a8bf82 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:18.696474 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adab4f5-2783-4325-bdfa-53b4cea077c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:18.697173 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adab4f5-2783-4325-bdfa-53b4cea077c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:18.697615 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adab4f5-2783-4325-bdfa-53b4cea077c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:18.698055 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adab4f5-2783-4325-bdfa-53b4cea077c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:18.698838 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adab4f5-2783-4325-bdfa-53b4cea077c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:42:18.699156 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adab4f5-2783-4325-bdfa-53b4cea077c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:18.700850 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adab4f5-2783-4325-bdfa-53b4cea077c7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:18.716909 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1411/2835] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:42:18.722069 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312f7fc-f5e1-436a-90a3-8659d8c174cf None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:18.732076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312f7fc-f5e1-436a-90a3-8659d8c174cf None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:18.744211 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f004c-1f51-4a7e-a68e-f195f5ab702c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:18.744910 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f004c-1f51-4a7e-a68e-f195f5ab702c admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:18.745334 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f004c-1f51-4a7e-a68e-f195f5ab702c admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:18.745627 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f004c-1f51-4a7e-a68e-f195f5ab702c admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:18.746310 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f004c-1f51-4a7e-a68e-f195f5ab702c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:18.748270 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f004c-1f51-4a7e-a68e-f195f5ab702c admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:18.776145 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1425/2836] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:42:18 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:42:18.780244 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adab4f5-2783-4325-bdfa-53b4cea077c7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:18.790012 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adab4f5-2783-4325-bdfa-53b4cea077c7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:18.846080 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b445549-bb11-4f96-ba57-1b0df3c59835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:18.846782 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b445549-bb11-4f96-ba57-1b0df3c59835 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:18.847071 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b445549-bb11-4f96-ba57-1b0df3c59835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:18.847354 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b445549-bb11-4f96-ba57-1b0df3c59835 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:18.848040 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b445549-bb11-4f96-ba57-1b0df3c59835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:18.849967 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b445549-bb11-4f96-ba57-1b0df3c59835 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:18.872092 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1412/2837] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:42:18 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:42:18.873238 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f004c-1f51-4a7e-a68e-f195f5ab702c admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:18.883822 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f004c-1f51-4a7e-a68e-f195f5ab702c admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:18.888332 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f191e53-2a4e-448e-b640-f8da960666ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:18.888979 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f191e53-2a4e-448e-b640-f8da960666ee admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:18.889266 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f191e53-2a4e-448e-b640-f8da960666ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:18.889541 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f191e53-2a4e-448e-b640-f8da960666ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:18.890255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f191e53-2a4e-448e-b640-f8da960666ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:18.891939 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f191e53-2a4e-448e-b640-f8da960666ee admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:18.902617 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1426/2838] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:42:18.906423 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b445549-bb11-4f96-ba57-1b0df3c59835 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:18.916238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b445549-bb11-4f96-ba57-1b0df3c59835 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:18.920764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87eec3-a389-4557-86f3-a3473e27c5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:18.921411 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87eec3-a389-4557-86f3-a3473e27c5fe admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:18.921693 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87eec3-a389-4557-86f3-a3473e27c5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:18.921971 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87eec3-a389-4557-86f3-a3473e27c5fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:18.922723 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87eec3-a389-4557-86f3-a3473e27c5fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:18.924598 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87eec3-a389-4557-86f3-a3473e27c5fe admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:18.934418 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1413/2839] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:42:18.938155 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f191e53-2a4e-448e-b640-f8da960666ee admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:18.948728 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f191e53-2a4e-448e-b640-f8da960666ee admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:18.953363 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee9d1d-d9b4-4099-8612-cd1d62238396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:18.954231 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee9d1d-d9b4-4099-8612-cd1d62238396 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:18.954618 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee9d1d-d9b4-4099-8612-cd1d62238396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:18.954913 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee9d1d-d9b4-4099-8612-cd1d62238396 admin admin] PATH_INFO: `/v3/projects/e0e73b90748d4b8cb1122bccdb386165/users/b39b2b32ffcb478899d533c4863ddfd7/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:18.969486 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee9d1d-d9b4-4099-8612-cd1d62238396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0e73b90748d4b8cb1122bccdb386165, user_id=b39b2b32ffcb478899d533c4863ddfd7, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:18.972666 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee9d1d-d9b4-4099-8612-cd1d62238396 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:18.984786 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1427/2840] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:42:18 2022] PUT /identity/v3/projects/e0e73b90748d4b8cb1122bccdb386165/users/b39b2b32ffcb478899d533c4863ddfd7/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:18.995776 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298fabf-8854-49bd-976f-95c857b982c3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:18.996069 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298fabf-8854-49bd-976f-95c857b982c3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:18.996347 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298fabf-8854-49bd-976f-95c857b982c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:19.021855 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f298fabf-8854-49bd-976f-95c857b982c3 None None] MFA Rules not processed for user `b39b2b32ffcb478899d533c4863ddfd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:19.023109 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f298fabf-8854-49bd-976f-95c857b982c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:19.094047 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1414/2841] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:19.099228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee9d1d-d9b4-4099-8612-cd1d62238396 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:19.160183 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee9d1d-d9b4-4099-8612-cd1d62238396 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:19.164754 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b027593-c357-43a7-b586-48cef40bcbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:19.165401 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b027593-c357-43a7-b586-48cef40bcbf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:19.165690 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b027593-c357-43a7-b586-48cef40bcbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:19.165997 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b027593-c357-43a7-b586-48cef40bcbf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:19.166702 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b027593-c357-43a7-b586-48cef40bcbf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:19.168603 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b027593-c357-43a7-b586-48cef40bcbf6 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:19.195056 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1428/2842] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:42:19 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:42:19.199058 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298fabf-8854-49bd-976f-95c857b982c3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:19.210359 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298fabf-8854-49bd-976f-95c857b982c3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:19.230448 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:19.267955 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7b696-1707-4db3-a661-cba21380c71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:19.268550 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7b696-1707-4db3-a661-cba21380c71b admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:19.268840 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7b696-1707-4db3-a661-cba21380c71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:19.269124 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7b696-1707-4db3-a661-cba21380c71b admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:19.269849 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7b696-1707-4db3-a661-cba21380c71b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:19.271959 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7b696-1707-4db3-a661-cba21380c71b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:19.291421 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1415/2843] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:42:19 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:42:19.295424 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b027593-c357-43a7-b586-48cef40bcbf6 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:19.306007 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b027593-c357-43a7-b586-48cef40bcbf6 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:19.310577 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b787f3-6243-403e-8ea7-d04e403d1c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:19.311228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b787f3-6243-403e-8ea7-d04e403d1c4a admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:19.311516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b787f3-6243-403e-8ea7-d04e403d1c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:19.311797 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b787f3-6243-403e-8ea7-d04e403d1c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:19.312535 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b787f3-6243-403e-8ea7-d04e403d1c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:19.314141 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b787f3-6243-403e-8ea7-d04e403d1c4a admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:19.324495 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1429/2844] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:42:19.328354 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7b696-1707-4db3-a661-cba21380c71b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:19.338649 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7b696-1707-4db3-a661-cba21380c71b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:19.343313 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68326a2-a21f-4a29-9e43-d7bf249faf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:19.344187 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68326a2-a21f-4a29-9e43-d7bf249faf9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:19.344475 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68326a2-a21f-4a29-9e43-d7bf249faf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:19.344759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68326a2-a21f-4a29-9e43-d7bf249faf9a admin admin] PATH_INFO: `/v3/projects/201920fefec344e5a9262d00af38e19b/users/c7048131c3f64b5d92ab3f734c308080/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:19.359980 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68326a2-a21f-4a29-9e43-d7bf249faf9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=201920fefec344e5a9262d00af38e19b, user_id=c7048131c3f64b5d92ab3f734c308080, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:19.363855 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68326a2-a21f-4a29-9e43-d7bf249faf9a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:19.377072 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1416/2845] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:42:19 2022] PUT /identity/v3/projects/201920fefec344e5a9262d00af38e19b/users/c7048131c3f64b5d92ab3f734c308080/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:19.381635 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b787f3-6243-403e-8ea7-d04e403d1c4a admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:19.393129 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b787f3-6243-403e-8ea7-d04e403d1c4a admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:19.412437 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:19.452422 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848b116-8eea-40eb-ab3a-73ccc6225977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:19.453084 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848b116-8eea-40eb-ab3a-73ccc6225977 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:19.453378 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848b116-8eea-40eb-ab3a-73ccc6225977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:19.453663 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848b116-8eea-40eb-ab3a-73ccc6225977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:19.454380 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848b116-8eea-40eb-ab3a-73ccc6225977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:19.456071 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848b116-8eea-40eb-ab3a-73ccc6225977 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:19.465741 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1430/2846] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 12:42:19.470033 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68326a2-a21f-4a29-9e43-d7bf249faf9a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:19.483567 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68326a2-a21f-4a29-9e43-d7bf249faf9a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:19.488998 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4564203-dc49-449f-b607-f9b594e4e736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:19.489905 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4564203-dc49-449f-b607-f9b594e4e736 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:19.490193 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4564203-dc49-449f-b607-f9b594e4e736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:19.490521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4564203-dc49-449f-b607-f9b594e4e736 admin admin] PATH_INFO: `/v3/projects/201920fefec344e5a9262d00af38e19b/users/c7048131c3f64b5d92ab3f734c308080/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:19.492494 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4564203-dc49-449f-b607-f9b594e4e736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=201920fefec344e5a9262d00af38e19b, user_id=c7048131c3f64b5d92ab3f734c308080, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:19.495189 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4564203-dc49-449f-b607-f9b594e4e736 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:19.506284 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1417/2847] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:42:19 2022] PUT /identity/v3/projects/201920fefec344e5a9262d00af38e19b/users/c7048131c3f64b5d92ab3f734c308080/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:19.516404 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad6426-5c70-4d1c-92f0-b587cd19f025 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:19.516920 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad6426-5c70-4d1c-92f0-b587cd19f025 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:19.517041 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad6426-5c70-4d1c-92f0-b587cd19f025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:19.543087 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-97ad6426-5c70-4d1c-92f0-b587cd19f025 None None] MFA Rules not processed for user `c7048131c3f64b5d92ab3f734c308080`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:19.544227 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-97ad6426-5c70-4d1c-92f0-b587cd19f025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:19.611023 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1431/2848] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:19 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:19.621500 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4564203-dc49-449f-b607-f9b594e4e736 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:19.623209 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d4564203-dc49-449f-b607-f9b594e4e736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:19.678735 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4564203-dc49-449f-b607-f9b594e4e736 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:19.682308 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9597401-4b65-4e8b-8b7f-c4f1862081fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:19.682963 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9597401-4b65-4e8b-8b7f-c4f1862081fe service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:19.683250 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9597401-4b65-4e8b-8b7f-c4f1862081fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:19.683521 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9597401-4b65-4e8b-8b7f-c4f1862081fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:19.692995 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9597401-4b65-4e8b-8b7f-c4f1862081fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:19.694430 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9597401-4b65-4e8b-8b7f-c4f1862081fe service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:19.703607 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1418/2849] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:42:19 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:42:20.996255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad6426-5c70-4d1c-92f0-b587cd19f025 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:21.058197 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad6426-5c70-4d1c-92f0-b587cd19f025 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:21.062720 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf0f36-9e4c-409c-8f83-8986a3edecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:21.063583 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf0f36-9e4c-409c-8f83-8986a3edecc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:21.064352 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf0f36-9e4c-409c-8f83-8986a3edecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:21.064628 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf0f36-9e4c-409c-8f83-8986a3edecc6 admin admin] PATH_INFO: `/v3/users/b39b2b32ffcb478899d533c4863ddfd7` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:21.065791 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf0f36-9e4c-409c-8f83-8986a3edecc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b39b2b32ffcb478899d533c4863ddfd7)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:21.067723 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf0f36-9e4c-409c-8f83-8986a3edecc6 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:21.115821 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:21.118772 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-a2bf0f36-9e4c-409c-8f83-8986a3edecc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b39b2b32ffcb478899d533c4863ddfd7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:21.127206 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-a2bf0f36-9e4c-409c-8f83-8986a3edecc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b39b2b32ffcb478899d533c4863ddfd7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:21.138891 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-a2bf0f36-9e4c-409c-8f83-8986a3edecc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b39b2b32ffcb478899d533c4863ddfd7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:21.146188 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-a2bf0f36-9e4c-409c-8f83-8986a3edecc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b39b2b32ffcb478899d533c4863ddfd7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:21.146890 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-a2bf0f36-9e4c-409c-8f83-8986a3edecc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b39b2b32ffcb478899d533c4863ddfd7'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:21.152672 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1432/2850] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:42:20 2022] DELETE /identity/v3/users/b39b2b32ffcb478899d533c4863ddfd7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:21.157097 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6451f-4b86-4aa1-9b8b-b25282378f91 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:21.157582 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6451f-4b86-4aa1-9b8b-b25282378f91 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:21.157683 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6451f-4b86-4aa1-9b8b-b25282378f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:21.175107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-38e6451f-4b86-4aa1-9b8b-b25282378f91 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:21.176303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-38e6451f-4b86-4aa1-9b8b-b25282378f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:21.233490 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1419/2851] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 12:42:21.242917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf0f36-9e4c-409c-8f83-8986a3edecc6 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:21.244323 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-a2bf0f36-9e4c-409c-8f83-8986a3edecc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:21.300850 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf0f36-9e4c-409c-8f83-8986a3edecc6 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:21.304449 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62ec7f-c315-40a3-afa9-3091782c8100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:21.305083 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62ec7f-c315-40a3-afa9-3091782c8100 service neutron] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:21.305370 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62ec7f-c315-40a3-afa9-3091782c8100 service neutron] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:21.305651 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62ec7f-c315-40a3-afa9-3091782c8100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:21.314984 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a62ec7f-c315-40a3-afa9-3091782c8100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:21.316406 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a62ec7f-c315-40a3-afa9-3091782c8100 service neutron] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:21.325691 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1433/2852] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:42:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:42:21.600120 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6451f-4b86-4aa1-9b8b-b25282378f91 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:21.601591 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-38e6451f-4b86-4aa1-9b8b-b25282378f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:21.616040 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6451f-4b86-4aa1-9b8b-b25282378f91 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:21.621363 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338bba9-de50-4c3c-acc3-b13586e57fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:21.622226 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338bba9-de50-4c3c-acc3-b13586e57fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:21.622560 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338bba9-de50-4c3c-acc3-b13586e57fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:21.622973 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338bba9-de50-4c3c-acc3-b13586e57fdc admin admin] PATH_INFO: `/v3/projects/e0e73b90748d4b8cb1122bccdb386165` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:21.624163 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338bba9-de50-4c3c-acc3-b13586e57fdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0e73b90748d4b8cb1122bccdb386165)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:21.626073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338bba9-de50-4c3c-acc3-b13586e57fdc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:21.642487 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:21.674037 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0338bba9-de50-4c3c-acc3-b13586e57fdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0e73b90748d4b8cb1122bccdb386165', 'request_id': 'req-0338bba9-de50-4c3c-acc3-b13586e57fdc'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:21.680231 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0338bba9-de50-4c3c-acc3-b13586e57fdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0e73b90748d4b8cb1122bccdb386165', 'request_id': 'req-0338bba9-de50-4c3c-acc3-b13586e57fdc'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:21.685918 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0338bba9-de50-4c3c-acc3-b13586e57fdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0e73b90748d4b8cb1122bccdb386165', 'request_id': 'req-0338bba9-de50-4c3c-acc3-b13586e57fdc'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:21.698242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0338bba9-de50-4c3c-acc3-b13586e57fdc admin admin] The token cache is being invalidate because project e0e73b90748d4b8cb1122bccdb386165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:42:21.698559 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0338bba9-de50-4c3c-acc3-b13586e57fdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:21.699181 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0338bba9-de50-4c3c-acc3-b13586e57fdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:21.700679 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1420/2853] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:42:21 2022] DELETE /identity/v3/projects/e0e73b90748d4b8cb1122bccdb386165 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:21.705142 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62ec7f-c315-40a3-afa9-3091782c8100 service neutron] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:21.714528 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62ec7f-c315-40a3-afa9-3091782c8100 service neutron] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:21.770992 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb2179-734b-472a-a6a8-0969ce9905cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:21.771859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb2179-734b-472a-a6a8-0969ce9905cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:21.772148 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb2179-734b-472a-a6a8-0969ce9905cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:21.772428 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb2179-734b-472a-a6a8-0969ce9905cb admin admin] PATH_INFO: `/v3/users/c7048131c3f64b5d92ab3f734c308080` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:21.773600 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb2179-734b-472a-a6a8-0969ce9905cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7048131c3f64b5d92ab3f734c308080)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:21.775584 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb2179-734b-472a-a6a8-0969ce9905cb admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:21.820372 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-8cbb2179-734b-472a-a6a8-0969ce9905cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7048131c3f64b5d92ab3f734c308080'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:21.827137 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-8cbb2179-734b-472a-a6a8-0969ce9905cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7048131c3f64b5d92ab3f734c308080'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:21.837263 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:21.839682 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-8cbb2179-734b-472a-a6a8-0969ce9905cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7048131c3f64b5d92ab3f734c308080'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:21.848973 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-8cbb2179-734b-472a-a6a8-0969ce9905cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7048131c3f64b5d92ab3f734c308080'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:21.849657 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-8cbb2179-734b-472a-a6a8-0969ce9905cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7048131c3f64b5d92ab3f734c308080'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:21.855658 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1434/2854] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:42:21 2022] DELETE /identity/v3/users/c7048131c3f64b5d92ab3f734c308080 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:42:22.125661 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338bba9-de50-4c3c-acc3-b13586e57fdc admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:22.127127 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0338bba9-de50-4c3c-acc3-b13586e57fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:22.141635 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338bba9-de50-4c3c-acc3-b13586e57fdc admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:22.202430 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2553d4-abc0-4e65-85b5-f5ea37cfa6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:22.203262 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2553d4-abc0-4e65-85b5-f5ea37cfa6ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:22.203551 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2553d4-abc0-4e65-85b5-f5ea37cfa6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:22.203834 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2553d4-abc0-4e65-85b5-f5ea37cfa6ea admin admin] PATH_INFO: `/v3/projects/201920fefec344e5a9262d00af38e19b` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:22.205036 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2553d4-abc0-4e65-85b5-f5ea37cfa6ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=201920fefec344e5a9262d00af38e19b)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:22.207048 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2553d4-abc0-4e65-85b5-f5ea37cfa6ea admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:22.253320 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4a2553d4-abc0-4e65-85b5-f5ea37cfa6ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '201920fefec344e5a9262d00af38e19b', 'request_id': 'req-4a2553d4-abc0-4e65-85b5-f5ea37cfa6ea'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:22.259361 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4a2553d4-abc0-4e65-85b5-f5ea37cfa6ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '201920fefec344e5a9262d00af38e19b', 'request_id': 'req-4a2553d4-abc0-4e65-85b5-f5ea37cfa6ea'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:22.264972 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4a2553d4-abc0-4e65-85b5-f5ea37cfa6ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '201920fefec344e5a9262d00af38e19b', 'request_id': 'req-4a2553d4-abc0-4e65-85b5-f5ea37cfa6ea'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:22.276837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4a2553d4-abc0-4e65-85b5-f5ea37cfa6ea admin admin] The token cache is being invalidate because project 201920fefec344e5a9262d00af38e19b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:42:22.277126 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4a2553d4-abc0-4e65-85b5-f5ea37cfa6ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:22.277732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4a2553d4-abc0-4e65-85b5-f5ea37cfa6ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:22.279273 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1421/2855] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:42:22 2022] DELETE /identity/v3/projects/201920fefec344e5a9262d00af38e19b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:22.284304 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8d37a-ddb6-406c-a84e-19e394c8e7e7 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:22.284791 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8d37a-ddb6-406c-a84e-19e394c8e7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:22.284894 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8d37a-ddb6-406c-a84e-19e394c8e7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:22.303460 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-ace8d37a-ddb6-406c-a84e-19e394c8e7e7 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:22.304686 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-ace8d37a-ddb6-406c-a84e-19e394c8e7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:22.363683 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1435/2856] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:22.371423 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5af94-0d32-4902-bf3f-92346afc7ecf None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:22.371724 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5af94-0d32-4902-bf3f-92346afc7ecf None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:22.372034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5af94-0d32-4902-bf3f-92346afc7ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:22.390836 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7ec5af94-0d32-4902-bf3f-92346afc7ecf None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:22.392136 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7ec5af94-0d32-4902-bf3f-92346afc7ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:22.400291 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1422/2857] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:22.404159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8d37a-ddb6-406c-a84e-19e394c8e7e7 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:22.413972 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8d37a-ddb6-406c-a84e-19e394c8e7e7 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:22.418553 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf92350-f506-47d0-baf7-805565abb31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:22.419209 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf92350-f506-47d0-baf7-805565abb31f admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:22.419499 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf92350-f506-47d0-baf7-805565abb31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:22.419780 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf92350-f506-47d0-baf7-805565abb31f admin admin] PATH_INFO: `/v3/domains` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:22.420500 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf92350-f506-47d0-baf7-805565abb31f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80199) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:42:22.420811 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf92350-f506-47d0-baf7-805565abb31f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:22.422413 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf92350-f506-47d0-baf7-805565abb31f admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:22.434865 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1436/2858] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:42:22.439366 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5af94-0d32-4902-bf3f-92346afc7ecf None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:22.448530 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5af94-0d32-4902-bf3f-92346afc7ecf None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:22.453239 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9b79c-6903-4aa7-b8f6-d986e1d1edc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:22.453826 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9b79c-6903-4aa7-b8f6-d986e1d1edc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:22.454115 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9b79c-6903-4aa7-b8f6-d986e1d1edc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:22.454429 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9b79c-6903-4aa7-b8f6-d986e1d1edc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:22.455151 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9b79c-6903-4aa7-b8f6-d986e1d1edc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:22.457065 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9b79c-6903-4aa7-b8f6-d986e1d1edc9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:22.484499 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1423/2859] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:42:22 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:42:22.486899 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf92350-f506-47d0-baf7-805565abb31f admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:22.496655 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf92350-f506-47d0-baf7-805565abb31f admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:22.552733 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de4cd7-e46d-48c9-998b-0d34c5b9bc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:22.553385 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de4cd7-e46d-48c9-998b-0d34c5b9bc92 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:22.553669 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de4cd7-e46d-48c9-998b-0d34c5b9bc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:22.553944 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de4cd7-e46d-48c9-998b-0d34c5b9bc92 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:22.554654 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de4cd7-e46d-48c9-998b-0d34c5b9bc92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:22.556580 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de4cd7-e46d-48c9-998b-0d34c5b9bc92 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:22.575383 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1437/2860] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:42:22 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:42:22.579522 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9b79c-6903-4aa7-b8f6-d986e1d1edc9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:22.586267 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:22.590452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9b79c-6903-4aa7-b8f6-d986e1d1edc9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:22.597304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d54bfe-c300-4dd9-8bc1-6f4e84ed3a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:22.597960 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d54bfe-c300-4dd9-8bc1-6f4e84ed3a27 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:22.598243 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d54bfe-c300-4dd9-8bc1-6f4e84ed3a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:22.598552 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d54bfe-c300-4dd9-8bc1-6f4e84ed3a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:22.599275 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d54bfe-c300-4dd9-8bc1-6f4e84ed3a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:22.600875 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d54bfe-c300-4dd9-8bc1-6f4e84ed3a27 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:22.611876 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1424/2861] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:42:22.615659 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de4cd7-e46d-48c9-998b-0d34c5b9bc92 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:22.625246 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de4cd7-e46d-48c9-998b-0d34c5b9bc92 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:22.629667 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d60e3-0c5e-4558-9e85-d946d1083225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:22.630311 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d60e3-0c5e-4558-9e85-d946d1083225 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:22.630624 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d60e3-0c5e-4558-9e85-d946d1083225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:22.630903 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d60e3-0c5e-4558-9e85-d946d1083225 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:22.631614 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d60e3-0c5e-4558-9e85-d946d1083225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:22.633188 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d60e3-0c5e-4558-9e85-d946d1083225 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:22.642885 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1438/2862] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:42:22.646715 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d54bfe-c300-4dd9-8bc1-6f4e84ed3a27 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:22.656290 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d54bfe-c300-4dd9-8bc1-6f4e84ed3a27 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:22.661288 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd43eb-ad78-4768-9574-b5eb66538448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:22.662156 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd43eb-ad78-4768-9574-b5eb66538448 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:22.662442 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd43eb-ad78-4768-9574-b5eb66538448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:22.662745 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd43eb-ad78-4768-9574-b5eb66538448 admin admin] PATH_INFO: `/v3/projects/b087526a4e4e4dd49f18e22f4b097ed7/users/0afceba614074d9c873502baed04510e/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:22.678405 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd43eb-ad78-4768-9574-b5eb66538448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b087526a4e4e4dd49f18e22f4b097ed7, user_id=0afceba614074d9c873502baed04510e, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:22.681116 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd43eb-ad78-4768-9574-b5eb66538448 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:22.693575 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1425/2863] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:42:22 2022] PUT /identity/v3/projects/b087526a4e4e4dd49f18e22f4b097ed7/users/0afceba614074d9c873502baed04510e/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:22.703853 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a90f6-94ad-49b4-aa1d-499151d465ac None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:22.704097 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a90f6-94ad-49b4-aa1d-499151d465ac None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:22.704380 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a90f6-94ad-49b4-aa1d-499151d465ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:22.730431 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-b22a90f6-94ad-49b4-aa1d-499151d465ac None None] MFA Rules not processed for user `0afceba614074d9c873502baed04510e`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:22.731661 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-b22a90f6-94ad-49b4-aa1d-499151d465ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:22.771347 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:22.797400 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1439/2864] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:22.802860 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd43eb-ad78-4768-9574-b5eb66538448 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:22.866110 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd43eb-ad78-4768-9574-b5eb66538448 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:22.870828 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288721e-fb53-4d15-a07d-f627664c2d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:22.871485 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288721e-fb53-4d15-a07d-f627664c2d3e admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:22.871775 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288721e-fb53-4d15-a07d-f627664c2d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:22.872055 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288721e-fb53-4d15-a07d-f627664c2d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:22.872751 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288721e-fb53-4d15-a07d-f627664c2d3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:22.874717 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288721e-fb53-4d15-a07d-f627664c2d3e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:22.899692 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1426/2865] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:42:22 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:42:22.903848 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a90f6-94ad-49b4-aa1d-499151d465ac None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:22.915037 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a90f6-94ad-49b4-aa1d-499151d465ac None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:22.969409 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8bb89-a99b-4efe-aa2d-11ce9f880578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:22.970070 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8bb89-a99b-4efe-aa2d-11ce9f880578 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:22.970360 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8bb89-a99b-4efe-aa2d-11ce9f880578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:22.970674 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8bb89-a99b-4efe-aa2d-11ce9f880578 admin admin] PATH_INFO: `/v3/users` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:22.971369 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8bb89-a99b-4efe-aa2d-11ce9f880578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:22.973324 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8bb89-a99b-4efe-aa2d-11ce9f880578 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:22.996157 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1440/2866] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:42:22 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:42:22.997305 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288721e-fb53-4d15-a07d-f627664c2d3e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:23.008175 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288721e-fb53-4d15-a07d-f627664c2d3e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:23.012759 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3167e6-ecb5-4931-b2cd-9d782c63ae63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:23.013414 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3167e6-ecb5-4931-b2cd-9d782c63ae63 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:23.013703 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3167e6-ecb5-4931-b2cd-9d782c63ae63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:23.013984 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3167e6-ecb5-4931-b2cd-9d782c63ae63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:23.014756 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3167e6-ecb5-4931-b2cd-9d782c63ae63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:23.016364 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3167e6-ecb5-4931-b2cd-9d782c63ae63 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:23.026819 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1427/2867] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:42:23.030767 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8bb89-a99b-4efe-aa2d-11ce9f880578 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:23.040469 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8bb89-a99b-4efe-aa2d-11ce9f880578 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:23.045040 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb43872-7ac3-48bc-aa41-679aa8f6943e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:23.045900 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb43872-7ac3-48bc-aa41-679aa8f6943e admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:23.046186 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb43872-7ac3-48bc-aa41-679aa8f6943e admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:23.046466 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb43872-7ac3-48bc-aa41-679aa8f6943e admin admin] PATH_INFO: `/v3/projects/ebf33d531da94cdeb7dd35dfa2f07faa/users/c15de7b67610437689d7003a1f6198fe/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:23.061940 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb43872-7ac3-48bc-aa41-679aa8f6943e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf33d531da94cdeb7dd35dfa2f07faa, user_id=c15de7b67610437689d7003a1f6198fe, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:23.065294 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb43872-7ac3-48bc-aa41-679aa8f6943e admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:23.077776 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1441/2868] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:42:23 2022] PUT /identity/v3/projects/ebf33d531da94cdeb7dd35dfa2f07faa/users/c15de7b67610437689d7003a1f6198fe/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 12:42:23.081633 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3167e6-ecb5-4931-b2cd-9d782c63ae63 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:23.091487 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3167e6-ecb5-4931-b2cd-9d782c63ae63 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:23.146351 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dff8f9-848e-4c9e-9639-ebbcebd5bc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:23.147045 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dff8f9-848e-4c9e-9639-ebbcebd5bc97 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:23.147366 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dff8f9-848e-4c9e-9639-ebbcebd5bc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:23.147647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dff8f9-848e-4c9e-9639-ebbcebd5bc97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:23.148369 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dff8f9-848e-4c9e-9639-ebbcebd5bc97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:23.149990 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dff8f9-848e-4c9e-9639-ebbcebd5bc97 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:23.160052 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1428/2869] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:42:23.164282 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb43872-7ac3-48bc-aa41-679aa8f6943e admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:23.175097 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb43872-7ac3-48bc-aa41-679aa8f6943e admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:23.179827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef2cca-2508-43cc-95c1-e316dc759383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:23.180715 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef2cca-2508-43cc-95c1-e316dc759383 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:23.180994 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef2cca-2508-43cc-95c1-e316dc759383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:23.181271 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef2cca-2508-43cc-95c1-e316dc759383 admin admin] PATH_INFO: `/v3/projects/ebf33d531da94cdeb7dd35dfa2f07faa/users/c15de7b67610437689d7003a1f6198fe/roles/3ae7c5e54e084ac4a1f94da93a667583` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:23.184142 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef2cca-2508-43cc-95c1-e316dc759383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf33d531da94cdeb7dd35dfa2f07faa, user_id=c15de7b67610437689d7003a1f6198fe, role_id=3ae7c5e54e084ac4a1f94da93a667583)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:23.187228 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef2cca-2508-43cc-95c1-e316dc759383 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:23.198894 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1442/2870] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:42:23 2022] PUT /identity/v3/projects/ebf33d531da94cdeb7dd35dfa2f07faa/users/c15de7b67610437689d7003a1f6198fe/roles/3ae7c5e54e084ac4a1f94da93a667583 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:23.210308 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e101ae5-d715-4832-949a-0611f3140990 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:23.210806 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e101ae5-d715-4832-949a-0611f3140990 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:23.210931 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e101ae5-d715-4832-949a-0611f3140990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:23.237337 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7e101ae5-d715-4832-949a-0611f3140990 None None] MFA Rules not processed for user `c15de7b67610437689d7003a1f6198fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:23.238488 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7e101ae5-d715-4832-949a-0611f3140990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:23.267720 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:23.307258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1429/2871] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:23.318425 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef2cca-2508-43cc-95c1-e316dc759383 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:23.320316 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-b9ef2cca-2508-43cc-95c1-e316dc759383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:23.378084 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef2cca-2508-43cc-95c1-e316dc759383 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:23.381832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fccef0-d1eb-41f3-8b97-78782e135428 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:23.382471 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fccef0-d1eb-41f3-8b97-78782e135428 service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:23.382787 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fccef0-d1eb-41f3-8b97-78782e135428 service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:23.383064 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fccef0-d1eb-41f3-8b97-78782e135428 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:23.391780 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fccef0-d1eb-41f3-8b97-78782e135428 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:23.393737 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fccef0-d1eb-41f3-8b97-78782e135428 service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:23.403423 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1443/2872] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:42:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:42:23.922729 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e101ae5-d715-4832-949a-0611f3140990 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:23.984707 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e101ae5-d715-4832-949a-0611f3140990 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:23.989631 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589df44c-8640-494b-a3e3-0b180a480886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:23.990489 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589df44c-8640-494b-a3e3-0b180a480886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:23.990798 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589df44c-8640-494b-a3e3-0b180a480886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:23.991073 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589df44c-8640-494b-a3e3-0b180a480886 admin admin] PATH_INFO: `/v3/users/0afceba614074d9c873502baed04510e` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:23.992278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589df44c-8640-494b-a3e3-0b180a480886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0afceba614074d9c873502baed04510e)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:23.994198 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589df44c-8640-494b-a3e3-0b180a480886 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:24.037974 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-589df44c-8640-494b-a3e3-0b180a480886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0afceba614074d9c873502baed04510e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:24.044739 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-589df44c-8640-494b-a3e3-0b180a480886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0afceba614074d9c873502baed04510e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:24.045353 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-589df44c-8640-494b-a3e3-0b180a480886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0afceba614074d9c873502baed04510e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:24.045949 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-589df44c-8640-494b-a3e3-0b180a480886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0afceba614074d9c873502baed04510e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:24.058645 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-589df44c-8640-494b-a3e3-0b180a480886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0afceba614074d9c873502baed04510e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:24.071316 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1430/2873] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:42:23 2022] DELETE /identity/v3/users/0afceba614074d9c873502baed04510e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:24.075777 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9798b-2747-4ef3-8d05-50b4076279ab None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:24.076070 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9798b-2747-4ef3-8d05-50b4076279ab None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:24.076350 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9798b-2747-4ef3-8d05-50b4076279ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:24.104654 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-4bb9798b-2747-4ef3-8d05-50b4076279ab None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:24.105879 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-4bb9798b-2747-4ef3-8d05-50b4076279ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:24.135985 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:24.165551 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1444/2874] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:24.175471 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589df44c-8640-494b-a3e3-0b180a480886 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:24.176878 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-589df44c-8640-494b-a3e3-0b180a480886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:24.223975 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:24.236567 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589df44c-8640-494b-a3e3-0b180a480886 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:24.240242 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8734d8b-0a98-449f-b1ac-28fe4292d63b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:24.240912 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8734d8b-0a98-449f-b1ac-28fe4292d63b service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:24.241218 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8734d8b-0a98-449f-b1ac-28fe4292d63b service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:24.241478 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8734d8b-0a98-449f-b1ac-28fe4292d63b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:24.250481 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8734d8b-0a98-449f-b1ac-28fe4292d63b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:24.252450 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8734d8b-0a98-449f-b1ac-28fe4292d63b service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:24.261745 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1431/2875] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:42:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:42:24.526658 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9798b-2747-4ef3-8d05-50b4076279ab None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:24.528156 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-4bb9798b-2747-4ef3-8d05-50b4076279ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:24.540514 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9798b-2747-4ef3-8d05-50b4076279ab None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:24.545953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b3268-1550-472b-8a58-6bab0b1f8476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:24.546851 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b3268-1550-472b-8a58-6bab0b1f8476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:24.547143 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b3268-1550-472b-8a58-6bab0b1f8476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:24.547426 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b3268-1550-472b-8a58-6bab0b1f8476 admin admin] PATH_INFO: `/v3/projects/b087526a4e4e4dd49f18e22f4b097ed7` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:24.549734 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b3268-1550-472b-8a58-6bab0b1f8476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b087526a4e4e4dd49f18e22f4b097ed7)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:24.551521 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b3268-1550-472b-8a58-6bab0b1f8476 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:24.597039 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-4b2b3268-1550-472b-8a58-6bab0b1f8476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b087526a4e4e4dd49f18e22f4b097ed7', 'request_id': 'req-4b2b3268-1550-472b-8a58-6bab0b1f8476'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:24.603044 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-4b2b3268-1550-472b-8a58-6bab0b1f8476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b087526a4e4e4dd49f18e22f4b097ed7', 'request_id': 'req-4b2b3268-1550-472b-8a58-6bab0b1f8476'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:24.610069 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-4b2b3268-1550-472b-8a58-6bab0b1f8476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b087526a4e4e4dd49f18e22f4b097ed7', 'request_id': 'req-4b2b3268-1550-472b-8a58-6bab0b1f8476'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:24.620859 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-4b2b3268-1550-472b-8a58-6bab0b1f8476 admin admin] The token cache is being invalidate because project b087526a4e4e4dd49f18e22f4b097ed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:42:24.621151 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-4b2b3268-1550-472b-8a58-6bab0b1f8476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:24.622234 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-4b2b3268-1550-472b-8a58-6bab0b1f8476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:24.623767 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1445/2876] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:42:24 2022] DELETE /identity/v3/projects/b087526a4e4e4dd49f18e22f4b097ed7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:24.628359 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8734d8b-0a98-449f-b1ac-28fe4292d63b service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:24.637866 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8734d8b-0a98-449f-b1ac-28fe4292d63b service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:24.693137 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38000dd0-07d3-41be-98b1-7af9aef6d0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:24.694005 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38000dd0-07d3-41be-98b1-7af9aef6d0c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:24.694294 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38000dd0-07d3-41be-98b1-7af9aef6d0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:24.694624 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38000dd0-07d3-41be-98b1-7af9aef6d0c6 admin admin] PATH_INFO: `/v3/users/c15de7b67610437689d7003a1f6198fe` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:24.695820 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38000dd0-07d3-41be-98b1-7af9aef6d0c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c15de7b67610437689d7003a1f6198fe)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:24.697788 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38000dd0-07d3-41be-98b1-7af9aef6d0c6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:24.741788 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-38000dd0-07d3-41be-98b1-7af9aef6d0c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c15de7b67610437689d7003a1f6198fe'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:24.748938 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-38000dd0-07d3-41be-98b1-7af9aef6d0c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c15de7b67610437689d7003a1f6198fe'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:24.749567 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-38000dd0-07d3-41be-98b1-7af9aef6d0c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c15de7b67610437689d7003a1f6198fe'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:24.750221 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-38000dd0-07d3-41be-98b1-7af9aef6d0c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c15de7b67610437689d7003a1f6198fe'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:24.763375 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-38000dd0-07d3-41be-98b1-7af9aef6d0c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c15de7b67610437689d7003a1f6198fe'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:24.775562 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1432/2877] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:42:24 2022] DELETE /identity/v3/users/c15de7b67610437689d7003a1f6198fe => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:25.041632 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b3268-1550-472b-8a58-6bab0b1f8476 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:25.043102 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-4b2b3268-1550-472b-8a58-6bab0b1f8476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:25.058750 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b3268-1550-472b-8a58-6bab0b1f8476 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:25.116573 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc0b00-bfb1-4423-950a-c129585f6352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:25.117663 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc0b00-bfb1-4423-950a-c129585f6352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:25.117981 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc0b00-bfb1-4423-950a-c129585f6352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:25.118260 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc0b00-bfb1-4423-950a-c129585f6352 admin admin] PATH_INFO: `/v3/projects/ebf33d531da94cdeb7dd35dfa2f07faa` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:25.119497 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc0b00-bfb1-4423-950a-c129585f6352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebf33d531da94cdeb7dd35dfa2f07faa)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:25.121452 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc0b00-bfb1-4423-950a-c129585f6352 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:25.166418 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-fffc0b00-bfb1-4423-950a-c129585f6352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebf33d531da94cdeb7dd35dfa2f07faa', 'request_id': 'req-fffc0b00-bfb1-4423-950a-c129585f6352'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:25.172490 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-fffc0b00-bfb1-4423-950a-c129585f6352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebf33d531da94cdeb7dd35dfa2f07faa', 'request_id': 'req-fffc0b00-bfb1-4423-950a-c129585f6352'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:25.180359 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-fffc0b00-bfb1-4423-950a-c129585f6352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebf33d531da94cdeb7dd35dfa2f07faa', 'request_id': 'req-fffc0b00-bfb1-4423-950a-c129585f6352'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:25.181624 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:25.194482 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-fffc0b00-bfb1-4423-950a-c129585f6352 admin admin] The token cache is being invalidate because project ebf33d531da94cdeb7dd35dfa2f07faa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:42:25.194800 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-fffc0b00-bfb1-4423-950a-c129585f6352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:25.195432 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-fffc0b00-bfb1-4423-950a-c129585f6352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:25.196940 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1446/2878] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:42:25 2022] DELETE /identity/v3/projects/ebf33d531da94cdeb7dd35dfa2f07faa => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:25.201738 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b00c5-44cb-4757-98fd-8cf5edb77e91 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:25.202030 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b00c5-44cb-4757-98fd-8cf5edb77e91 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:25.202308 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b00c5-44cb-4757-98fd-8cf5edb77e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:25.220278 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-811b00c5-44cb-4757-98fd-8cf5edb77e91 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:25.221478 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-811b00c5-44cb-4757-98fd-8cf5edb77e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:25.279658 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1433/2879] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:25.287251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a1eca-8cab-4892-b3d1-2cb58f465422 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:25.287547 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a1eca-8cab-4892-b3d1-2cb58f465422 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:25.287827 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a1eca-8cab-4892-b3d1-2cb58f465422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:25.306471 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-4a5a1eca-8cab-4892-b3d1-2cb58f465422 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:25.307745 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-4a5a1eca-8cab-4892-b3d1-2cb58f465422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:25.316468 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1447/2880] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:25.320568 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b00c5-44cb-4757-98fd-8cf5edb77e91 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:25.330179 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b00c5-44cb-4757-98fd-8cf5edb77e91 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:25.334860 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087fcb9-4483-4ee1-969a-49261586c5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:25.335513 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087fcb9-4483-4ee1-969a-49261586c5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:25.335801 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087fcb9-4483-4ee1-969a-49261586c5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:25.336078 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087fcb9-4483-4ee1-969a-49261586c5a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:25.336801 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087fcb9-4483-4ee1-969a-49261586c5a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:42:25.337108 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087fcb9-4483-4ee1-969a-49261586c5a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:25.338755 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087fcb9-4483-4ee1-969a-49261586c5a4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:25.340199 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:25.351838 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1434/2881] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:42:25.355790 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a1eca-8cab-4892-b3d1-2cb58f465422 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:25.365396 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a1eca-8cab-4892-b3d1-2cb58f465422 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:25.370013 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee185b1b-28cd-4195-b62e-b819a57a8e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:25.370693 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee185b1b-28cd-4195-b62e-b819a57a8e2a admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:25.370982 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee185b1b-28cd-4195-b62e-b819a57a8e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:25.371259 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee185b1b-28cd-4195-b62e-b819a57a8e2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:25.371938 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee185b1b-28cd-4195-b62e-b819a57a8e2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:25.373820 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee185b1b-28cd-4195-b62e-b819a57a8e2a admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:25.400654 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1448/2882] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:42:25 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:42:25.404583 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087fcb9-4483-4ee1-969a-49261586c5a4 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:25.414482 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087fcb9-4483-4ee1-969a-49261586c5a4 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:25.471076 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf2500-2f61-41c1-ae63-455081eebd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:25.471684 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf2500-2f61-41c1-ae63-455081eebd96 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:25.471971 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf2500-2f61-41c1-ae63-455081eebd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:25.472249 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf2500-2f61-41c1-ae63-455081eebd96 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:25.473006 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf2500-2f61-41c1-ae63-455081eebd96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:25.474985 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf2500-2f61-41c1-ae63-455081eebd96 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:25.494358 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1435/2883] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:42:25 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:42:25.498436 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee185b1b-28cd-4195-b62e-b819a57a8e2a admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:25.508646 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee185b1b-28cd-4195-b62e-b819a57a8e2a admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:25.513147 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdd928-722e-4638-bc74-bac51b732dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:25.513790 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdd928-722e-4638-bc74-bac51b732dbe admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:25.514075 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdd928-722e-4638-bc74-bac51b732dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:25.514369 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdd928-722e-4638-bc74-bac51b732dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:25.515099 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdd928-722e-4638-bc74-bac51b732dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:25.516693 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdd928-722e-4638-bc74-bac51b732dbe admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:25.530643 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1449/2884] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:42:25.535292 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf2500-2f61-41c1-ae63-455081eebd96 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:25.545301 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf2500-2f61-41c1-ae63-455081eebd96 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:25.550892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4ecf6-d316-492a-a933-6eb9621f3b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:25.551545 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4ecf6-d316-492a-a933-6eb9621f3b4e admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:25.551832 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4ecf6-d316-492a-a933-6eb9621f3b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:25.552107 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4ecf6-d316-492a-a933-6eb9621f3b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:25.552835 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4ecf6-d316-492a-a933-6eb9621f3b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:25.554439 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4ecf6-d316-492a-a933-6eb9621f3b4e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:25.564176 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1436/2885] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:42:25.568344 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdd928-722e-4638-bc74-bac51b732dbe admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:25.578083 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdd928-722e-4638-bc74-bac51b732dbe admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:25.582580 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de60d5-d712-41ce-9046-c806059e07a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:25.583444 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de60d5-d712-41ce-9046-c806059e07a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:25.583755 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de60d5-d712-41ce-9046-c806059e07a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:25.584033 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de60d5-d712-41ce-9046-c806059e07a6 admin admin] PATH_INFO: `/v3/projects/b21dd750e7bb40d1aa05802365831a8d/users/71e780d80e0d4465be155bcc2654e12a/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:25.598676 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de60d5-d712-41ce-9046-c806059e07a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b21dd750e7bb40d1aa05802365831a8d, user_id=71e780d80e0d4465be155bcc2654e12a, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:25.601292 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de60d5-d712-41ce-9046-c806059e07a6 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:25.614417 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1450/2886] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:42:25 2022] PUT /identity/v3/projects/b21dd750e7bb40d1aa05802365831a8d/users/71e780d80e0d4465be155bcc2654e12a/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:25.624593 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeb3fd-bc13-4203-bcf4-2b1d0d2398a2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:25.624891 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeb3fd-bc13-4203-bcf4-2b1d0d2398a2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:25.625174 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeb3fd-bc13-4203-bcf4-2b1d0d2398a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:25.650643 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-34eeb3fd-bc13-4203-bcf4-2b1d0d2398a2 None None] MFA Rules not processed for user `71e780d80e0d4465be155bcc2654e12a`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:25.651858 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-34eeb3fd-bc13-4203-bcf4-2b1d0d2398a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:25.714645 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1437/2887] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:25.726343 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de60d5-d712-41ce-9046-c806059e07a6 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:25.727952 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-89de60d5-d712-41ce-9046-c806059e07a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:25.783044 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de60d5-d712-41ce-9046-c806059e07a6 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:25.786630 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36b057-9970-40d6-861f-e3178e8a003e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:25.787257 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36b057-9970-40d6-861f-e3178e8a003e service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:25.787542 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36b057-9970-40d6-861f-e3178e8a003e service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:25.787825 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36b057-9970-40d6-861f-e3178e8a003e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:25.795837 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36b057-9970-40d6-861f-e3178e8a003e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:25.797249 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36b057-9970-40d6-861f-e3178e8a003e service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:25.806578 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1451/2888] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:42:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:42:28.343256 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eeb3fd-bc13-4203-bcf4-2b1d0d2398a2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:28.404501 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eeb3fd-bc13-4203-bcf4-2b1d0d2398a2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:28.409006 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ff46a-194e-41f9-b107-6413630285f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:28.409868 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ff46a-194e-41f9-b107-6413630285f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:28.410156 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ff46a-194e-41f9-b107-6413630285f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:28.410437 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ff46a-194e-41f9-b107-6413630285f8 admin admin] PATH_INFO: `/v3/users/71e780d80e0d4465be155bcc2654e12a` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:28.411647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ff46a-194e-41f9-b107-6413630285f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e780d80e0d4465be155bcc2654e12a)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:28.413608 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ff46a-194e-41f9-b107-6413630285f8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:28.415892 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:28.462548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-aa3ff46a-194e-41f9-b107-6413630285f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e780d80e0d4465be155bcc2654e12a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:28.470803 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-aa3ff46a-194e-41f9-b107-6413630285f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e780d80e0d4465be155bcc2654e12a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:28.471412 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-aa3ff46a-194e-41f9-b107-6413630285f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e780d80e0d4465be155bcc2654e12a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:28.472034 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-aa3ff46a-194e-41f9-b107-6413630285f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e780d80e0d4465be155bcc2654e12a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:28.484169 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-aa3ff46a-194e-41f9-b107-6413630285f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e780d80e0d4465be155bcc2654e12a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:28.496617 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1438/2889] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:42:28 2022] DELETE /identity/v3/users/71e780d80e0d4465be155bcc2654e12a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:28.501604 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099831a7-46e5-4ee8-ab09-24b200d316fb None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:28.502103 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099831a7-46e5-4ee8-ab09-24b200d316fb None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:28.502207 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099831a7-46e5-4ee8-ab09-24b200d316fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:28.519222 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-099831a7-46e5-4ee8-ab09-24b200d316fb None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:28.520419 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-099831a7-46e5-4ee8-ab09-24b200d316fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:28.582158 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1452/2890] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:28.591843 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ff46a-194e-41f9-b107-6413630285f8 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:28.593247 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-aa3ff46a-194e-41f9-b107-6413630285f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:28.650257 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ff46a-194e-41f9-b107-6413630285f8 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:28.654548 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb89792-fb7b-4338-aef8-1e3ba4c52f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:28.655228 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb89792-fb7b-4338-aef8-1e3ba4c52f47 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:28.655516 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb89792-fb7b-4338-aef8-1e3ba4c52f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:28.655793 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb89792-fb7b-4338-aef8-1e3ba4c52f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:28.664837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb89792-fb7b-4338-aef8-1e3ba4c52f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:28.666283 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb89792-fb7b-4338-aef8-1e3ba4c52f47 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:28.675934 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1439/2891] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:42:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:42:28.941063 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099831a7-46e5-4ee8-ab09-24b200d316fb None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:28.942487 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-099831a7-46e5-4ee8-ab09-24b200d316fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:28.954958 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099831a7-46e5-4ee8-ab09-24b200d316fb None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:28.960076 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f7555-b248-4c25-9004-db5d29b50649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:28.960974 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f7555-b248-4c25-9004-db5d29b50649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:28.961265 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f7555-b248-4c25-9004-db5d29b50649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:28.962072 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f7555-b248-4c25-9004-db5d29b50649 admin admin] PATH_INFO: `/v3/projects/b21dd750e7bb40d1aa05802365831a8d` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:28.963516 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f7555-b248-4c25-9004-db5d29b50649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b21dd750e7bb40d1aa05802365831a8d)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:28.965584 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f7555-b248-4c25-9004-db5d29b50649 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:28.992182 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:29.015726 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-172f7555-b248-4c25-9004-db5d29b50649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b21dd750e7bb40d1aa05802365831a8d', 'request_id': 'req-172f7555-b248-4c25-9004-db5d29b50649'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:29.022619 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-172f7555-b248-4c25-9004-db5d29b50649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b21dd750e7bb40d1aa05802365831a8d', 'request_id': 'req-172f7555-b248-4c25-9004-db5d29b50649'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:29.029596 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-172f7555-b248-4c25-9004-db5d29b50649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b21dd750e7bb40d1aa05802365831a8d', 'request_id': 'req-172f7555-b248-4c25-9004-db5d29b50649'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:29.040557 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-172f7555-b248-4c25-9004-db5d29b50649 admin admin] The token cache is being invalidate because project b21dd750e7bb40d1aa05802365831a8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:42:29.040850 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-172f7555-b248-4c25-9004-db5d29b50649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:29.041514 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-172f7555-b248-4c25-9004-db5d29b50649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:29.043067 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1453/2892] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:42:28 2022] DELETE /identity/v3/projects/b21dd750e7bb40d1aa05802365831a8d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:29.047832 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade0469-26d2-4225-a2ba-fa6ab7389570 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:29.048118 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade0469-26d2-4225-a2ba-fa6ab7389570 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:29.048394 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade0469-26d2-4225-a2ba-fa6ab7389570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:29.065637 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0ade0469-26d2-4225-a2ba-fa6ab7389570 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:29.066886 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0ade0469-26d2-4225-a2ba-fa6ab7389570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:29.125029 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1440/2893] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:29.184572 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7258f24-cae1-44f3-8a00-052a01b949b3 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:29.184865 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7258f24-cae1-44f3-8a00-052a01b949b3 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:29.185151 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7258f24-cae1-44f3-8a00-052a01b949b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:29.204522 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-b7258f24-cae1-44f3-8a00-052a01b949b3 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:29.205740 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-b7258f24-cae1-44f3-8a00-052a01b949b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:29.213625 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1454/2894] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:29.217811 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade0469-26d2-4225-a2ba-fa6ab7389570 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:29.228220 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade0469-26d2-4225-a2ba-fa6ab7389570 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:29.232753 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69ae4d-637c-44cb-b1d0-c513a7fa375f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:29.233440 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69ae4d-637c-44cb-b1d0-c513a7fa375f admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:29.233728 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69ae4d-637c-44cb-b1d0-c513a7fa375f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:29.234011 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69ae4d-637c-44cb-b1d0-c513a7fa375f admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:29.234764 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69ae4d-637c-44cb-b1d0-c513a7fa375f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 12:42:29.235078 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69ae4d-637c-44cb-b1d0-c513a7fa375f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:29.236716 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69ae4d-637c-44cb-b1d0-c513a7fa375f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:29.248314 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1441/2895] 10.222.0.25 () {58 vars in 1152 bytes} [Mon May 23 12:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 12:42:29.252796 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7258f24-cae1-44f3-8a00-052a01b949b3 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:29.261934 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7258f24-cae1-44f3-8a00-052a01b949b3 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:29.267111 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de9e6a-1276-4cdc-9493-8597ccf754f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:29.267769 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de9e6a-1276-4cdc-9493-8597ccf754f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:29.268063 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de9e6a-1276-4cdc-9493-8597ccf754f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:29.268348 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de9e6a-1276-4cdc-9493-8597ccf754f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:29.269159 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de9e6a-1276-4cdc-9493-8597ccf754f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:29.271117 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de9e6a-1276-4cdc-9493-8597ccf754f0 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:29.295727 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1455/2896] 10.222.0.25 () {60 vars in 1152 bytes} [Mon May 23 12:42:29 2022] POST /identity/v3/projects => generated 397 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:42:29.299923 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69ae4d-637c-44cb-b1d0-c513a7fa375f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:29.309622 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69ae4d-637c-44cb-b1d0-c513a7fa375f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:29.317716 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:29.366427 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a3ec2-512c-4883-a5a3-c3df10024e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:29.367158 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a3ec2-512c-4883-a5a3-c3df10024e74 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:29.367452 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a3ec2-512c-4883-a5a3-c3df10024e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:29.367732 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a3ec2-512c-4883-a5a3-c3df10024e74 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:29.368435 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a3ec2-512c-4883-a5a3-c3df10024e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:29.370367 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a3ec2-512c-4883-a5a3-c3df10024e74 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:29.389989 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1442/2897] 10.222.0.25 () {60 vars in 1143 bytes} [Mon May 23 12:42:29 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 12:42:29.394682 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de9e6a-1276-4cdc-9493-8597ccf754f0 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:29.404913 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de9e6a-1276-4cdc-9493-8597ccf754f0 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:29.409569 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d92db4-75b7-45aa-b48c-49011126c1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:29.410220 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d92db4-75b7-45aa-b48c-49011126c1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:29.410524 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d92db4-75b7-45aa-b48c-49011126c1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:29.410832 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d92db4-75b7-45aa-b48c-49011126c1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:29.411559 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d92db4-75b7-45aa-b48c-49011126c1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:29.413171 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d92db4-75b7-45aa-b48c-49011126c1e2 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:29.424549 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1456/2898] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:42:29.428571 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a3ec2-512c-4883-a5a3-c3df10024e74 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:29.439167 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a3ec2-512c-4883-a5a3-c3df10024e74 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:29.443886 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467fe90-4f89-4e7c-baae-9ccab8ff2a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:29.444539 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467fe90-4f89-4e7c-baae-9ccab8ff2a99 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:29.444827 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467fe90-4f89-4e7c-baae-9ccab8ff2a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:29.445110 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467fe90-4f89-4e7c-baae-9ccab8ff2a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:29.445840 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467fe90-4f89-4e7c-baae-9ccab8ff2a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:29.447506 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467fe90-4f89-4e7c-baae-9ccab8ff2a99 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:29.457330 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1443/2899] 10.222.0.25 () {58 vars in 1121 bytes} [Mon May 23 12:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 12:42:29.461255 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d92db4-75b7-45aa-b48c-49011126c1e2 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:29.471912 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d92db4-75b7-45aa-b48c-49011126c1e2 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:29.476738 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70779c-4624-455d-b22d-aa261168e076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:29.477624 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70779c-4624-455d-b22d-aa261168e076 admin admin] REQUEST_METHOD: `PUT` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:29.477911 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70779c-4624-455d-b22d-aa261168e076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:29.478192 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70779c-4624-455d-b22d-aa261168e076 admin admin] PATH_INFO: `/v3/projects/affcae2f0d6c4f4dabb34af3b35b01c5/users/5234efd6f19a45eeb954256fd189ea26/roles/3dac847973464a2cb123dc2c9083baf3` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:29.492688 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70779c-4624-455d-b22d-aa261168e076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=affcae2f0d6c4f4dabb34af3b35b01c5, user_id=5234efd6f19a45eeb954256fd189ea26, role_id=3dac847973464a2cb123dc2c9083baf3)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:29.495369 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70779c-4624-455d-b22d-aa261168e076 admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:29.508196 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1457/2900] 10.222.0.25 () {60 vars in 1482 bytes} [Mon May 23 12:42:29 2022] PUT /identity/v3/projects/affcae2f0d6c4f4dabb34af3b35b01c5/users/5234efd6f19a45eeb954256fd189ea26/roles/3dac847973464a2cb123dc2c9083baf3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:29.518489 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8473fb-c0ba-488e-8acb-a87b786c66ea None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:29.526471 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8473fb-c0ba-488e-8acb-a87b786c66ea None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:29.526471 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8473fb-c0ba-488e-8acb-a87b786c66ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:29.545647 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-eb8473fb-c0ba-488e-8acb-a87b786c66ea None None] MFA Rules not processed for user `5234efd6f19a45eeb954256fd189ea26`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:29.546939 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-eb8473fb-c0ba-488e-8acb-a87b786c66ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:29.621304 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1444/2901] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:29.633221 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70779c-4624-455d-b22d-aa261168e076 admin admin] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:29.634916 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-3a70779c-4624-455d-b22d-aa261168e076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:29.691974 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70779c-4624-455d-b22d-aa261168e076 admin admin] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:29.695634 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a15e30-ef10-4251-8641-933aceb4f894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3f520fcbe544c9be7e33a64eb1dc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:29.696283 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a15e30-ef10-4251-8641-933aceb4f894 service cinder] REQUEST_METHOD: `GET` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:29.696602 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a15e30-ef10-4251-8641-933aceb4f894 service cinder] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:29.696882 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a15e30-ef10-4251-8641-933aceb4f894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:29.705917 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a15e30-ef10-4251-8641-933aceb4f894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:29.707419 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a15e30-ef10-4251-8641-933aceb4f894 service cinder] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:29.716711 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1458/2902] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:42:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:42:34.719337 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8473fb-c0ba-488e-8acb-a87b786c66ea None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:34.780238 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8473fb-c0ba-488e-8acb-a87b786c66ea None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:34.784675 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c154e-9abe-4860-92e6-def5f89a6721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:34.785536 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c154e-9abe-4860-92e6-def5f89a6721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:34.785818 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c154e-9abe-4860-92e6-def5f89a6721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:34.786091 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c154e-9abe-4860-92e6-def5f89a6721 admin admin] PATH_INFO: `/v3/users/5234efd6f19a45eeb954256fd189ea26` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:34.787568 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c154e-9abe-4860-92e6-def5f89a6721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5234efd6f19a45eeb954256fd189ea26)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:34.790769 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c154e-9abe-4860-92e6-def5f89a6721 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:34.816903 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:34.843504 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-af2c154e-9abe-4860-92e6-def5f89a6721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5234efd6f19a45eeb954256fd189ea26'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:34.851991 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-af2c154e-9abe-4860-92e6-def5f89a6721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5234efd6f19a45eeb954256fd189ea26'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:34.852613 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-af2c154e-9abe-4860-92e6-def5f89a6721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5234efd6f19a45eeb954256fd189ea26'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:34.853258 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-af2c154e-9abe-4860-92e6-def5f89a6721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5234efd6f19a45eeb954256fd189ea26'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:34.866003 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-af2c154e-9abe-4860-92e6-def5f89a6721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5234efd6f19a45eeb954256fd189ea26'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:34.878459 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1445/2903] 10.222.0.25 () {58 vars in 1223 bytes} [Mon May 23 12:42:34 2022] DELETE /identity/v3/users/5234efd6f19a45eeb954256fd189ea26 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:34.883019 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e563189-822d-4a0d-bba7-06db854dcd08 None None] REQUEST_METHOD: `POST` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:34.883531 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e563189-822d-4a0d-bba7-06db854dcd08 None None] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:34.883645 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e563189-822d-4a0d-bba7-06db854dcd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:34.900526 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.auth.core [None req-0e563189-822d-4a0d-bba7-06db854dcd08 None None] MFA Rules not processed for user `38b5788f4258438a9175f55196c13413`. Rule list: `[]` (Enabled: `True`). {{(pid=80199) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 12:42:34.901771 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-0e563189-822d-4a0d-bba7-06db854dcd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:34.946353 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:34.962454 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1459/2904] 10.222.0.25 () {58 vars in 957 bytes} [Mon May 23 12:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 12:42:34.972117 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c154e-9abe-4860-92e6-def5f89a6721 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:34.973517 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-af2c154e-9abe-4860-92e6-def5f89a6721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:35.033654 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c154e-9abe-4860-92e6-def5f89a6721 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:35.037303 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b33100-aab6-4746-9d1d-0bfe8d19ac2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74674b52807742abb7e144bba3bb6e56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:35.037952 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b33100-aab6-4746-9d1d-0bfe8d19ac2b service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:35.038239 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b33100-aab6-4746-9d1d-0bfe8d19ac2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:35.038592 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b33100-aab6-4746-9d1d-0bfe8d19ac2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:35.048095 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b33100-aab6-4746-9d1d-0bfe8d19ac2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:35.049795 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b33100-aab6-4746-9d1d-0bfe8d19ac2b service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:35.059482 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1446/2905] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:42:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:42:35.342935 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e563189-822d-4a0d-bba7-06db854dcd08 None None] Authenticating user token {{(pid=80199) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:42:35.344904 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.fernet_utils [None req-0e563189-822d-4a0d-bba7-06db854dcd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80199) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:42:35.357736 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e563189-822d-4a0d-bba7-06db854dcd08 None None] Validating token access rules against request {{(pid=80199) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:42:35.363251 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f12ef2-2d68-4b92-a8e0-8d32510038ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b5788f4258438a9175f55196c13413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14be2fbaccef4510a5810ab627c88a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80199) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:42:35.364317 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f12ef2-2d68-4b92-a8e0-8d32510038ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:42:35.364739 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f12ef2-2d68-4b92-a8e0-8d32510038ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:42:35.365195 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f12ef2-2d68-4b92-a8e0-8d32510038ea admin admin] PATH_INFO: `/v3/projects/affcae2f0d6c4f4dabb34af3b35b01c5` {{(pid=80199) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:42:35.366635 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f12ef2-2d68-4b92-a8e0-8d32510038ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=affcae2f0d6c4f4dabb34af3b35b01c5)` {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:42:35.368633 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f12ef2-2d68-4b92-a8e0-8d32510038ea admin admin] RBAC: Authorization granted {{(pid=80199) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:42:35.415331 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-53f12ef2-2d68-4b92-a8e0-8d32510038ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'affcae2f0d6c4f4dabb34af3b35b01c5', 'request_id': 'req-53f12ef2-2d68-4b92-a8e0-8d32510038ea'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:35.421464 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-53f12ef2-2d68-4b92-a8e0-8d32510038ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'affcae2f0d6c4f4dabb34af3b35b01c5', 'request_id': 'req-53f12ef2-2d68-4b92-a8e0-8d32510038ea'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:35.429082 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-53f12ef2-2d68-4b92-a8e0-8d32510038ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'affcae2f0d6c4f4dabb34af3b35b01c5', 'request_id': 'req-53f12ef2-2d68-4b92-a8e0-8d32510038ea'} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:35.439661 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-53f12ef2-2d68-4b92-a8e0-8d32510038ea admin admin] The token cache is being invalidate because project affcae2f0d6c4f4dabb34af3b35b01c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80199) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 12:42:35.439953 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-53f12ef2-2d68-4b92-a8e0-8d32510038ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:35.440581 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG keystone.notifications [None req-53f12ef2-2d68-4b92-a8e0-8d32510038ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80199) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 12:42:35.442106 dv-cinder-836996-27-smb devstack@keystone.service[80199]: [pid: 80199|app: 0|req: 1460/2906] 10.222.0.25 () {58 vars in 1232 bytes} [Mon May 23 12:42:35 2022] DELETE /identity/v3/projects/affcae2f0d6c4f4dabb34af3b35b01c5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 12:42:45.055043 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:DELETE=7,keystone:SELECT=46,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:42:45.436568 dv-cinder-836996-27-smb devstack@keystone.service[80199]: DEBUG dbcounter [-] [80199] Writing DB stats keystone:SELECT=31,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 12:46:14.510138 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b33100-aab6-4746-9d1d-0bfe8d19ac2b service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 12:46:14.511546 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-96b33100-aab6-4746-9d1d-0bfe8d19ac2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:46:14.645837 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b33100-aab6-4746-9d1d-0bfe8d19ac2b service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 12:46:14.703682 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1994dde-d427-409d-9ec6-c6cd6443d9f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3fde90ab1e0490ebb7cb514173d984e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '402397b981be4f0c9e778a2771c41937', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 12:46:14.704332 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1994dde-d427-409d-9ec6-c6cd6443d9f2 service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 12:46:14.704617 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1994dde-d427-409d-9ec6-c6cd6443d9f2 service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 12:46:14.704894 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1994dde-d427-409d-9ec6-c6cd6443d9f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 12:46:14.706725 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b1994dde-d427-409d-9ec6-c6cd6443d9f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 12:46:14.718402 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1994dde-d427-409d-9ec6-c6cd6443d9f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 12:46:14.720035 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1994dde-d427-409d-9ec6-c6cd6443d9f2 service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 12:46:14.729766 dv-cinder-836996-27-smb devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1447/2907] 10.222.0.25 () {60 vars in 1365 bytes} [Mon May 23 12:46:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 12:46:24.725515 dv-cinder-836996-27-smb devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}